Grok.com Prompt Scraper 🧠

Overview

This Apify actor allows you to extract prompt/response pairs from Grok.com by submitting one or more natural language questions to any given URL. It's ideal for collecting structured AI-generated responses for research, benchmarking, SEO, or content analysis use cases.

Why choose this actor? 🌟

If you're looking to automate data collection from Grok.com’s prompt-based Q&A interface, this actor is your go-to tool. It requires no manual interaction, no proxy configuration, and gives you access to clear, consistent JSON outputs ready for immediate analysis.

NO PROXIES NEEDED
FREE USERS CAN SCRAPE UP TO 10 RESULTS
MAX_RESULTS MUST BE A MULTIPLE OF 10

Use Cases

• Competitive analysis of AI-generated answers
• SEO research by prompt/topic
• Dataset generation for fine-tuning LLMs
• Educational material collection from expert Q&A
• Prompt engineering testing or benchmarking

Key Features 🔑

• Simple input: Just provide the prompts and target URL(s)
• Fast and proxy-free: Works instantly without needing proxy setup
• Clean JSON output with full context and response
• Smart handling of multiple prompts per URL

How It Works

1. You input one or more prompts to test on a given Grok.com URL.
2. The actor sends each prompt to the URL and waits for the AI-generated response.
3. It parses and saves all outputs in structured format (JSON) with full context.
4. The results are compiled into a dataset, ready for download or API access.

Input Parameters

Field	Type	Description	Example
prompts	array	List of prompts or instructions the actor will run against the supplied URL(s).	["What is SQL?", "John Doe bio"]

Output (Full Example)

[
  {
    "url": "https://grok.com/",
    "prompt": "What's the difference between SQL and no-SQL",
    "answer_text": "SQL and NoSQL databases differ in their structure, use cases, and approach to data management...",
    "answer_text_markdown": "SQL and NoSQL databases differ in their structure, use cases, and approach to data management. Here's a concise comparison:\n\n**SQL (Relational Databases):**...",
    "citations": null,
    "timestamp": "2025-07-28T17:49:03.033Z",
    "input": {
      "url": "https://grok.com/",
      "prompt": "What's the difference between SQL and no-SQL",
      "index": 1
    }
  },
  {
    "url": "https://grok.com/",
    "prompt": "What does SQL stands for",
    "answer_text": "SQL stands for Structured Query Language .",
    "answer_text_markdown": "SQL stands for **Structured Query Language**.",
    "citations": null,
    "timestamp": "2025-07-28T17:47:21.275Z",
    "input": {
      "url": "https://grok.com/",
      "prompt": "What does SQL stands for",
      "index": 0
    }
  }
]

Pricing 💰

Plan	Limit	Price per 1,000 results
Free User	Up to 10 results	$0
Pay-as-you-go	Unlimited (multiples of 10)	$3.50

Legal Disclaimer

This actor is not affiliated with or endorsed by Grok.com. Use responsibly and respect the terms of service of the target site.

Update Policy

We monitor Grok.com's structure and will update this actor if changes break functionality. Report issues via Apify support or GitHub.

FAQ

Q: Can I scrape more than one prompt per run?
A: Yes! You can include multiple prompts and run them against the same or different URLs.

Q: Do I need a proxy to use this actor?
A: No proxies required. It runs efficiently without them.

Q: What happens if I set max_results = 35?
A: You'll receive 40 results. MAX_RESULTS MUST BE A MULTIPLE OF 10

Q: Can I use this actor on URLs outside grok.com?
A: No, this actor is specifically designed to interact with https://grok.com/ structure.