AI Search Scraper – Google AI Overview Answers & Citations

Get the real Google AI Overview answer — the one people actually see at the top of Google search results — for any query, in any country, with every source it cites. Give it your queries and markets; each row carries the full answer text, the cited pages with resolved URLs, the page-1 organic results of the same search, and a clear flag telling you whether Google shows an AI Overview for that query at all. No API keys, no login, no browser.

AI answers are where your customers now look first, and they are not the same as what a chat API returns: the search answer is grounded in Google's index for that country and cites specific pages. This scraper reads that answer from Google's own result page, so what you get is what a searcher in that market gets.

AI search scraper: what you get

One row per query × country:

Field	What it tells you
present, status	present: true — an AI Overview was shown and captured; present: false — Google shows no AI Overview for this query (a real, useful result); status is ok, generating (Google is still generating the answer for this query and market — re-run later), blocked or error
answerText, answerCharCount	The complete answer, paragraphs and list items on separate lines, without UI text or source chips
citations[], citationCount	The cited pages in the order Google shows them — url (resolved), domain, title, position, kind (inline source chip in the answer, or related link under it)
organicResults[], organicCount	The page-1 organic results of the same search, in order — position, url (resolved), domain, title, displayUrl — so you see what ranks next to what the AI says (ads and "People also ask" excluded; switch off with Include page-1 organic results)
query, country, countryCode, language, searchDomain, sourceUrl	What was asked, where, and the exact search page it came from
unavailableReason	Why there is no answer: no_aio_module (Google shows none), aio_not_available_msg, aio_generating, google_blocked, transport_error
searchQuery, aiOverview	The same objects the first-party Google Search Scraper emits, so existing pipelines built on it can switch sources without changing their parsers
metadata	Diagnostics: the localized heading, whether Google marked the overview as an AI Mode answer, citation counts by kind

Three dataset views: AI answers (one line per query and country), Citations (the sources per answer) and Organic results (the page-1 ranking next to the answer).

How it works

1. Search — each query is run on the Google domain of the chosen country (google.de for Germany, google.co.uk for the UK) with the country's interface language, through a search-engine-grade proxy pool, exactly as a desktop visitor would.
2. Read the answer — the AI Overview block is located structurally (not by fragile class names), the answer text is extracted with its paragraph and list structure, and UI strings and source chips are stripped out.
3. Resolve the sources — every cited page is a redirect token on the page; each unique token is resolved to the real URL once per run, so citations[].url is the page itself.
4. Deliver honestly — a query without an AI Overview is a present: false row, not an error; a page Google is still generating is generating; a block page is blocked. Rows without an answer are never charged.

No API keys, no login, no cookies, no nested scrapers.

Who uses it

• SEO and AEO teams — see the exact answer, the cited pages and the page-1 organic results for your money queries, per market, every day: is the AI citing you, and do you rank underneath it?
• Brand and competitor monitoring — feed the rows into a mention counter or a share-of-voice sheet; the aiOverview object is a drop-in for pipelines built on the first-party Google Search Scraper.
• Agents and automations — a keyword-discoverable, MCP-callable step that turns a list of questions into structured AI answers with citations, unattended.

Set it up in a minute

1. Paste your Queries (one per line).
2. Pick the Countries (default: United States). Optionally set the Interface language.
3. Start. Rows arrive as each query is finished; the run summary (presence rate per country, citation stats) is in the OUTPUT record.

Citation and retry settings are collapsed below the essentials; the defaults are tuned for unattended runs.

Use it from an agent or the API

{ "queries": ["best crm for small business", "what is model context protocol"], "countries": ["us", "uk"] }

{ "queries": ["bestes CRM für kleine Unternehmen"], "countries": ["de"], "language": "de", "maxCitations": 10, "includeAnswerHtml": true }

Agents may also pass prompts or keywords instead of queries, country as a comma-separated string, and query objects { query }. Results are in the default dataset (?view=answers, ?view=citations); the run summary is in the OUTPUT record of the run's key-value store. Through the Apify MCP server, call inovaflow/ai-search-scraper with the same input.

Output example

{
  "query": "best crm for small business",
  "surface": "google_ai_overview",
  "country": "us",
  "countryCode": "US",
  "language": "en",
  "searchDomain": "google.com",
  "status": "ok",
  "present": true,
  "unavailableReason": null,
  "answerText": "HubSpot is the best overall CRM for small businesses because it offers a powerful free tier and scales smoothly as your company grows. A CRM (Customer Relationship Management) tool is software that helps you track leads, manage customer contacts, and organize sales.\nTop Small Business CRM Options\nHubSpot: Best all-in-one option for marketing-driven teams. It features a popular free tier (up to two users), email templates, and contact management.\nPipedrive: Best for straightforward, visual sales pipelines. Plans start around $12.50 to $15 per user, per month.",
  "answerCharCount": 690,
  "citations": [
    { "url": "https://www.uschamber.com/co/start/strategy/low-cost-crm-tools", "domain": "uschamber.com", "title": "U.S. Chamber of Commerce", "position": 1, "kind": "inline", "resolved": true },
    { "url": "https://www.pcmag.com/picks/the-best-small-business-crm-software", "domain": "pcmag.com", "title": "PCMag", "position": 3, "kind": "inline", "resolved": true },
    { "url": "https://www.reddit.com/r/CRM/comments/…", "domain": "reddit.com", "title": "Best and inexpensive CRM for small business - Reddit", "position": 4, "kind": "related", "resolved": true }
  ],
  "citationCount": 5,
  "organicResults": [
    { "position": 1, "url": "https://slack.com/blog/best-crm-for-small-business", "domain": "slack.com", "title": "Best CRM for Small Business in 2026", "displayUrl": "https://slack.com/blog/best-crm-for-small-busi...", "resolved": true },
    { "position": 2, "url": "https://www.zoho.com/crm/small-business-crm-software/", "domain": "zoho.com", "title": "The Best CRM Software for Small Businesses", "displayUrl": "https://www.zoho.com/crm/small-business-crm-so...", "resolved": true }
  ],
  "organicCount": 9,
  "sourceUrl": "https://www.google.com/search?q=best+crm+for+small+business&hl=en&gl=us",
  "aiOverview": { "type": "live", "content": "HubSpot is the best overall CRM …", "sources": [{ "url": "https://www.uschamber.com/co/start/strategy/low-cost-crm-tools", "title": "U.S. Chamber of Commerce", "description": "" }] }
}

Pricing

Pay per event: $0.01 per AI answer delivered (a query × country with the answer text and its citations), plus a small per-run start fee. Queries where Google shows no AI Overview, is still generating one, or served a block page are free — and so are the organic results, which come from the same page.

Good to know

• No AI Overview is a result, not a failure. Google shows an AI Overview for roughly three quarters of informational and commercial English queries; the rest come back as present: false so you can track when an answer appears.
• Live-generated answers. For some queries — mostly non-English ones in their own market — Google generates the overview live in the browser instead of serving it with the page. Those rows are status: generating (after two automatic re-fetches); re-run later, or ask the question in English, which is served with the page on every market's Google domain tested.
• What is visible is what you get. The answer text is the overview as rendered on the result page; a few very long overviews are shown by Google with a trailing section collapsed, and the collapsed part is not on the page.
• Organic results are free. They are read from the same result page as the answer, so a query with no AI Overview still gives you its page-1 ranking — at no charge.
• Countries — 49 markets, each on its own Google domain with its main language by default; override with Interface language.
• Results reflect what Google shows at the moment of the run; sourceUrl and metadata carry the evidence for every row.