Google AI Mode Scraper

Browserless Google AI Mode scraper — AI Mode answer text + citation URLs + structured content in clean JSON, pay-per-use.

• AI Mode answers browserlessly — comparison / "best X" / question queries trigger Google's AI Mode surface naturally; the full answer is recovered via Google's own folsrch async endpoint (no browser rendering, no third-party API, no browser cost markup)
• Answer text + sources: text_blocks (paragraphs, headings, lists) + references (citation title + link + snippet) — 3–5 references on typical answers, verified live on 8/8 test queries
• AI Mode surface flag: ai_mode: true when the answer is the AI Mode surface (vs classic AI Overview)
• Never sell garbage: queries that return no substantive answer (status Empty) or error out are not charged
• Country (gl) + language (hl) targeting, optional location (uule) for localized answers
• Batch up to 1000 queries per run (array input), 10-way concurrency (configurable 1–30), rows stream to the dataset as they complete

Use cases

• Brand monitoring / GEO: does the AI Mode answer mention you, and does it cite you? (AI Mode and classic AIO cite the same URLs only ~13.7% of the time — this captures a different slice of the web)
• LLM-visibility tracking: what do Google's generative answers say about your brand, products, or competitors
• AEO/GEO content research: which sources does AI Mode cite for your niche, and what do the answers say

Input

{
  "queries": ["best crm for startups", "notion vs obsidian"],
  "gl": "us",
  "hl": "en",
  "location": "Kuala Lumpur, Malaysia",
  "retryDeferred": true,
  "retryDeferredMaxFetches": 2,
  "concurrency": 10,
  "captureRawHtml": false
}

• queries (required): array of queries to scrape AI Mode answers for
• gl / hl: two-letter country / language codes (default us / en)
• location: optional free-text location (e.g. "Kuala Lumpur, Malaysia") for localized results
• retryDeferred (default true): recover deferred answers via Google's folsrch endpoint (~90% recovery)
• retryDeferredMaxFetches (1–5, default 2): cap on recovery fetches per query
• udm50 (default false): append udm=50 to force the AI Mode tab. NOTE: the forced shell's answer currently requires a real browser session — natural routing is the supported path
• concurrency (1–30, default 10)
• captureRawHtml (default false): save raw SERP HTML to the KV store for debugging/corpus

Output

One dataset item per query:

• query — the searched query
• status — Ok (charged) | Empty (no answer) | Failed | Blocked (CAPTCHA)
• ai_mode — true when the answer is the AI Mode surface
• ai_overview — text_blocks (answer paragraphs/lists) + references (citation title, link, snippet) + resolved_by (shell | folsrch)
• search_parameters — hl/gl/udm/location echo
• search_metadata — surface, total_time_ms, resolved_by
• error — message when status != Ok

Queries with status != Ok are not charged (empty/blocked/failed = free).

Pricing

• $0.01 per completed query (store badge $10.00 / 1,000 searches)
• Buyer pays platform usage on top (~$0.001–0.004/query depending on recovery fetches) — all-in ≈ $0.011–0.014 per query
• Empty / Blocked / Failed queries are free