Google AI Overviews Scraper & API ($3/1k) โจ
Pricing
from $3.00 / 1,000 ai overview & serp queries
Google AI Overviews Scraper & API ($3/1k) โจ
โก Scrape Google AI Overviews ($3/1k): clean Markdown answers, unwrapped citations, AEO brand audits & Page 1 rankings. Track SGE, Generative Engine Optimization (GEO) & People Also Ask in 150+ countries. MCP & RAG ready.
Pricing
from $3.00 / 1,000 ai overview & serp queries
Rating
0.0
(0)
Developer
UnitBytes | Enterprise Web Data
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Features
Share
โจ Google AI Overviews Scraper & AEO API: Clean Markdown, Unwrapped Citations, Brand Visibility Audits & Organic Ranks
๐ Overview
Google AI Overviews (SGE) now sit directly above Page 1 organic rankings across informational, commercial comparison, software evaluation, financial, and technical queries โ fundamentally reshaping click-through rates and brand discovery.
For SEO agencies, in-house growth teams, and AI data engineers, tracking AI Overviews reliably at scale has been notoriously difficult:
- Truncated "Show More" Answers: Standard SERP scrapers only capture the opening summary paragraph and miss the collapsed comparison tables, nested lists, code snippets, and secondary citation cards that make up ~75% of the full answer.
- Obfuscated Redirect Links: Raw SERP captures often return opaque Google redirect wrappers instead of clean, canonical publisher URLs and root domains needed for attribution dashboards.
- Heavy Browser & SaaS Tracker Costs: Headless-browser scrapers burn
1โ4 GB RAMand charge $25.00 to $200.00 per 1,000 queries, while closed SaaS AEO/GEO suites charge $32.00 to $300.00 per 1,000 tracked prompts. - Disconnected SEO vs. AEO Reporting: Teams have had to run separate tools just to answer a single question: "Do we rank on Page 1 organically, and is Google actually citing our domain inside the AI Overview?"
Google AI Overviews Scraper by UnitBytes delivers the entire expanded AI Overview + unwrapped canonical citations + Page 1 organic rankings + People Also Ask + automated AEO Brand Citation Audit across 4 flattened Console tabs in a single lightweight 256 MB run at $2.50 / 1,000 queries on Free Tier ($3.00 / 1,000 on GOLD+ volume plans) โ with $0 event charge on genuine zero-result searches.
| โก UnitBytes ยท Google AI, Search, News, Trends, UGC, Shopping & Local Intelligence Ecosystem | ||
|
โจ Google AI Overviews Scraper ๐ You are here ($2.50โ$3.00/1K) SERP AI Overviews, citations, AEO brand audit & Page 1 ranks |
๐ค Google AI Mode Scraper From $4.00/1K โข Deep AI Answers Full conversational Google AI Mode answers, cited web sources & follow-ups |
๐ฌ Reddit & Google Trends From $0.30โ$0.50 โข UGC & Demand Reddit Scraper (AI-cited threads) & Google Trends |
|
๐ฐ Google News Scraper From $1.00/1K โข PR & Coverage Direct publisher URLs, recency filters & clean full-article text |
๐๏ธ Google Shopping & Travel From $0.50โ$2.50/1K โข Retail & OTAs Google Shopping, Flights & Hotels |
๐ Google Maps & Jobs From $0.25/1K โข Local & Hiring B2B Leads, Reviews & Google Jobs |
๐ Why SEO / AEO Agencies, SaaS Brands & RAG Engineers Choose UnitBytes
| Capability / Metric | UnitBytes Google AI Overviews Scraper | Legacy SERP APIs | Browser Scrapers & SaaS AEO Suites |
|---|---|---|---|
| ๐ฐ Price per 1,000 Queries | $2.50/1K Free Trial (~1,998 free/mo) โข $3.00/1K Volume (GOLD+) | $15.00 โ $30.00 per 1K + extra async token calls | $30.00 โ $300.00 per 1K + heavy 2โ4 GB RAM compute |
๐ Full Expanded Answer (markdown) | โ Complete GFM tables, fenced code blocks, LaTeX math & nested lists | โ ๏ธ Often truncated or requires manual follow-up calls | โ ๏ธ Frequently misses lazy-expanded sections |
| ๐ Unwrapped Canonical Citation URLs | โ
Direct external https://... URLs + normalized domain | โ ๏ธ Raw redirect wrappers or partial links | โ ๏ธ Redirect links requiring post-processing |
| ๐ฏ Built-In AEO Brand Citation Audit | โ
brandCitationAudit (cited vs competitor_cited + organicTargetRanks) | โ Manual scripting required | โ ๏ธ Locked inside rigid dashboards |
| ๐ 4 Flattened CSV/Excel Console Tabs | โ Summary, AEO Audit, Unwound Citations & Organic/PAA tabs | โ Nested JSON only | โ Nested arrays ([object Object] in CSV) |
| ๐ Global + Hyper-Local Geo-Targeting | โ
150+ Countries (country) + City/State (location) + EEA/UK support | โ Supported | โ ๏ธ Often blocked by European consent screens |
โก 60-Second Quick Start: Ready-to-Run JSON Presets & Zero-Rewrite Migration
Click Try for free in the Apify Console (pre-filled with sample B2B & technical queries plus targetDomains so your very first run showcases brandCitationAudit), or paste any preset below into the JSON input tab:
1. SaaS / Agency AEO Brand Citation vs. Page 1 SEO Gap Audit
{"queries": ["best crm for small business","compare hubspot vs salesforce vs pipedrive for 20 person sales team","inbound marketing automation software pricing"],"country": "US","targetDomains": ["hubspot.com", "salesforce.com", "pipedrive.com"],"includeOrganicResults": true,"includePeopleAlsoAsk": true,"resolveUrls": true,"maxQueries": 25}
2. Hyper-Local City & Regional Service Visibility Audit (location)
{"queries": ["commercial roofing replacement cost per square foot","best managed it support providers for healthcare clinics"],"country": "US","location": "Austin, Texas, United States","targetDomains": ["HubSpot", "angi.com"],"includeOrganicResults": true,"maxQueries": 20}
3. Multi-Country European / Global RAG Knowledge Grounding
{"queries": ["stocks and shares isa vs lifetime isa uk tax rules","difference between postgresql and mysql for analytical workloads"],"country": "GB","includeOrganicResults": false,"includePeopleAlsoAsk": true,"resolveUrls": true,"maxConcurrency": 6,"maxQueries": 50}
๐ Zero-Rewrite Drop-In API Compatibility: Migrating an existing SERP or AEO script? You don't even need to rename payload keys โ this Actor automatically normalizes
query,question,questions,prompts,keywords, orq(including newline-separated strings),gl(countryCode),hl(languageCode),maxItems(limit), andbrandKeywords/brands/domains/trackDomains!
๐ฏ Built-In AEO Brand Citation Audit & 4 Console Dataset Views
Pass your own domains, client subdomains, or brand names in targetDomains โ supporting root domains ("hubspot.com"), exact subdomains ("docs.snowflake.com"), full URLs ("https://www.hubspot.com/pricing"), and bare brand names ("HubSpot") โ and every output item automatically includes a turnkey brandCitationAudit object:
citationStatus:"cited"โ At least one of yourtargetDomainsor brand targets is cited inside the AI Overview."competitor_cited"โ Google rendered an AI Overview with external citations, and competing domains were cited instead of yours."overview_no_citations"โ Google rendered a synthesized AI Overview with zero external web links."no_overview"โ Google did not display an AI Overview for this query (hasAiOverview: false).
citedTargetUrls&citedTargetCount: Every exact URL from your target domains cited in the AI Overview.topCompetitorDomains: Ranked tally of competing domains winning AI Overview citations on that keyword.organicTargetRanks: Your exact Page 1 organic ranking positions (rank,domain,url) on the same SERP โ making it effortless to spot "SEO Rank #2, AEO Cited #0" content gaps!
๐ 4 Ready-to-Export Console Dataset Views (Zero [object Object] in CSV/Sheets)
Every run automatically populates 4 purpose-built dataset views in the Apify Console Output tab and REST API:
AI Overviews & SERP Summary(?view=overview): Flattened executive view withquery,country,hasAiOverview,aiOverviewState,brandCitationAudit.citationStatus,citationsCount,organicResultsCount,markdown, andgoogleSearchUrl.AEO Brand Citation Audit(?view=aeo_audit): Dedicated brand-gap scorecard flatteningcitationStatus,isCited,citedTargetCount,citedTargetUrls,topCompetitorDomains, andorganicTargetRanks.Extracted Citations & Publishers(?view=citations): Unwound one-row-per-citation table (citations.index,citations.domain,citations.publisher,citations.title,citations.url,citations.snippet) ready for instant publisher share-of-voice pivot tables in Excel or Google Sheets.Page 1 Organic & PAA(?view=organic_vs_paa): Traditional Page 1organicResultsandpeopleAlsoAskside-by-side withhasAiOverview.
๐ฐ Transparent Pay-Per-Event Pricing ($2.50 / 1,000 Free Trial โข $3.00 / 1,000 Volume)
This Actor uses transparent Pay-Per-Event (PPE) billing on a minimal 256 MB container footprint โ with zero browser compute surcharges, zero extra async-token fees when Google lazy-loads an AI Overview, and $0.00 query charge on genuine zero-result searches.
| Apify Plan Tier | Event Name | Price per Query | Price per 1,000 Queries | Included in $5.00 Credit |
|---|---|---|---|---|
Free Plan (FREE) | ai-overview-query | $0.0025 | $2.50 / 1,000 queries | ~1,998 queries / month free |
Starter Plan (BRONZE) | ai-overview-query | $0.0033 | $3.30 / 1,000 queries | ~1,513 queries per $5.00 |
Scale Plan (SILVER) | ai-overview-query | $0.0031 | $3.10 / 1,000 queries | ~1,611 queries per $5.00 |
Business & Enterprise (GOLD+) | ai-overview-query | $0.0030 | $3.00 / 1,000 queries | ~1,665 queries per $5.00 |
| Actor Run Start | apify-actor-start | $0.0050 | $5.00 / 1,000 runs | One-time startup fee per run (256 MB allocation) |
| Zero-Result Searches | โ | $0.00 / query | $0.00 event fee | Genuine no_results SERPs are never billed |
๐ก Hard Budget Cap Support: Set Maximum cost per run in the Apify Console (
Options -> Maximum cost per run) or via API (maxTotalChargeUsd). The Actor monitors remaining budget in real time and stops cleanly with exit code0the instant your cap is reached.
โฐ Automate Weekly 24/7 AEO / GEO Monitoring (3-Click Apify Schedules)
Because Google updates AI Overview citations continuously as fresh benchmarks, documentation, and community threads are indexed, high-performing SEO teams monitor their core money keywords on an automated weekly or daily cadence:
- Save Your Audit Preset as a Task: Configure your keyword list,
country,location, andtargetDomainsin Apify Console and click Save as new task. - Attach an Apify Schedule: Open Schedules, click Create new schedule, select your saved Task, and choose Weekly (e.g.,
0 7 * * 1โ Mondays at 07:00 UTC) or Daily. - Connect Alerts or BI Exports: Add a native Apify Integration (Slack, Google Sheets, Make, n8n, Zapier, or Webhook) on
ACTOR.RUN.SUCCEEDEDto alert your content team whenevercitationStatusshifts to"competitor_cited".
๐ Recurring Monthly Monitoring Cost Reference
| Tracked Keyword Set | Schedule Cadence | Monthly Queries | Plan Tier | Net Monthly Cost |
|---|---|---|---|---|
100 Core Keywords | Weekly (4 runs/mo) | 400 / mo | Free Plan ($5 free credit) | $0.00 / mo ($1.02 covered by $5 monthly credit) |
400 Core Keywords | Weekly (4 runs/mo) | 1,600 / mo | Free Plan ($5 free credit) | $0.00 / mo ($4.02 covered by $5 monthly credit) |
500 Agency Keywords | Weekly (4 runs/mo) | 2,000 / mo | Paid (GOLD+ $3/1K) | $6.02 / mo (4 ร $0.005 start + 2,000 ร $0.003) |
1,000 Enterprise Keywords | Daily (30 runs/mo) | 30,000 / mo | Paid (GOLD+ $3/1K) | $90.15 / mo (30 ร $0.005 start + 30,000 ร $0.003) |
๐ No-Code, GTM Outbound & AI Pipeline Recipes (Clay, n8n, Make, Sheets & RAG)
1. ๐ฏ Clay + Google Maps Leads B2B SEO / AEO Agency Outbound Playbook
Turn live AI Overview citation gaps into your highest-converting B2B agency sales hook:
- Source High-Value Local or SaaS Prospects: Run Google Maps Email & Leads Scraper to pull verified business websites, decision-maker emails, phone numbers, and categories (e.g., dental clinics, personal injury law firms, HVAC contractors, or regional B2B agencies).
- Enrich Each Prospect's AEO Visibility in Clay: Trigger
unitbytes/google-ai-overviews-scraperfrom Clay's Apify integration passing the prospect's high-intent buyer query +location+targetDomains: ["{{prospect_domain}}"]. - Personalize Outbound with Proof: Filter for prospects where
brandCitationAudit.citationStatus == "competitor_cited"(especially those ranking on Page 1 organically viaorganicTargetRanksyet excluded from the AI Overview!) and reference the exacttopCompetitorDomainscapturing their AI Overview traffic.
2. ๐ n8n & Make Weekly Citation Drift Alert (Slack / Microsoft Teams)
Configure an n8n or Make workflow triggered by an Apify ACTOR.RUN.SUCCEEDED webhook $\rightarrow$ fetch {{defaultDatasetUrl}}/items?view=aeo_audit $\rightarrow$ filter items where brandCitationAudit.citationStatus === "competitor_cited" $\rightarrow$ send a formatted Slack/Teams brief listing the query, Page 1 organicTargetRanks, topCompetitorDomains, and clickable googleSearchUrl.
3. ๐ Google Sheets & Looker Studio 1-Click Flattened CSV Dashboards
Skip JSON parsing scripts completely. Pull unwound citation rows or flattened brand audits directly into Google Sheets (=IMPORTDATA(...)) or Looker Studio via Apify's view-specific CSV endpoints:
- Brand Scorecard CSV:
https://api.apify.com/v2/datasets/DATASET_ID/items?view=aeo_audit&format=csv - Publisher Share-of-Voice CSV (1 Row per Citation):
https://api.apify.com/v2/datasets/DATASET_ID/items?view=citations&format=csv
4. ๐ง LangChain, LlamaIndex & CrewAI Multi-Source RAG Grounding
Feed deterministic markdown, block-level textBlocks, and verified canonical citations into LangChain, LlamaIndex, or CrewAI agents โ and combine them with real-time journalism from Google News Scraper plus community discussions from Reddit Scraper (one of Google AI's most frequently cited UGC domains) for 360-degree grounded synthesis.
โจ Key Capabilities
- ๐ LLM-Ready GitHub-Flavored Markdown (
markdown) + Structured AST (textBlocks): Reconstructs complete headings (###), bold callouts, nested bulleted and numbered lists, multi-column comparison tables (| Feature | Option A | Option B |), syntax-tagged code blocks (```python), and inline/block LaTeX formulas ($O(\log n)$). - ๐ Unwrapped Canonical External Citations (
citations): Resolves citation cards into clean external URLs (https://...), normalized rootdomain,publisher,title,snippet, andfaviconUrl. - ๐ Side-by-Side Page 1 Organic Rankings (
organicResults): Captures traditional Page 1 search rankings (rank,title,url,domain,displayedUrl,snippet) in the exact same pass so you can correlate classic SEO rank with AI Overview citation share. - โ People Also Ask (
peopleAlsoAsk): Extracts related user follow-up questions surfaced on the SERP for content brief generation. - ๐ 150+ Countries & City-Level Geo-Targeting (
country+location): Audit national markets (US,GB,DE,FR,CA,AU,IN,BR,JP,ES,IT,NL,SG,AE, etc. โ including full European EEA/UK support) or pinpoint exact cities ("Austin, Texas, United States","Manchester, England, United Kingdom").
๐ When hasAiOverview Is false (Honest Upstream SERP Behavior)
Google does not generate an AI Overview on 100% of searches. In real-world SERPs, hasAiOverview is false (aiOverviewState: "none") in three common scenarios:
- Pure Navigational or Operator Queries: Brand login searches, exact domain lookups, or search operators such as
site:example.comfrequently bypass AI Overviews upstream. - Commercial / YMYL Queries Without AI Trigger: On certain transactional or localized queries, Google intentionally serves traditional organic listings only.
- SERP Recency Filters (
timeRange!="any"): Applying publication-date filters (hour,day,week,month,year) restricts Google's organic index by recency and causes Google upstream to suppress AI Overviews on most queries. KeeptimeRange: "any"whenever your primary goal is capturing AI Overviews.
Why Every Query Still Delivers Full SERP Value: Even when Google suppresses the AI Overview (hasAiOverview: false), this Actor still returns the query's Page 1 organicResults, peopleAlsoAsk, and brandCitationAudit (citationStatus: "no_overview" + your organicTargetRanks), giving your SEO/AEO reporting pipeline complete visibility into both AI-triggered and classic SERPs without blind spots. (And if a search returns zero results across Google altogether, aiOverviewState: "no_results" is never billed.)
๐ ๏ธ How to Use via API (Python, Node.js & cURL)
๐ Python Example (AEO Brand Visibility & Competitor Citation Audit)
$pip install apify-client
from apify_client import ApifyClientclient = ApifyClient("YOUR_APIFY_API_TOKEN")run_input = {"queries": ["best crm for small business","compare hubspot vs pipedrive vs zoho for 10 person sales team","difference between postgresql and mysql",],"country": "US","targetDomains": ["hubspot.com", "pipedrive.com", "postgresql.org"],"includeOrganicResults": True,"includePeopleAlsoAsk": True,"resolveUrls": True,"maxConcurrency": 4,"maxQueries": 25,}run = client.actor("unitbytes/google-ai-overviews-scraper").call(run_input=run_input)items = client.dataset(run["defaultDatasetId"]).list_items().itemsfor row in items:audit = row.get("brandCitationAudit") or {}print(f"[{row['country']}] {row['query']} | AIO={row['hasAiOverview']} "f"| Citations={row['citationsCount']} | Audit={audit.get('citationStatus')}")
๐จ JavaScript / Node.js Example
import { ApifyClient } from 'apify-client';const client = new ApifyClient({ token: 'YOUR_APIFY_API_TOKEN' });const run = await client.actor('unitbytes/google-ai-overviews-scraper').call({queries: ['best roofing contractors near me','roof replacement cost estimator',],country: 'US',location: 'Austin, Texas, United States',includeOrganicResults: true,resolveUrls: true,maxQueries: 10,});const { items } = await client.dataset(run.defaultDatasetId).listItems();console.log(`Processed ${items.length} localized SERP + AI Overview records`, items[0]);
๐ cURL Example
curl -X POST "https://api.apify.com/v2/acts/unitbytes~google-ai-overviews-scraper/runs?token=YOUR_APIFY_API_TOKEN" \-H "Content-Type: application/json" \-d '{"queries": ["how does a stocks and shares isa work in the uk"],"country": "GB","targetDomains": ["gov.uk", "moneysavingexpert.com"],"includeOrganicResults": true,"resolveUrls": true,"maxQueries": 5}'
๐ค Example Output Record
{"query": "compare hubspot vs pipedrive vs zoho for 10 person sales team","country": "US","language": "en","location": null,"timeRange": "any","hasAiOverview": true,"aiOverviewState": "deferred","markdown": "Comparing **HubSpot**, **Pipedrive**, and **Zoho CRM** for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization.\n\n### Quick Comparison at a Glance\n\n| Feature | HubSpot Sales Hub | Pipedrive | Zoho CRM |\n| --- | --- | --- | --- |\n| Best For | All-in-one GTM & marketing alignment | Visual pipeline & outbound velocity | Budget-friendly customization |\n| Learning Curve | Low to Moderate | Very Low | Moderate |\n| Reporting | Advanced multi-touch attribution | Deal velocity & activity tracking | Custom BI modules & forecasting |","text": "Comparing HubSpot, Pipedrive, and Zoho CRM for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization...","textBlocks": [{"type": "paragraph","text": "Comparing HubSpot, Pipedrive, and Zoho CRM for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization."},{"type": "heading","level": 3,"text": "Quick Comparison at a Glance"},{"type": "table","headers": ["Feature", "HubSpot Sales Hub", "Pipedrive", "Zoho CRM"],"rows": [["Best For", "All-in-one GTM & marketing alignment", "Visual pipeline & outbound velocity", "Budget-friendly customization"]]}],"citations": [{"index": 1,"title": "HubSpot vs. Pipedrive vs. Zoho CRM Comparison","url": "https://www.pcmag.com/picks/the-best-crm-software","domain": "pcmag.com","publisher": "PCMag","snippet": "Pipedrive focuses squarely on sales pipeline management, while HubSpot unifies marketing, sales, and service hubs.","faviconUrl": "https://encrypted-tbn0.gstatic.com/faviconV2?url=https://www.pcmag.com&sz=64"}],"citationsCount": 1,"brandCitationAudit": {"targetDomains": ["hubspot.com", "pipedrive.com"],"citationStatus": "competitor_cited","isCited": false,"citedTargetUrls": [],"citedTargetCount": 0,"topCompetitorDomains": [{ "domain": "pcmag.com", "citationsCount": 1 }],"organicTargetRanks": [{"rank": 2,"domain": "hubspot.com","url": "https://www.hubspot.com/comparisons/pipedrive-vs-hubspot"}]},"organicResults": [{"rank": 1,"title": "The Best CRM Software for Small Businesses","url": "https://www.pcmag.com/picks/the-best-crm-software","domain": "pcmag.com","displayedUrl": "https://www.pcmag.com โบ Business โบ CRM","snippet": "We tested the top CRM platforms for small and midsize sales teams..."},{"rank": 2,"title": "Pipedrive vs. HubSpot: Which CRM Fits Your Sales Team?","url": "https://www.hubspot.com/comparisons/pipedrive-vs-hubspot","domain": "hubspot.com","displayedUrl": "https://www.hubspot.com โบ comparisons","snippet": "Compare HubSpot Sales Hub and Pipedrive side by side across pipeline automation, reporting, and seat pricing."}],"organicResultsCount": 2,"peopleAlsoAsk": [{"question": "Is Pipedrive or HubSpot better for a 10-person team?","answer": "Pipedrive is often faster to onboard for pure outbound sales teams, whereas HubSpot scales better if marketing and sales share attribution.","title": "CRM Buyer Guide","url": "https://www.pcmag.com/picks/the-best-crm-software","domain": "pcmag.com"}],"googleSearchUrl": "https://www.google.com/search?q=compare+hubspot+vs+pipedrive+vs+zoho+for+10+person+sales+team&gl=us&hl=en","scrapedAt": "2026-11-14T12:00:00Z"}
Complete Output Fields Reference
| Field | Type | Description |
|---|---|---|
query | string | Normalized Google Search query processed. |
country | string | Uppercase 2-letter ISO 3166-1 country code ("US", "GB", "DE", "JP", etc.). |
language | string | Effective interface language code used ("en", "de", "fr", "pt-BR", "ja", etc.). |
location | string | null | Canonical city/region geo-targeting location string if supplied, otherwise null. |
timeRange | string | Applied SERP recency filter ("any", "hour", "day", "week", "month", "year"). |
hasAiOverview | boolean | true when Google rendered an AI Overview on this SERP. |
aiOverviewState | string | "inline" (rendered directly on initial SERP), "deferred" (expanded dynamically), "none", or "no_results". |
markdown | string | Full AI Overview answer in clean GitHub-Flavored Markdown (headings, tables, lists, code, math). |
text | string | Clean plain-text version of the AI Overview answer. |
textBlocks | object[] | Structured block list (paragraph, heading, list, table, code) for deterministic RAG chunking. |
citations | object[] | Unwrapped source citations (index, title, url, domain, publisher, snippet, faviconUrl). |
citationsCount | integer | Total number of citations in citations. |
brandCitationAudit | object | null | AEO audit object (targetDomains, citationStatus, isCited, citedTargetUrls, citedTargetCount, topCompetitorDomains, organicTargetRanks) when targetDomains is set (null when omitted). |
organicResults | object[] | Page 1 organic search results (rank, title, url, domain, displayedUrl, snippet). |
organicResultsCount | integer | Count of Page 1 organic results extracted. |
peopleAlsoAsk | object[] | Related People Also Ask entries (question, answer, title, url, domain). |
googleSearchUrl | string | Direct Google Search URL for the query and market. |
scrapedAt | string | UTC ISO 8601 extraction timestamp. |
โ๏ธ Input Parameters Reference
| Parameter | Type | Default / Prefill | Description |
|---|---|---|---|
queries | string[] | ["best crm for small business", ...] (prefill) | Search keywords, questions, newline-separated strings, or Google Search URLs. Aliases query, question, questions, prompts, keywords, q supported. |
startUrls | object[] | [] | Optional Google Search URLs ({"url": "https://www.google.com/search?q=..."}). |
maxQueries | integer | 25 | Maximum unique queries to process in this run (1 โ 1000; alias maxItems). |
country | string | "US" (prefill) | 2-letter ISO 3166-1 country code (US, GB, DE, FR, CA, AU, IN, BR, JP, etc.; alias gl). |
language | string | "" | Optional ISO/BCP-47 language override (alias hl). Leave empty ("") to automatically use the natural language of country. |
location | string | "" | Optional city/state/region geo-targeting (e.g. "Austin, Texas, United States"). |
timeRange | string | "any" | "any", "hour", "day", "week", "month", or "year". Keep "any" for AI Overviews. |
targetDomains | string[] | [] (API default) / ["hubspot.com", ...] (UI prefill) | Root domains, subdomains (docs.snowflake.com), full URLs, or bare brand names ("HubSpot") to populate brandCitationAudit (aliases brandKeywords, brands, domains, trackDomains). |
includeOrganicResults | boolean | true | Include Page 1 traditional organic search rankings. |
includePeopleAlsoAsk | boolean | true | Include People Also Ask questions on the SERP. |
resolveUrls | boolean | true | Unwrap Google redirect links into clean canonical external URLs. |
maxConcurrency | integer | 4 | Parallel query concurrency (1 โ 8). |
proxyConfiguration | object | null | Optional custom HTTP/SOCKS5 proxy override (proxyUrls). Managed residential proxies are configured automatically on Cloud. |
๐ค AI Agent, Coding Assistant & MCP Server Integration
๐ Copy-and-Paste Directive for AI Coding Assistants (Cursor, Claude Code & Windsurf)
"Use
unitbytes/google-ai-overviews-scraperon Apify to extract Google Search AI Overviews (SGE) in clean GitHub-Flavored Markdown, unwrapped sourcecitations, Page 1organicResults,peopleAlsoAsk, andbrandCitationAudit(targetDomainsaccepts root domains, subdomains, URLs, or bare brand names). Pair it withunitbytes/google-ai-mode-scraperfor deep conversational Google AI Mode benchmarking. Export flattened tables directly via?view=aeo_auditor?view=citations. Example Python call:client.actor('unitbytes/google-ai-overviews-scraper').call(run_input={'queries': ['best crm for small business'], 'country': 'US', 'targetDomains': ['hubspot.com'], 'maxQueries': 25})"
๐ Option A: Local stdio MCP Server (claude_desktop_config.json / .cursor/mcp.json)
{"mcpServers": {"apify-google-ai": {"command": "npx","args": ["-y","@apify/actors-mcp-server","--actors","unitbytes/google-ai-overviews-scraper,unitbytes/google-ai-mode-scraper"],"env": {"APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"}}}}
๐ Option B: Hosted Apify Streamable HTTP MCP Server
{"mcpServers": {"apify": {"type": "http","url": "https://mcp.apify.com/?tools=actors,docs,unitbytes/google-ai-overviews-scraper,unitbytes/google-ai-mode-scraper"}}}
โ Frequently Asked Questions (FAQ)
1. What is the difference between Google AI Overviews Scraper and Google AI Mode Scraper?
Google AI Overviews Scraper captures the AI Overview summary box displayed directly above traditional Page 1 Google Search results, alongside organicResults and peopleAlsoAsk so you can measure SEO vs. AEO correlation in one pass. Google AI Mode Scraper queries Google's dedicated conversational AI Mode surface, which generates multi-section deep research answers, inline cited vs. related web sources, and suggested followUpQuestions on virtually every prompt. Most SEO/GEO teams run both side by side.
2. Can targetDomains track subdomains, specific product URLs, or bare brand names?
Yes. targetDomains accepts root domains ("hubspot.com"), specific subdomains ("docs.snowflake.com"), full URLs ("https://www.hubspot.com/pricing"), and bare brand names ("HubSpot"). In the Apify Console UI, sample domains are pre-filled so your first test run demonstrates brandCitationAudit immediately; when calling via API without targetDomains, it defaults cleanly to [] (brandCitationAudit: null).
3. Am I charged if a search returns zero results, or how do I cap spending?
Genuine zero-result searches (aiOverviewState: "no_results") are never charged ($0.00 event fee). Queries where Google serves a valid traditional Page 1 SERP without an AI Overview (hasAiOverview: false) return complete Page 1 organicResults, peopleAlsoAsk, and organicTargetRanks and count as one SERP query. You can enforce an exact dollar limit on any run via maxTotalChargeUsd or maxQueries.
4. How do I export citations or brand audits cleanly to CSV, Excel, or Google Sheets?
Select any of the 4 built-in Console Dataset Views (AI Overviews & SERP Summary, AEO Brand Citation Audit, Extracted Citations & Publishers, or Page 1 Organic & PAA) before clicking Export CSV / Excel, or append ?view=citations&format=csv / ?view=aeo_audit&format=csv to your dataset URL for flat, pivot-ready spreadsheets with zero [object Object] cells.
5. Does it work in the UK, European Union (EEA), Asia-Pacific, and specific cities?
Yes. The Actor supports 150+ countries (US, GB, DE, FR, ES, IT, NL, PL, SE, CA, AU, IN, SG, JP, BR, MX, AE, etc.) โ handling European consent screens automatically โ plus hyper-local city/state location targeting (e.g., "Austin, Texas, United States", "London, England, United Kingdom").
6. Can I migrate an existing SERP or AI Overview integration without rewriting field names?
Yes. Input aliases including query, question, questions, prompts, keywords, q (as arrays or newline-separated strings), gl, hl, maxItems, and brandKeywords / brands / domains / trackDomains are mapped automatically.
7. Do I need a Google account, cookies, or a separate proxy subscription?
No login credentials or cookies are ever required. Managed residential routing is automatically configured on Apify Cloud at no extra proxy setup step, and advanced users can optionally pass custom HTTP/SOCKS5 proxyUrls in proxyConfiguration.
๐ Complete UnitBytes Google, AI, Search & UGC Intelligence Ecosystem
| Actor | Best For | Pricing |
|---|---|---|
| Google AI Overviews Scraper (๐ You are here) | SERP AI Overviews (SGE) in clean GFM Markdown, unwrapped citations, brandCitationAudit, Page 1 organic ranks & PAA | From $3.00 / 1K |
| Google AI Mode Scraper | Full conversational Google AI Mode answers, cited vs. related web sources, follow-up prompts & GEO brand audits | From $4.00 / 1K |
| Reddit Posts, Comments & Search Scraper | Extract AI-cited Reddit community threads, buyer comparisons, nested comments & organic brand sentiment | From $0.50 / 1K |
| Google Trends Scraper (5-in-1) | Historical interest over time, regional heatmaps, +5,000% breakout queries & related topics | From $0.30 / 1K |
| Google News Scraper | Direct publisher URLs, recency/domain filters, curated topic feeds & optional clean full-article text | From $1.00 / 1K |
| Google Shopping Scraper | Live retail product prices, discounts, multi-seller offers & direct checkout URLs | From $2.00 / 1K |
| Google Flights Scraper | Real-time airfares, carriers, flight numbers, stops, layovers & CO2 emissions | From $0.50 / 1K |
| Google Hotels Scraper | Nightly & total hotel/rental rates, multi-OTA price parity (Booking.com, Expedia), GPS & HD photos | From $2.50 / 1K |
| Google Jobs Scraper | Corporate hiring signals, parsed salaries, employer logos & direct ATS apply links | From $4.00 / 1K |
| Google Maps Email & Leads Scraper | Verified B2B business emails, phones, social profiles & website tech stacks | From $0.50 / 1K |
| Google Maps Reviews Scraper | Bulk extraction of up to 10,000 customer reviews per place with keyword & rating filters | From $0.25 / 1K |
โ๏ธ Compliance & Privacy
This Actor extracts strictly publicly available search results and AI Overview summaries displayed on Google Search. It never accesses private Google accounts, personal histories, or personally identifiable information (PII). Read Apify's guide on the legality of web scraping to ensure compliance with applicable regulations.
Disclaimer
This Actor is an independent software tool and is not affiliated with, endorsed by, or sponsored by Google LLC.
๐ฌ Support & Feedback
Building an AEO visibility dashboard, multi-market SEO tracker, Clay outbound engine, or enterprise RAG pipeline?
- ๐ฌ Apify Issues: Open a ticket on the Actor Issues Tab
- ๐ Apify Store: Google AI Overviews Scraper
๐ Keywords & Search Tags
google ai overviews scraper, google sge scraper, google search generative experience api, answer engine optimization (aeo), generative engine optimization (geo), ai brand visibility tracker, ai citation checker, llm seo audit, google ai overview markdown api, people also ask scraper, google serp + ai overview api, ai share of voice tracker, rag web search grounding, mcp google ai search