Google AI Overviews Scraper & API ($3/1k) โœจ avatar

Google AI Overviews Scraper & API ($3/1k) โœจ

Pricing

from $3.00 / 1,000 ai overview & serp queries

Go to Apify Store
Google AI Overviews Scraper & API ($3/1k) โœจ

Google AI Overviews Scraper & API ($3/1k) โœจ

โšก Scrape Google AI Overviews ($3/1k): clean Markdown answers, unwrapped citations, AEO brand audits & Page 1 rankings. Track SGE, Generative Engine Optimization (GEO) & People Also Ask in 150+ countries. MCP & RAG ready.

Pricing

from $3.00 / 1,000 ai overview & serp queries

Rating

0.0

(0)

Developer

UnitBytes | Enterprise Web Data

UnitBytes | Enterprise Web Data

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Features

Limited permissions

Share

โœจ Google AI Overviews Scraper & AEO API: Clean Markdown, Unwrapped Citations, Brand Visibility Audits & Organic Ranks


Try it for Free on Apify


๐Ÿ“– Overview

Google AI Overviews (SGE) now sit directly above Page 1 organic rankings across informational, commercial comparison, software evaluation, financial, and technical queries โ€” fundamentally reshaping click-through rates and brand discovery.

For SEO agencies, in-house growth teams, and AI data engineers, tracking AI Overviews reliably at scale has been notoriously difficult:

  • Truncated "Show More" Answers: Standard SERP scrapers only capture the opening summary paragraph and miss the collapsed comparison tables, nested lists, code snippets, and secondary citation cards that make up ~75% of the full answer.
  • Obfuscated Redirect Links: Raw SERP captures often return opaque Google redirect wrappers instead of clean, canonical publisher URLs and root domains needed for attribution dashboards.
  • Heavy Browser & SaaS Tracker Costs: Headless-browser scrapers burn 1โ€“4 GB RAM and charge $25.00 to $200.00 per 1,000 queries, while closed SaaS AEO/GEO suites charge $32.00 to $300.00 per 1,000 tracked prompts.
  • Disconnected SEO vs. AEO Reporting: Teams have had to run separate tools just to answer a single question: "Do we rank on Page 1 organically, and is Google actually citing our domain inside the AI Overview?"

Google AI Overviews Scraper by UnitBytes delivers the entire expanded AI Overview + unwrapped canonical citations + Page 1 organic rankings + People Also Ask + automated AEO Brand Citation Audit across 4 flattened Console tabs in a single lightweight 256 MB run at $2.50 / 1,000 queries on Free Tier ($3.00 / 1,000 on GOLD+ volume plans) โ€” with $0 event charge on genuine zero-result searches.

โšก UnitBytes ยท Google AI, Search, News, Trends, UGC, Shopping & Local Intelligence Ecosystem
โœจ Google AI Overviews Scraper
๐Ÿ“ You are here ($2.50โ€“$3.00/1K)
SERP AI Overviews, citations, AEO brand audit & Page 1 ranks
๐Ÿค– Google AI Mode Scraper
From $4.00/1K โ€ข Deep AI Answers
Full conversational Google AI Mode answers, cited web sources & follow-ups
๐Ÿ’ฌ Reddit & Google Trends
From $0.30โ€“$0.50 โ€ข UGC & Demand
Reddit Scraper (AI-cited threads) & Google Trends
๐Ÿ“ฐ Google News Scraper
From $1.00/1K โ€ข PR & Coverage
Direct publisher URLs, recency filters & clean full-article text
๐Ÿ›๏ธ Google Shopping & Travel
From $0.50โ€“$2.50/1K โ€ข Retail & OTAs
Google Shopping, Flights & Hotels
๐Ÿ“ Google Maps & Jobs
From $0.25/1K โ€ข Local & Hiring
B2B Leads, Reviews & Google Jobs

๐ŸŒŸ Why SEO / AEO Agencies, SaaS Brands & RAG Engineers Choose UnitBytes

Capability / MetricUnitBytes Google AI Overviews ScraperLegacy SERP APIsBrowser Scrapers & SaaS AEO Suites
๐Ÿ’ฐ Price per 1,000 Queries$2.50/1K Free Trial (~1,998 free/mo) โ€ข $3.00/1K Volume (GOLD+)$15.00 โ€“ $30.00 per 1K + extra async token calls$30.00 โ€“ $300.00 per 1K + heavy 2โ€“4 GB RAM compute
๐Ÿ“ Full Expanded Answer (markdown)โœ… Complete GFM tables, fenced code blocks, LaTeX math & nested listsโš ๏ธ Often truncated or requires manual follow-up callsโš ๏ธ Frequently misses lazy-expanded sections
๐Ÿ”— Unwrapped Canonical Citation URLsโœ… Direct external https://... URLs + normalized domainโš ๏ธ Raw redirect wrappers or partial linksโš ๏ธ Redirect links requiring post-processing
๐ŸŽฏ Built-In AEO Brand Citation Auditโœ… brandCitationAudit (cited vs competitor_cited + organicTargetRanks)โŒ Manual scripting requiredโš ๏ธ Locked inside rigid dashboards
๐Ÿ“Š 4 Flattened CSV/Excel Console Tabsโœ… Summary, AEO Audit, Unwound Citations & Organic/PAA tabsโŒ Nested JSON onlyโŒ Nested arrays ([object Object] in CSV)
๐ŸŒ Global + Hyper-Local Geo-Targetingโœ… 150+ Countries (country) + City/State (location) + EEA/UK supportโœ… Supportedโš ๏ธ Often blocked by European consent screens

โšก 60-Second Quick Start: Ready-to-Run JSON Presets & Zero-Rewrite Migration

Click Try for free in the Apify Console (pre-filled with sample B2B & technical queries plus targetDomains so your very first run showcases brandCitationAudit), or paste any preset below into the JSON input tab:

1. SaaS / Agency AEO Brand Citation vs. Page 1 SEO Gap Audit

{
"queries": [
"best crm for small business",
"compare hubspot vs salesforce vs pipedrive for 20 person sales team",
"inbound marketing automation software pricing"
],
"country": "US",
"targetDomains": ["hubspot.com", "salesforce.com", "pipedrive.com"],
"includeOrganicResults": true,
"includePeopleAlsoAsk": true,
"resolveUrls": true,
"maxQueries": 25
}

2. Hyper-Local City & Regional Service Visibility Audit (location)

{
"queries": [
"commercial roofing replacement cost per square foot",
"best managed it support providers for healthcare clinics"
],
"country": "US",
"location": "Austin, Texas, United States",
"targetDomains": ["HubSpot", "angi.com"],
"includeOrganicResults": true,
"maxQueries": 20
}

3. Multi-Country European / Global RAG Knowledge Grounding

{
"queries": [
"stocks and shares isa vs lifetime isa uk tax rules",
"difference between postgresql and mysql for analytical workloads"
],
"country": "GB",
"includeOrganicResults": false,
"includePeopleAlsoAsk": true,
"resolveUrls": true,
"maxConcurrency": 6,
"maxQueries": 50
}

๐Ÿ”„ Zero-Rewrite Drop-In API Compatibility: Migrating an existing SERP or AEO script? You don't even need to rename payload keys โ€” this Actor automatically normalizes query, question, questions, prompts, keywords, or q (including newline-separated strings), gl (countryCode), hl (languageCode), maxItems (limit), and brandKeywords / brands / domains / trackDomains!


๐ŸŽฏ Built-In AEO Brand Citation Audit & 4 Console Dataset Views

Pass your own domains, client subdomains, or brand names in targetDomains โ€” supporting root domains ("hubspot.com"), exact subdomains ("docs.snowflake.com"), full URLs ("https://www.hubspot.com/pricing"), and bare brand names ("HubSpot") โ€” and every output item automatically includes a turnkey brandCitationAudit object:

  • citationStatus:
    • "cited" โ€” At least one of your targetDomains or brand targets is cited inside the AI Overview.
    • "competitor_cited" โ€” Google rendered an AI Overview with external citations, and competing domains were cited instead of yours.
    • "overview_no_citations" โ€” Google rendered a synthesized AI Overview with zero external web links.
    • "no_overview" โ€” Google did not display an AI Overview for this query (hasAiOverview: false).
  • citedTargetUrls & citedTargetCount: Every exact URL from your target domains cited in the AI Overview.
  • topCompetitorDomains: Ranked tally of competing domains winning AI Overview citations on that keyword.
  • organicTargetRanks: Your exact Page 1 organic ranking positions (rank, domain, url) on the same SERP โ€” making it effortless to spot "SEO Rank #2, AEO Cited #0" content gaps!

๐Ÿ“Š 4 Ready-to-Export Console Dataset Views (Zero [object Object] in CSV/Sheets)

Every run automatically populates 4 purpose-built dataset views in the Apify Console Output tab and REST API:

  1. AI Overviews & SERP Summary (?view=overview): Flattened executive view with query, country, hasAiOverview, aiOverviewState, brandCitationAudit.citationStatus, citationsCount, organicResultsCount, markdown, and googleSearchUrl.
  2. AEO Brand Citation Audit (?view=aeo_audit): Dedicated brand-gap scorecard flattening citationStatus, isCited, citedTargetCount, citedTargetUrls, topCompetitorDomains, and organicTargetRanks.
  3. Extracted Citations & Publishers (?view=citations): Unwound one-row-per-citation table (citations.index, citations.domain, citations.publisher, citations.title, citations.url, citations.snippet) ready for instant publisher share-of-voice pivot tables in Excel or Google Sheets.
  4. Page 1 Organic & PAA (?view=organic_vs_paa): Traditional Page 1 organicResults and peopleAlsoAsk side-by-side with hasAiOverview.

๐Ÿ’ฐ Transparent Pay-Per-Event Pricing ($2.50 / 1,000 Free Trial โ€ข $3.00 / 1,000 Volume)

This Actor uses transparent Pay-Per-Event (PPE) billing on a minimal 256 MB container footprint โ€” with zero browser compute surcharges, zero extra async-token fees when Google lazy-loads an AI Overview, and $0.00 query charge on genuine zero-result searches.

Apify Plan TierEvent NamePrice per QueryPrice per 1,000 QueriesIncluded in $5.00 Credit
Free Plan (FREE)ai-overview-query$0.0025$2.50 / 1,000 queries~1,998 queries / month free
Starter Plan (BRONZE)ai-overview-query$0.0033$3.30 / 1,000 queries~1,513 queries per $5.00
Scale Plan (SILVER)ai-overview-query$0.0031$3.10 / 1,000 queries~1,611 queries per $5.00
Business & Enterprise (GOLD+)ai-overview-query$0.0030$3.00 / 1,000 queries~1,665 queries per $5.00
Actor Run Startapify-actor-start$0.0050$5.00 / 1,000 runsOne-time startup fee per run (256 MB allocation)
Zero-Result Searchesโ€”$0.00 / query$0.00 event feeGenuine no_results SERPs are never billed

๐Ÿ’ก Hard Budget Cap Support: Set Maximum cost per run in the Apify Console (Options -> Maximum cost per run) or via API (maxTotalChargeUsd). The Actor monitors remaining budget in real time and stops cleanly with exit code 0 the instant your cap is reached.


โฐ Automate Weekly 24/7 AEO / GEO Monitoring (3-Click Apify Schedules)

Because Google updates AI Overview citations continuously as fresh benchmarks, documentation, and community threads are indexed, high-performing SEO teams monitor their core money keywords on an automated weekly or daily cadence:

  1. Save Your Audit Preset as a Task: Configure your keyword list, country, location, and targetDomains in Apify Console and click Save as new task.
  2. Attach an Apify Schedule: Open Schedules, click Create new schedule, select your saved Task, and choose Weekly (e.g., 0 7 * * 1 โ€” Mondays at 07:00 UTC) or Daily.
  3. Connect Alerts or BI Exports: Add a native Apify Integration (Slack, Google Sheets, Make, n8n, Zapier, or Webhook) on ACTOR.RUN.SUCCEEDED to alert your content team whenever citationStatus shifts to "competitor_cited".

๐Ÿ“… Recurring Monthly Monitoring Cost Reference

Tracked Keyword SetSchedule CadenceMonthly QueriesPlan TierNet Monthly Cost
100 Core KeywordsWeekly (4 runs/mo)400 / moFree Plan ($5 free credit)$0.00 / mo ($1.02 covered by $5 monthly credit)
400 Core KeywordsWeekly (4 runs/mo)1,600 / moFree Plan ($5 free credit)$0.00 / mo ($4.02 covered by $5 monthly credit)
500 Agency KeywordsWeekly (4 runs/mo)2,000 / moPaid (GOLD+ $3/1K)$6.02 / mo (4 ร— $0.005 start + 2,000 ร— $0.003)
1,000 Enterprise KeywordsDaily (30 runs/mo)30,000 / moPaid (GOLD+ $3/1K)$90.15 / mo (30 ร— $0.005 start + 30,000 ร— $0.003)

๐Ÿ”Œ No-Code, GTM Outbound & AI Pipeline Recipes (Clay, n8n, Make, Sheets & RAG)

1. ๐ŸŽฏ Clay + Google Maps Leads B2B SEO / AEO Agency Outbound Playbook

Turn live AI Overview citation gaps into your highest-converting B2B agency sales hook:

  1. Source High-Value Local or SaaS Prospects: Run Google Maps Email & Leads Scraper to pull verified business websites, decision-maker emails, phone numbers, and categories (e.g., dental clinics, personal injury law firms, HVAC contractors, or regional B2B agencies).
  2. Enrich Each Prospect's AEO Visibility in Clay: Trigger unitbytes/google-ai-overviews-scraper from Clay's Apify integration passing the prospect's high-intent buyer query + location + targetDomains: ["{{prospect_domain}}"].
  3. Personalize Outbound with Proof: Filter for prospects where brandCitationAudit.citationStatus == "competitor_cited" (especially those ranking on Page 1 organically via organicTargetRanks yet excluded from the AI Overview!) and reference the exact topCompetitorDomains capturing their AI Overview traffic.

2. ๐Ÿ”” n8n & Make Weekly Citation Drift Alert (Slack / Microsoft Teams)

Configure an n8n or Make workflow triggered by an Apify ACTOR.RUN.SUCCEEDED webhook $\rightarrow$ fetch {{defaultDatasetUrl}}/items?view=aeo_audit $\rightarrow$ filter items where brandCitationAudit.citationStatus === "competitor_cited" $\rightarrow$ send a formatted Slack/Teams brief listing the query, Page 1 organicTargetRanks, topCompetitorDomains, and clickable googleSearchUrl.

3. ๐Ÿ“Š Google Sheets & Looker Studio 1-Click Flattened CSV Dashboards

Skip JSON parsing scripts completely. Pull unwound citation rows or flattened brand audits directly into Google Sheets (=IMPORTDATA(...)) or Looker Studio via Apify's view-specific CSV endpoints:

  • Brand Scorecard CSV: https://api.apify.com/v2/datasets/DATASET_ID/items?view=aeo_audit&format=csv
  • Publisher Share-of-Voice CSV (1 Row per Citation): https://api.apify.com/v2/datasets/DATASET_ID/items?view=citations&format=csv

4. ๐Ÿง  LangChain, LlamaIndex & CrewAI Multi-Source RAG Grounding

Feed deterministic markdown, block-level textBlocks, and verified canonical citations into LangChain, LlamaIndex, or CrewAI agents โ€” and combine them with real-time journalism from Google News Scraper plus community discussions from Reddit Scraper (one of Google AI's most frequently cited UGC domains) for 360-degree grounded synthesis.


โœจ Key Capabilities

  • ๐Ÿ“ LLM-Ready GitHub-Flavored Markdown (markdown) + Structured AST (textBlocks): Reconstructs complete headings (###), bold callouts, nested bulleted and numbered lists, multi-column comparison tables (| Feature | Option A | Option B |), syntax-tagged code blocks (```python), and inline/block LaTeX formulas ($O(\log n)$).
  • ๐Ÿ”— Unwrapped Canonical External Citations (citations): Resolves citation cards into clean external URLs (https://...), normalized root domain, publisher, title, snippet, and faviconUrl.
  • ๐Ÿ“Š Side-by-Side Page 1 Organic Rankings (organicResults): Captures traditional Page 1 search rankings (rank, title, url, domain, displayedUrl, snippet) in the exact same pass so you can correlate classic SEO rank with AI Overview citation share.
  • โ“ People Also Ask (peopleAlsoAsk): Extracts related user follow-up questions surfaced on the SERP for content brief generation.
  • ๐ŸŒ 150+ Countries & City-Level Geo-Targeting (country + location): Audit national markets (US, GB, DE, FR, CA, AU, IN, BR, JP, ES, IT, NL, SG, AE, etc. โ€” including full European EEA/UK support) or pinpoint exact cities ("Austin, Texas, United States", "Manchester, England, United Kingdom").

๐Ÿ” When hasAiOverview Is false (Honest Upstream SERP Behavior)

Google does not generate an AI Overview on 100% of searches. In real-world SERPs, hasAiOverview is false (aiOverviewState: "none") in three common scenarios:

  1. Pure Navigational or Operator Queries: Brand login searches, exact domain lookups, or search operators such as site:example.com frequently bypass AI Overviews upstream.
  2. Commercial / YMYL Queries Without AI Trigger: On certain transactional or localized queries, Google intentionally serves traditional organic listings only.
  3. SERP Recency Filters (timeRange != "any"): Applying publication-date filters (hour, day, week, month, year) restricts Google's organic index by recency and causes Google upstream to suppress AI Overviews on most queries. Keep timeRange: "any" whenever your primary goal is capturing AI Overviews.

Why Every Query Still Delivers Full SERP Value: Even when Google suppresses the AI Overview (hasAiOverview: false), this Actor still returns the query's Page 1 organicResults, peopleAlsoAsk, and brandCitationAudit (citationStatus: "no_overview" + your organicTargetRanks), giving your SEO/AEO reporting pipeline complete visibility into both AI-triggered and classic SERPs without blind spots. (And if a search returns zero results across Google altogether, aiOverviewState: "no_results" is never billed.)


๐Ÿ› ๏ธ How to Use via API (Python, Node.js & cURL)

๐Ÿ Python Example (AEO Brand Visibility & Competitor Citation Audit)

$pip install apify-client
from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_API_TOKEN")
run_input = {
"queries": [
"best crm for small business",
"compare hubspot vs pipedrive vs zoho for 10 person sales team",
"difference between postgresql and mysql",
],
"country": "US",
"targetDomains": ["hubspot.com", "pipedrive.com", "postgresql.org"],
"includeOrganicResults": True,
"includePeopleAlsoAsk": True,
"resolveUrls": True,
"maxConcurrency": 4,
"maxQueries": 25,
}
run = client.actor("unitbytes/google-ai-overviews-scraper").call(run_input=run_input)
items = client.dataset(run["defaultDatasetId"]).list_items().items
for row in items:
audit = row.get("brandCitationAudit") or {}
print(
f"[{row['country']}] {row['query']} | AIO={row['hasAiOverview']} "
f"| Citations={row['citationsCount']} | Audit={audit.get('citationStatus')}"
)

๐ŸŸจ JavaScript / Node.js Example

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_APIFY_API_TOKEN' });
const run = await client.actor('unitbytes/google-ai-overviews-scraper').call({
queries: [
'best roofing contractors near me',
'roof replacement cost estimator',
],
country: 'US',
location: 'Austin, Texas, United States',
includeOrganicResults: true,
resolveUrls: true,
maxQueries: 10,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Processed ${items.length} localized SERP + AI Overview records`, items[0]);

๐ŸŒ cURL Example

curl -X POST "https://api.apify.com/v2/acts/unitbytes~google-ai-overviews-scraper/runs?token=YOUR_APIFY_API_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"queries": ["how does a stocks and shares isa work in the uk"],
"country": "GB",
"targetDomains": ["gov.uk", "moneysavingexpert.com"],
"includeOrganicResults": true,
"resolveUrls": true,
"maxQueries": 5
}'

๐Ÿ“ค Example Output Record

{
"query": "compare hubspot vs pipedrive vs zoho for 10 person sales team",
"country": "US",
"language": "en",
"location": null,
"timeRange": "any",
"hasAiOverview": true,
"aiOverviewState": "deferred",
"markdown": "Comparing **HubSpot**, **Pipedrive**, and **Zoho CRM** for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization.\n\n### Quick Comparison at a Glance\n\n| Feature | HubSpot Sales Hub | Pipedrive | Zoho CRM |\n| --- | --- | --- | --- |\n| Best For | All-in-one GTM & marketing alignment | Visual pipeline & outbound velocity | Budget-friendly customization |\n| Learning Curve | Low to Moderate | Very Low | Moderate |\n| Reporting | Advanced multi-touch attribution | Deal velocity & activity tracking | Custom BI modules & forecasting |",
"text": "Comparing HubSpot, Pipedrive, and Zoho CRM for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization...",
"textBlocks": [
{
"type": "paragraph",
"text": "Comparing HubSpot, Pipedrive, and Zoho CRM for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization."
},
{
"type": "heading",
"level": 3,
"text": "Quick Comparison at a Glance"
},
{
"type": "table",
"headers": ["Feature", "HubSpot Sales Hub", "Pipedrive", "Zoho CRM"],
"rows": [
["Best For", "All-in-one GTM & marketing alignment", "Visual pipeline & outbound velocity", "Budget-friendly customization"]
]
}
],
"citations": [
{
"index": 1,
"title": "HubSpot vs. Pipedrive vs. Zoho CRM Comparison",
"url": "https://www.pcmag.com/picks/the-best-crm-software",
"domain": "pcmag.com",
"publisher": "PCMag",
"snippet": "Pipedrive focuses squarely on sales pipeline management, while HubSpot unifies marketing, sales, and service hubs.",
"faviconUrl": "https://encrypted-tbn0.gstatic.com/faviconV2?url=https://www.pcmag.com&sz=64"
}
],
"citationsCount": 1,
"brandCitationAudit": {
"targetDomains": ["hubspot.com", "pipedrive.com"],
"citationStatus": "competitor_cited",
"isCited": false,
"citedTargetUrls": [],
"citedTargetCount": 0,
"topCompetitorDomains": [
{ "domain": "pcmag.com", "citationsCount": 1 }
],
"organicTargetRanks": [
{
"rank": 2,
"domain": "hubspot.com",
"url": "https://www.hubspot.com/comparisons/pipedrive-vs-hubspot"
}
]
},
"organicResults": [
{
"rank": 1,
"title": "The Best CRM Software for Small Businesses",
"url": "https://www.pcmag.com/picks/the-best-crm-software",
"domain": "pcmag.com",
"displayedUrl": "https://www.pcmag.com โ€บ Business โ€บ CRM",
"snippet": "We tested the top CRM platforms for small and midsize sales teams..."
},
{
"rank": 2,
"title": "Pipedrive vs. HubSpot: Which CRM Fits Your Sales Team?",
"url": "https://www.hubspot.com/comparisons/pipedrive-vs-hubspot",
"domain": "hubspot.com",
"displayedUrl": "https://www.hubspot.com โ€บ comparisons",
"snippet": "Compare HubSpot Sales Hub and Pipedrive side by side across pipeline automation, reporting, and seat pricing."
}
],
"organicResultsCount": 2,
"peopleAlsoAsk": [
{
"question": "Is Pipedrive or HubSpot better for a 10-person team?",
"answer": "Pipedrive is often faster to onboard for pure outbound sales teams, whereas HubSpot scales better if marketing and sales share attribution.",
"title": "CRM Buyer Guide",
"url": "https://www.pcmag.com/picks/the-best-crm-software",
"domain": "pcmag.com"
}
],
"googleSearchUrl": "https://www.google.com/search?q=compare+hubspot+vs+pipedrive+vs+zoho+for+10+person+sales+team&gl=us&hl=en",
"scrapedAt": "2026-11-14T12:00:00Z"
}

Complete Output Fields Reference

FieldTypeDescription
querystringNormalized Google Search query processed.
countrystringUppercase 2-letter ISO 3166-1 country code ("US", "GB", "DE", "JP", etc.).
languagestringEffective interface language code used ("en", "de", "fr", "pt-BR", "ja", etc.).
locationstring | nullCanonical city/region geo-targeting location string if supplied, otherwise null.
timeRangestringApplied SERP recency filter ("any", "hour", "day", "week", "month", "year").
hasAiOverviewbooleantrue when Google rendered an AI Overview on this SERP.
aiOverviewStatestring"inline" (rendered directly on initial SERP), "deferred" (expanded dynamically), "none", or "no_results".
markdownstringFull AI Overview answer in clean GitHub-Flavored Markdown (headings, tables, lists, code, math).
textstringClean plain-text version of the AI Overview answer.
textBlocksobject[]Structured block list (paragraph, heading, list, table, code) for deterministic RAG chunking.
citationsobject[]Unwrapped source citations (index, title, url, domain, publisher, snippet, faviconUrl).
citationsCountintegerTotal number of citations in citations.
brandCitationAuditobject | nullAEO audit object (targetDomains, citationStatus, isCited, citedTargetUrls, citedTargetCount, topCompetitorDomains, organicTargetRanks) when targetDomains is set (null when omitted).
organicResultsobject[]Page 1 organic search results (rank, title, url, domain, displayedUrl, snippet).
organicResultsCountintegerCount of Page 1 organic results extracted.
peopleAlsoAskobject[]Related People Also Ask entries (question, answer, title, url, domain).
googleSearchUrlstringDirect Google Search URL for the query and market.
scrapedAtstringUTC ISO 8601 extraction timestamp.

โš™๏ธ Input Parameters Reference

ParameterTypeDefault / PrefillDescription
queriesstring[]["best crm for small business", ...] (prefill)Search keywords, questions, newline-separated strings, or Google Search URLs. Aliases query, question, questions, prompts, keywords, q supported.
startUrlsobject[][]Optional Google Search URLs ({"url": "https://www.google.com/search?q=..."}).
maxQueriesinteger25Maximum unique queries to process in this run (1 โ€“ 1000; alias maxItems).
countrystring"US" (prefill)2-letter ISO 3166-1 country code (US, GB, DE, FR, CA, AU, IN, BR, JP, etc.; alias gl).
languagestring""Optional ISO/BCP-47 language override (alias hl). Leave empty ("") to automatically use the natural language of country.
locationstring""Optional city/state/region geo-targeting (e.g. "Austin, Texas, United States").
timeRangestring"any""any", "hour", "day", "week", "month", or "year". Keep "any" for AI Overviews.
targetDomainsstring[][] (API default) / ["hubspot.com", ...] (UI prefill)Root domains, subdomains (docs.snowflake.com), full URLs, or bare brand names ("HubSpot") to populate brandCitationAudit (aliases brandKeywords, brands, domains, trackDomains).
includeOrganicResultsbooleantrueInclude Page 1 traditional organic search rankings.
includePeopleAlsoAskbooleantrueInclude People Also Ask questions on the SERP.
resolveUrlsbooleantrueUnwrap Google redirect links into clean canonical external URLs.
maxConcurrencyinteger4Parallel query concurrency (1 โ€“ 8).
proxyConfigurationobjectnullOptional custom HTTP/SOCKS5 proxy override (proxyUrls). Managed residential proxies are configured automatically on Cloud.

๐Ÿค– AI Agent, Coding Assistant & MCP Server Integration

๐Ÿ“‹ Copy-and-Paste Directive for AI Coding Assistants (Cursor, Claude Code & Windsurf)

"Use unitbytes/google-ai-overviews-scraper on Apify to extract Google Search AI Overviews (SGE) in clean GitHub-Flavored Markdown, unwrapped source citations, Page 1 organicResults, peopleAlsoAsk, and brandCitationAudit (targetDomains accepts root domains, subdomains, URLs, or bare brand names). Pair it with unitbytes/google-ai-mode-scraper for deep conversational Google AI Mode benchmarking. Export flattened tables directly via ?view=aeo_audit or ?view=citations. Example Python call: client.actor('unitbytes/google-ai-overviews-scraper').call(run_input={'queries': ['best crm for small business'], 'country': 'US', 'targetDomains': ['hubspot.com'], 'maxQueries': 25})"

๐Ÿ”Œ Option A: Local stdio MCP Server (claude_desktop_config.json / .cursor/mcp.json)

{
"mcpServers": {
"apify-google-ai": {
"command": "npx",
"args": [
"-y",
"@apify/actors-mcp-server",
"--actors",
"unitbytes/google-ai-overviews-scraper,unitbytes/google-ai-mode-scraper"
],
"env": {
"APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
}
}
}
}

๐ŸŒ Option B: Hosted Apify Streamable HTTP MCP Server

{
"mcpServers": {
"apify": {
"type": "http",
"url": "https://mcp.apify.com/?tools=actors,docs,unitbytes/google-ai-overviews-scraper,unitbytes/google-ai-mode-scraper"
}
}
}

โ“ Frequently Asked Questions (FAQ)

1. What is the difference between Google AI Overviews Scraper and Google AI Mode Scraper?

Google AI Overviews Scraper captures the AI Overview summary box displayed directly above traditional Page 1 Google Search results, alongside organicResults and peopleAlsoAsk so you can measure SEO vs. AEO correlation in one pass. Google AI Mode Scraper queries Google's dedicated conversational AI Mode surface, which generates multi-section deep research answers, inline cited vs. related web sources, and suggested followUpQuestions on virtually every prompt. Most SEO/GEO teams run both side by side.

2. Can targetDomains track subdomains, specific product URLs, or bare brand names?

Yes. targetDomains accepts root domains ("hubspot.com"), specific subdomains ("docs.snowflake.com"), full URLs ("https://www.hubspot.com/pricing"), and bare brand names ("HubSpot"). In the Apify Console UI, sample domains are pre-filled so your first test run demonstrates brandCitationAudit immediately; when calling via API without targetDomains, it defaults cleanly to [] (brandCitationAudit: null).

3. Am I charged if a search returns zero results, or how do I cap spending?

Genuine zero-result searches (aiOverviewState: "no_results") are never charged ($0.00 event fee). Queries where Google serves a valid traditional Page 1 SERP without an AI Overview (hasAiOverview: false) return complete Page 1 organicResults, peopleAlsoAsk, and organicTargetRanks and count as one SERP query. You can enforce an exact dollar limit on any run via maxTotalChargeUsd or maxQueries.

4. How do I export citations or brand audits cleanly to CSV, Excel, or Google Sheets?

Select any of the 4 built-in Console Dataset Views (AI Overviews & SERP Summary, AEO Brand Citation Audit, Extracted Citations & Publishers, or Page 1 Organic & PAA) before clicking Export CSV / Excel, or append ?view=citations&format=csv / ?view=aeo_audit&format=csv to your dataset URL for flat, pivot-ready spreadsheets with zero [object Object] cells.

5. Does it work in the UK, European Union (EEA), Asia-Pacific, and specific cities?

Yes. The Actor supports 150+ countries (US, GB, DE, FR, ES, IT, NL, PL, SE, CA, AU, IN, SG, JP, BR, MX, AE, etc.) โ€” handling European consent screens automatically โ€” plus hyper-local city/state location targeting (e.g., "Austin, Texas, United States", "London, England, United Kingdom").

6. Can I migrate an existing SERP or AI Overview integration without rewriting field names?

Yes. Input aliases including query, question, questions, prompts, keywords, q (as arrays or newline-separated strings), gl, hl, maxItems, and brandKeywords / brands / domains / trackDomains are mapped automatically.

7. Do I need a Google account, cookies, or a separate proxy subscription?

No login credentials or cookies are ever required. Managed residential routing is automatically configured on Apify Cloud at no extra proxy setup step, and advanced users can optionally pass custom HTTP/SOCKS5 proxyUrls in proxyConfiguration.


๐ŸŒ Complete UnitBytes Google, AI, Search & UGC Intelligence Ecosystem

ActorBest ForPricing
Google AI Overviews Scraper (๐Ÿ“ You are here)SERP AI Overviews (SGE) in clean GFM Markdown, unwrapped citations, brandCitationAudit, Page 1 organic ranks & PAAFrom $3.00 / 1K
Google AI Mode ScraperFull conversational Google AI Mode answers, cited vs. related web sources, follow-up prompts & GEO brand auditsFrom $4.00 / 1K
Reddit Posts, Comments & Search ScraperExtract AI-cited Reddit community threads, buyer comparisons, nested comments & organic brand sentimentFrom $0.50 / 1K
Google Trends Scraper (5-in-1)Historical interest over time, regional heatmaps, +5,000% breakout queries & related topicsFrom $0.30 / 1K
Google News ScraperDirect publisher URLs, recency/domain filters, curated topic feeds & optional clean full-article textFrom $1.00 / 1K
Google Shopping ScraperLive retail product prices, discounts, multi-seller offers & direct checkout URLsFrom $2.00 / 1K
Google Flights ScraperReal-time airfares, carriers, flight numbers, stops, layovers & CO2 emissionsFrom $0.50 / 1K
Google Hotels ScraperNightly & total hotel/rental rates, multi-OTA price parity (Booking.com, Expedia), GPS & HD photosFrom $2.50 / 1K
Google Jobs ScraperCorporate hiring signals, parsed salaries, employer logos & direct ATS apply linksFrom $4.00 / 1K
Google Maps Email & Leads ScraperVerified B2B business emails, phones, social profiles & website tech stacksFrom $0.50 / 1K
Google Maps Reviews ScraperBulk extraction of up to 10,000 customer reviews per place with keyword & rating filtersFrom $0.25 / 1K

โš–๏ธ Compliance & Privacy

This Actor extracts strictly publicly available search results and AI Overview summaries displayed on Google Search. It never accesses private Google accounts, personal histories, or personally identifiable information (PII). Read Apify's guide on the legality of web scraping to ensure compliance with applicable regulations.

Disclaimer

This Actor is an independent software tool and is not affiliated with, endorsed by, or sponsored by Google LLC.


๐Ÿ’ฌ Support & Feedback

Building an AEO visibility dashboard, multi-market SEO tracker, Clay outbound engine, or enterprise RAG pipeline?


๐Ÿ” Keywords & Search Tags

google ai overviews scraper, google sge scraper, google search generative experience api, answer engine optimization (aeo), generative engine optimization (geo), ai brand visibility tracker, ai citation checker, llm seo audit, google ai overview markdown api, people also ask scraper, google serp + ai overview api, ai share of voice tracker, rag web search grounding, mcp google ai search