# Google AI Overviews Scraper & API ($4/1k) โจ (`unitbytes/google-ai-overviews-scraper`) Actor
โก Scrape Google AI Overviews ($4/1k): Markdown, unwrapped citations, AEO brand audits, organic ranks & PAA globally. Export JSON, CSV, or Excel.
- **URL**: https://apify.com/unitbytes/google-ai-overviews-scraper.md
- **Developed by:** [UnitBytes | Enterprise Web Data](https://apify.com/unitbytes) (community)
- **Categories:** SEO tools, AI, Automation
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet
## Pricing
from $4.00 / 1,000 ai overview & serp queries
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.
Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event
## What's an Apify Actor?
An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.
For examples already wired to this Actor's own input schema, see the [API](#api) section below.
Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).
# README
## โจ Google AI Overviews Scraper & AEO API: Clean Markdown, Unwrapped Citations, Brand Visibility Audits & Organic Ranks
[](https://apify.com/unitbytes/google-ai-overviews-scraper)
[](#)
[](#)
[](#)
[](#)
[](#)
**The production-grade Google AI Overviews (SGE) scraper & Answer Engine Optimization (AEO / GEO) intelligence API for SEO agencies, brand visibility trackers, SaaS growth teams, and RAG data pipelines. Extract complete AI Overviews in clean GitHub-Flavored Markdown (tables, code blocks with language tags, inline LaTeX math & nested lists), unwrapped canonical external citation URLs, built-in `brandCitationAudit` comparing AI citations against Page 1 organic rankings, and People Also Ask across 150+ countries.**
[**๐ Try it Live on Apify**](https://apify.com/unitbytes/google-ai-overviews-scraper) โข [**๐ฐ From $4.00 / 1,000 Queries**](#-transparent-pay-per-event-pricing-from-400--1000-queries) โข [**๐ฏ AEO Brand Citation Audit**](#-built-in-aeo-brand-citation-audit-targetdomains) โข [**๐ฌ Support**](https://apify.com/unitbytes/google-ai-overviews-scraper/issues)
***
โก 1-Click Free Trial: Audit up to ~995 Google Search AI Overview queries every month free with Apify's $5 monthly credit (up to ~1,248 per $5 on volume plans) โข No credit card required
***
### ๐ Overview
**Google AI Overviews** now sit directly above Page 1 organic rankings across informational, commercial comparison, software evaluation, financial, and technical queries โ fundamentally reshaping click-through rates and brand discovery.
For SEO agencies, in-house growth teams, and AI data engineers, tracking AI Overviews reliably at scale has been notoriously difficult:
- **Truncated "Show More" Answers**: Standard SERP scrapers only capture the opening summary paragraph and miss the collapsed comparison tables, nested lists, code snippets, and secondary citation cards that make up ~75% of the full answer.
- **Obfuscated Redirect Links**: Raw SERP captures often return opaque Google redirect wrappers instead of clean, canonical publisher URLs and root domains needed for attribution dashboards.
- **Heavy Browser Costs**: Headless-browser scrapers burn `1โ4 GB RAM`, take 45โ90 seconds per keyword, and charge **$25.00 to $200.00 per 1,000 queries**.
- **Disconnected SEO vs. AEO Reporting**: Teams have had to run separate tools just to answer a single question: *"Do we rank on Page 1 organically, and is Google actually citing our domain inside the AI Overview?"*
**Google AI Overviews Scraper by UnitBytes** delivers the **entire expanded AI Overview** + **unwrapped canonical citations** + **Page 1 organic rankings** + **People Also Ask** + **automated AEO Brand Citation Audit** in a single lightweight **`256 MB` run** starting **from `$4.00` per 1,000 queries**.
|
โก UnitBytes ยท Google AI, Search, News, Trends, Shopping & Local Intelligence Ecosystem
|
โจ Google AI Overviews Scraper
๐ You are here (From $4.00/1K)
SERP AI Overviews, citations, AEO brand audit & Page 1 ranks
|
๐ค Google AI Mode Scraper
From $4.00/1K โข Deep AI Answers
Full conversational Google AI Mode answers, cited web sources & follow-ups
|
๐ Google Trends Scraper
From $0.30/1K โข Search Demand
Breakout topics, interest over time, regional heatmaps & rising queries
|
๐ฐ Google News Scraper
From $1.00/1K โข PR & Coverage
Direct publisher URLs, recency filters & clean full-article text
|
๐๏ธ Google Shopping Scraper
From $2.00/1K โข Retail & Offers
Product prices, deals, multi-seller offers & store checkout URLs
|
๐ Google Maps & Jobs
From $0.25/1K โข Local & Hiring
B2B Leads, Reviews & Google Jobs
|
***
### ๐ Why SEO / AEO Agencies, SaaS Brands & RAG Engineers Choose UnitBytes
| Capability / Metric | **UnitBytes Google AI Overviews Scraper** | **Legacy SERP APIs** | **Browser-Based Scrapers** |
| :--- | :---: | :---: | :---: |
| **๐ฐ Price per 1,000 Queries** | **From $4.00 ($0.0040 / query)** | $15.00 โ $30.00 per 1K + extra async token calls | $30.00 โ $200.00 per 1K + 2โ4 GB RAM compute |
| **๐ Full Expanded Answer (`markdown`)** | **โ
Complete GFM tables, fenced code blocks, LaTeX math & nested lists** | โ ๏ธ Often truncated or requires manual follow-up calls | โ ๏ธ Frequently misses lazy-expanded sections |
| **๐ Unwrapped Canonical Citation URLs** | **โ
Direct external `https://...` URLs + normalized `domain`** | โ ๏ธ Raw redirect wrappers or partial links | โ ๏ธ Redirect links requiring post-processing |
| **๐ฏ Built-In AEO Brand Citation Audit** | **โ
`brandCitationAudit` (`cited` vs `competitor_cited` + `organicTargetRanks`)** | โ Manual scripting required | โ Not included |
| **๐ Unified SEO + AEO Single-Pass Output** | **โ
AI Overview + Citations + Page 1 Organic + PAA in 1 item** | โ ๏ธ Separate endpoints / extra charges | โ ๏ธ Fragile multi-selector scraping |
| **๐ Global + Hyper-Local Geo-Targeting** | **โ
150+ Countries (`country`) + City/State (`location`) + EEA support** | โ
Supported | โ ๏ธ Often blocked by European consent screens |
***
### ๐ฏ Built-In AEO Brand Citation Audit (`targetDomains`)
Pass your own domains or client domains in `targetDomains` (for example `["hubspot.com", "pipedrive.com"]`) and every output record automatically includes a turnkey **`brandCitationAudit`** object cross-referencing AI Overview citations against Page 1 organic rankings:
- **`citationStatus`**:
- `"cited"` โ At least one of your `targetDomains` is directly cited inside the AI Overview.
- `"competitor_cited"` โ Google rendered an AI Overview with external citations, and competing domains were cited instead of yours.
- `"overview_no_citations"` โ Google rendered a synthesized AI Overview with zero external web links.
- `"no_overview"` โ Google did not display an AI Overview for this query (`hasAiOverview: false`).
- **`citedTargetUrls` & `citedTargetCount`**: Every exact URL from your target domains cited in the AI Overview.
- **`topCompetitorDomains`**: Ranked tally of competing root domains winning AI Overview citations on that keyword.
- **`organicTargetRanks`**: Your exact Page 1 organic ranking positions (`rank`, `domain`, `url`) on the same SERP โ making it effortless to spot **"SEO Rank #2, AEO Cited #0"** content gaps!
***
### ๐ฐ Transparent Pay-Per-Event Pricing (From `$4.00 / 1,000 Queries`)
This Actor uses transparent **Pay-Per-Event (PPE)** billing on a minimal `256 MB` container footprint โ with zero browser compute surcharges and zero hidden secondary-call fees when Google lazy-loads an AI Overview, and **`$0.00` query charge** on genuine zero-result searches.
| Apify Plan Tier | Event Name | Price per Query | Price per 1,000 Queries | Included in $5.00 Credit |
| :--- | :--- | :--- | :--- | :--- |
| **Free Plan** (`FREE`) | `ai-overview-query` | `$0.0050` | **`$5.00 / 1,000 queries`** | **~995 queries / month free** |
| **Paid Volume Plans** (`GOLD`+) | `ai-overview-query` | **`$0.0040`** | **`$4.00 / 1,000 queries`** | **~1,248 queries per $5.00** |
| **Actor Run Start** | `apify-actor-start` | `$0.0050` | `$5.00 / 1,000 runs` | One-time startup fee per run (`256 MB` allocation) |
#### ๐ก Concrete Cost Examples & Spending-Cap Control
- **Free Tier Monthly Audit (`$0.00` out-of-pocket)**: Run a weekly 200-keyword AEO visibility audit (`800` queries/month total) completely covered by Apify's free **$5.00 monthly platform credit** (`$0.005` start + `200 ร $0.005` = **`$1.005` per weekly run** on Free Tier).
- **Agency 10,000-Keyword Multi-Client Tracker (Paid Tier)**: Auditing `10,000` commercial keywords with full AI Overview Markdown, unwrapped citations, Page 1 organic ranks, PAA, and `brandCitationAudit` costs just **`$40.005`** (`$4.00 / 1,000`).
- **Hard Budget Cap Support**: Set **Maximum cost per run** in the Apify Console (`Options -> Maximum cost per run`) or via API (`maxTotalChargeUsd`). The Actor monitors remaining budget in real time and stops cleanly with exit code `0` as soon as your spending cap is reached.
***
### โจ Key Capabilities
- **๐ LLM-Ready GitHub-Flavored Markdown (`markdown`) + Structured AST (`textBlocks`)**: Reconstructs complete headings (`###`), bold callouts, nested bulleted and numbered lists, multi-column comparison tables (`| Feature | Option A | Option B |`), syntax-tagged code blocks (` ```python `), and inline/block LaTeX formulas (`$O(\log n)$`).
- **๐ Unwrapped Canonical External Citations (`citations`)**: Resolves citation cards into clean external URLs (`https://...`), normalized root `domain`, `publisher`, `title`, `snippet`, and `faviconUrl`.
- **๐ Side-by-Side Page 1 Organic Rankings (`organicResults`)**: Captures traditional Page 1 search rankings (`rank`, `title`, `url`, `domain`, `displayedUrl`, `snippet`) in the exact same pass so you can correlate classic SEO rank with AI Overview citation share.
- **โ People Also Ask (`peopleAlsoAsk`)**: Extracts related user follow-up questions surfaced on the SERP for content brief generation.
- **๐ 150+ Countries & City-Level Geo-Targeting (`country` + `location`)**: Audit national markets (`US`, `GB`, `DE`, `FR`, `CA`, `AU`, `IN`, `BR`, `JP`, `ES`, `IT`, `NL`, `SG`, `AE`, etc. โ including full European EEA support) or pinpoint exact cities (`"Austin, Texas, United States"`, `"Manchester, England, United Kingdom"`).
***
### ๐ When `hasAiOverview` Is `false` (Honest Upstream SERP Behavior)
Google does not generate an AI Overview on 100% of searches. In real-world SERPs, `hasAiOverview` is `false` (`aiOverviewState: "none"`) in three common scenarios:
1. **Pure Navigational or Operator Queries**: Brand login searches, exact domain lookups, or search operators such as `site:example.com` frequently bypass AI Overviews upstream.
2. **Commercial / YMYL Queries Without AI Trigger**: On certain transactional or localized queries, Google intentionally serves traditional organic listings only.
3. **SERP Recency Filters (`timeRange` != `"any"`)**: Applying publication-date filters (`hour`, `day`, `week`, `month`, `year`) restricts Google's organic index by recency and causes Google upstream to suppress AI Overviews on most queries. Keep `timeRange: "any"` whenever your primary goal is capturing AI Overviews.
**Why Every Query Still Delivers Full SERP Value**: Even when Google suppresses the AI Overview (`hasAiOverview: false`), this Actor still returns the query's **Page 1 `organicResults`**, **`peopleAlsoAsk`**, and **`brandCitationAudit`** (`citationStatus: "no_overview"` + your `organicTargetRanks`), giving your SEO/AEO reporting pipeline complete visibility into both AI-triggered and classic SERPs without blind spots.
***
### ๐ ๏ธ How to Use via API (Python, Node.js & cURL)
#### ๐ Python Example (AEO Brand Visibility & Competitor Citation Audit)
```bash
pip install apify-client
```
```python
from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_API_TOKEN")
run_input = {
"queries": [
"best crm for small business",
"compare hubspot vs pipedrive vs zoho for 10 person sales team",
"difference between postgresql and mysql",
],
"country": "US",
"targetDomains": ["hubspot.com", "pipedrive.com"],
"includeOrganicResults": True,
"includePeopleAlsoAsk": True,
"resolveUrls": True,
"maxQueries": 25,
}
run = client.actor("unitbytes/google-ai-overviews-scraper").call(run_input=run_input)
items = client.dataset(run["defaultDatasetId"]).list_items().items
for row in items:
audit = row.get("brandCitationAudit") or {}
print(
f"[{row['country']}] {row['query']} | AIO={row['hasAiOverview']} "
f"| Citations={row['citationsCount']} | Audit={audit.get('citationStatus')}"
)
```
***
#### ๐จ JavaScript / Node.js Example
```javascript
import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_APIFY_API_TOKEN' });
const run = await client.actor('unitbytes/google-ai-overviews-scraper').call({
queries: [
'best roofing contractors near me',
'roof replacement cost estimator',
],
country: 'US',
location: 'Austin, Texas, United States',
includeOrganicResults: true,
resolveUrls: true,
maxQueries: 10,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Processed ${items.length} localized SERP + AI Overview records`, items[0]);
```
***
#### ๐ cURL Example
```bash
curl -X POST "https://api.apify.com/v2/acts/unitbytes~google-ai-overviews-scraper/runs?token=YOUR_APIFY_API_TOKEN" \
-H "Content-Type: application/json" \
-d '{
"queries": ["how does a stocks and shares isa work in the uk"],
"country": "GB",
"targetDomains": ["gov.uk", "moneysavingexpert.com"],
"includeOrganicResults": true,
"resolveUrls": true,
"maxQueries": 5
}'
```
***
### ๐ค Example Output Record
```json
{
"query": "compare hubspot vs pipedrive vs zoho for 10 person sales team",
"country": "US",
"language": "en",
"location": null,
"timeRange": "any",
"hasAiOverview": true,
"aiOverviewState": "deferred",
"markdown": "Comparing **HubSpot**, **Pipedrive**, and **Zoho CRM** for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization.\n\n### Quick Comparison at a Glance\n\n| Feature | HubSpot Sales Hub | Pipedrive | Zoho CRM |\n| --- | --- | --- | --- |\n| Best For | All-in-one GTM & marketing alignment | Visual pipeline & outbound velocity | Budget-friendly customization |\n| Learning Curve | Low to Moderate | Very Low | Moderate |\n| Reporting | Advanced multi-touch attribution | Deal velocity & activity tracking | Custom BI modules & forecasting |",
"text": "Comparing HubSpot, Pipedrive, and Zoho CRM for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization...",
"textBlocks": [
{
"type": "paragraph",
"text": "Comparing HubSpot, Pipedrive, and Zoho CRM for a 10-person sales team depends on whether you prioritize ease of use, marketing automation depth, or cost-effective customization."
},
{
"type": "heading",
"level": 3,
"text": "Quick Comparison at a Glance"
},
{
"type": "table",
"headers": ["Feature", "HubSpot Sales Hub", "Pipedrive", "Zoho CRM"],
"rows": [
["Best For", "All-in-one GTM & marketing alignment", "Visual pipeline & outbound velocity", "Budget-friendly customization"]
]
}
],
"citations": [
{
"index": 1,
"title": "HubSpot vs. Pipedrive vs. Zoho CRM Comparison",
"url": "https://www.pcmag.com/picks/the-best-crm-software",
"domain": "pcmag.com",
"publisher": "PCMag",
"snippet": "Pipedrive focuses squarely on sales pipeline management, while HubSpot unifies marketing, sales, and service hubs.",
"faviconUrl": "https://encrypted-tbn0.gstatic.com/faviconV2?url=https://www.pcmag.com&sz=64"
}
],
"citationsCount": 1,
"brandCitationAudit": {
"targetDomains": ["hubspot.com", "pipedrive.com"],
"citationStatus": "competitor_cited",
"isCited": false,
"citedTargetUrls": [],
"citedTargetCount": 0,
"topCompetitorDomains": [
{ "domain": "pcmag.com", "citationsCount": 1 }
],
"organicTargetRanks": [
{
"rank": 2,
"domain": "hubspot.com",
"url": "https://www.hubspot.com/comparisons/pipedrive-vs-hubspot"
}
]
},
"organicResults": [
{
"rank": 1,
"title": "The Best CRM Software for Small Businesses",
"url": "https://www.pcmag.com/picks/the-best-crm-software",
"domain": "pcmag.com",
"displayedUrl": "https://www.pcmag.com โบ Business โบ CRM",
"snippet": "We tested the top CRM platforms for small and midsize sales teams..."
},
{
"rank": 2,
"title": "Pipedrive vs. HubSpot: Which CRM Fits Your Sales Team?",
"url": "https://www.hubspot.com/comparisons/pipedrive-vs-hubspot",
"domain": "hubspot.com",
"displayedUrl": "https://www.hubspot.com โบ comparisons",
"snippet": "Compare HubSpot Sales Hub and Pipedrive side by side across pipeline automation, reporting, and seat pricing."
}
],
"organicResultsCount": 2,
"peopleAlsoAsk": [
{
"question": "Is Pipedrive or HubSpot better for a 10-person team?",
"answer": "Pipedrive is often faster to onboard for pure outbound sales teams, whereas HubSpot scales better if marketing and sales share attribution.",
"title": "CRM Buyer Guide",
"url": "https://www.pcmag.com/picks/the-best-crm-software",
"domain": "pcmag.com"
}
],
"googleSearchUrl": "https://www.google.com/search?q=compare+hubspot+vs+pipedrive+vs+zoho+for+10+person+sales+team&gl=us&hl=en",
"scrapedAt": "2026-11-14T12:00:00Z"
}
```
#### Complete Output Fields Reference (`18` Root Fields)
| Field | Type | Description |
| :--- | :--- | :--- |
| `query` | `string` | Normalized Google Search query processed. |
| `country` | `string` | Uppercase 2-letter ISO 3166-1 country code (`"US"`, `"GB"`, `"DE"`, `"JP"`, etc.). |
| `language` | `string` | Effective interface language code used (`"en"`, `"de"`, `"fr"`, `"pt-BR"`, `"ja"`, etc.). |
| `location` | `string \| null` | Canonical city/region geo-targeting location string if supplied, otherwise `null`. |
| `timeRange` | `string` | Applied SERP recency filter (`"any"`, `"hour"`, `"day"`, `"week"`, `"month"`, `"year"`). |
| `hasAiOverview` | `boolean` | `true` when Google rendered an AI Overview on this SERP. |
| `aiOverviewState` | `string` | `"inline"` (rendered directly on initial SERP), `"deferred"` (expanded dynamically), `"none"`, or `"no_results"`. |
| `markdown` | `string` | Full AI Overview answer in clean GitHub-Flavored Markdown (headings, tables, lists, code, math). |
| `text` | `string` | Clean plain-text version of the AI Overview answer. |
| `textBlocks` | `object[]` | Structured block list (`paragraph`, `heading`, `list`, `table`, `code`) for deterministic RAG chunking. |
| `citations` | `object[]` | Unwrapped source citations (`index`, `title`, `url`, `domain`, `publisher`, `snippet`, `faviconUrl`). |
| `citationsCount` | `integer` | Total number of citations in `citations`. |
| `brandCitationAudit` | `object \| null` | AEO audit object (`targetDomains`, `citationStatus`, `isCited`, `citedTargetUrls`, `citedTargetCount`, `topCompetitorDomains`, `organicTargetRanks`) when `targetDomains` is set. |
| `organicResults` | `object[]` | Page 1 organic search results (`rank`, `title`, `url`, `domain`, `displayedUrl`, `snippet`). |
| `organicResultsCount` | `integer` | Count of Page 1 organic results extracted. |
| `peopleAlsoAsk` | `object[]` | Related People Also Ask entries (`question`, `answer`, `title`, `url`, `domain`). |
| `googleSearchUrl` | `string` | Direct Google Search URL for the query and market. |
| `scrapedAt` | `string` | UTC ISO 8601 extraction timestamp. |
***
### โ๏ธ Input Parameters Reference
| Parameter | Type | Default | Description |
| :--- | :--- | :--- | :--- |
| `queries` | `string[]` | `["best crm for small business", ...]` | Search keywords, questions, or direct Google Search URLs. Automatically deduplicated. |
| `startUrls` | `object[]` | `[]` | Optional Google Search URLs (`{"url": "https://www.google.com/search?q=..."}`). |
| `maxQueries` | `integer` | `25` | Maximum unique queries to process in this run (`1` โ `1000`). |
| `country` | `string` | `"US"` | 2-letter ISO 3166-1 country code (`US`, `GB`, `DE`, `FR`, `CA`, `AU`, `IN`, `BR`, `JP`, etc.). |
| `language` | `string` | `""` | Optional ISO/BCP-47 language override. Leave empty (`""`) to automatically use the natural language of `country`. |
| `location` | `string` | `""` | Optional city/state/region geo-targeting (e.g. `"Austin, Texas, United States"`). |
| `timeRange` | `string` | `"any"` | `"any"`, `"hour"`, `"day"`, `"week"`, `"month"`, or `"year"`. Note: non-`"any"` recency filters apply to organic SERPs and generally suppress AI Overviews upstream. |
| `targetDomains` | `string[]` | `[]` | Brand/client domains (e.g. `["hubspot.com"]`) to populate `brandCitationAudit`. |
| `includeOrganicResults` | `boolean` | `true` | Include Page 1 traditional organic search rankings. |
| `includePeopleAlsoAsk` | `boolean` | `true` | Include People Also Ask questions on the SERP. |
| `resolveUrls` | `boolean` | `true` | Unwrap Google redirect links into clean canonical external URLs. |
| `proxyConfiguration` | `object` | `null` | Optional custom proxy override (`proxyUrls`). Managed residential proxies are configured automatically on Cloud. |
***
#### ๐ Copy-and-Paste Directive for AI Coding Assistants (Cursor, Windsurf & Claude Code)
> *"Use the `unitbytes/google-ai-overviews-scraper` Actor on Apify to extract Google Search AI Overviews in clean Markdown, unwrapped source citations, Page 1 organic rankings, People Also Ask, and `brandCitationAudit` (`targetDomains`). Pair it with `unitbytes/google-ai-mode-scraper` for deep conversational Google AI Mode benchmarking. Example call: `client.actor('unitbytes/google-ai-overviews-scraper').call(run_input={'queries': ['best crm for small business'], 'country': 'US', 'targetDomains': ['hubspot.com'], 'maxQueries': 25})`"*
***
#### ๐ MCP Server Setup: Claude Code, Cursor & AI Agents
```json
{
"mcpServers": {
"apify": {
"type": "http",
"url": "https://mcp.apify.com/?tools=actors,docs,unitbytes/google-ai-overviews-scraper,unitbytes/google-ai-mode-scraper"
}
}
}
```
***
### โ๏ธ Compliance & Privacy
This Actor extracts **strictly publicly available search results and AI Overview summaries** displayed on Google Search. It never accesses private Google accounts, personal histories, or personally identifiable information (PII). Read Apify's guide on [the legality of web scraping](https://blog.apify.com/is-web-scraping-legal/) to ensure compliance with applicable regulations.
#### Disclaimer
This Actor is an independent software tool and is not affiliated with, endorsed by, or sponsored by Google LLC.
***
### ๐ฌ Support & Feedback
Building an AEO visibility dashboard, multi-market SEO tracker, or enterprise RAG pipeline?
- ๐ฌ **Apify Issues**: Open a ticket on the [Actor Issues Tab](https://apify.com/unitbytes/google-ai-overviews-scraper/issues)
- ๐ **Apify Store**: [Google AI Overviews Scraper](https://apify.com/unitbytes/google-ai-overviews-scraper)
# Actor input Schema
## `queries` (type: `array`):
List of Google Search keywords, questions, or comparison queries to extract AI Overviews, unwrapped source citations, Page 1 organic rankings, People Also Ask, and AEO brand audits for. Also accepts direct Google Search URLs.
## `startUrls` (type: `array`):
Optional list of direct Google Search URLs (e.g. 'https://www.google.com/search?q=best+crm+for+small+business\&gl=us'). Combined and deduplicated automatically with Search Queries.
## `maxQueries` (type: `integer`):
Maximum number of unique search queries to process in this run (1 to 1,000). Execution stops cleanly once this cap is reached.
## `country` (type: `string`):
Two-letter ISO 3166-1 country code for localized Google Search & AI Overviews across 150+ countries (e.g. 'US', 'GB', 'DE', 'FR', 'CA', 'AU', 'IN', 'BR', 'JP', 'ES', 'IT', 'NL', 'SG', 'AE'). Common aliases like 'USA' or 'UK' are normalized automatically; if left empty when using `startUrls` (e.g. `google.co.uk`), the country is auto-inferred from the URL.
## `language` (type: `string`):
Optional ISO / BCP-47 interface language override (e.g. 'en', 'de', 'fr', 'es', 'ja', 'pt-BR'). Recommended: leave empty ('') so Google Search automatically serves results and AI Overviews in the natural primary language of the selected country.
## `location` (type: `string`):
Optional canonical city, state, or regional location string for hyper-local AI Overviews and organic rankings (e.g. 'Austin, Texas, United States', 'London, England, United Kingdom', 'Toronto, Ontario, Canada').
## `timeRange` (type: `string`):
Server-side Google Search recency filter. Note: Keep set to 'any' when capturing AI Overviews โ applying recency filters ('hour', 'day', 'week', 'month', 'year') restricts Page 1 organic SERP results by publication date and typically causes Google upstream to suppress AI Overviews (`hasAiOverview: false`) on most queries.
## `targetDomains` (type: `array`):
Optional list of your brand or client root domains (e.g. \['hubspot.com', 'pipedrive.com']) to compute `brandCitationAudit`: classifies each query as 'cited', 'competitor_cited', 'overview_no_citations', or 'no_overview', lists exact `citedTargetUrls` and `topCompetitorDomains`, and cross-references your Page 1 `organicTargetRanks` in a single pass.
## `includeOrganicResults` (type: `boolean`):
Include structured Page 1 organic search results (`rank`, `title`, `url`, `domain`, `displayedUrl`, `snippet`) alongside the AI Overview for side-by-side SEO vs. AEO correlation.
## `includePeopleAlsoAsk` (type: `boolean`):
Include related 'People Also Ask' questions and answers surfaced on the Google SERP.
## `resolveUrls` (type: `boolean`):
Unwraps Google redirect wrappers into clean, direct canonical external destination URLs across AI Overview citations and top Page 1 organic results.
## `proxyConfiguration` (type: `object`):
Managed residential proxies are automatically configured by default on Apify Cloud. Optionally supply custom HTTP/SOCKS5 `proxyUrls` if you prefer to route requests through your own proxy gateway.
## Actor input object example
```json
{
"queries": [
"best crm for small business",
"difference between postgresql and mysql"
],
"maxQueries": 25,
"country": "US",
"language": "",
"location": "",
"timeRange": "any",
"targetDomains": [],
"includeOrganicResults": true,
"includePeopleAlsoAsk": true,
"resolveUrls": true
}
```
# Actor output Schema
## `results` (type: `string`):
Extracted Google Search AI Overviews in clean GitHub-Flavored Markdown, structured textBlocks, unwrapped canonical source citations, AEO brand citation audits, Page 1 organic rankings, and People Also Ask
## `aeoAuditView` (type: `string`):
Focused table view comparing AI Overview citation status, cited count, and Page 1 organic rankings
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"queries": [
"best crm for small business",
"difference between postgresql and mysql"
],
"maxQueries": 25,
"country": "US",
"language": "",
"location": ""
};
// Run the Actor and wait for it to finish
const run = await client.actor("unitbytes/google-ai-overviews-scraper").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`๐พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// ๐ Want to learn more ๐? Go to โ https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"queries": [
"best crm for small business",
"difference between postgresql and mysql",
],
"maxQueries": 25,
"country": "US",
"language": "",
"location": "",
}
# Run the Actor and wait for it to finish
run = client.actor("unitbytes/google-ai-overviews-scraper").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print(f"๐พ Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
print(item)
# ๐ Want to learn more ๐? Go to โ https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"queries": [
"best crm for small business",
"difference between postgresql and mysql"
],
"maxQueries": 25,
"country": "US",
"language": "",
"location": ""
}' |
apify call unitbytes/google-ai-overviews-scraper --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"type": "http",
"url": "https://mcp.apify.com/?tools=fetch-actor-details,unitbytes/google-ai-overviews-scraper"
}
}
}
```
The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).
## OpenAPI specification
Download the OpenAPI definition: https://api.apify.com/v2/actors/6sggH4iNEorC1q1Sj/builds/DGYhzIgAbqsbh1nPD/openapi.json