# Google AI Overview Scraper (`actor4you/google-ai-overview-scraper`) Actor Scrape Google AI Overview results for your search queries. Returns AI-generated overviews with cited sources. - **URL**: https://apify.com/actor4you/google-ai-overview-scraper.md - **Developed by:** [Actor4you](https://apify.com/actor4you) (community) - **Categories:** AI, SEO tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### What does Google AI Overview Scraper do? **Google AI Overview Scraper** extracts **Google AI Overview results** (formerly known as Search Generative Experience / SGE) from Google Search. Feed it your queries and get back structured data containing the **AI overview content**, its type, all **cited sources**, and metadata - everything you need for SEO tracking and SERP monitoring. Google AI Overviews are the AI-generated summaries that appear at the top of search results for an increasing number of queries. This Actor gives you a simple, scalable way to capture that data: enter your queries, click Start, and receive clean JSON output. No proxy management, no parsing headaches. ### What can Google AI Overview Scraper do? - **Extract AI overview content** - Capture the full text of Google's AI-generated overview for each search query - **Identify overview types** - Distinguish between different AI overview formats (paragraph, list, table, etc.) - **Collect all cited sources** - Get every source URL and title referenced in the AI overview - **Target any country and language** - Configure country domains, search language, and interface language for localized SERP monitoring - **Desktop and mobile results** - Choose between desktop (default) and mobile rendering to see how AI overviews differ across devices - **Full Apify platform access** - REST API, scheduling, webhooks, Zapier/Make integrations, automatic proxy rotation, and cloud storage included - **Bulk query processing** - Submit hundreds or thousands of queries per run for large-scale SEO audits ### What data can you extract? | Field | Type | Description | |-------|------|-------------| | `query` | String | The search query you submitted | | `type` | String | The format/type of the AI overview (e.g., paragraph, list) | | `content` | String | The full AI overview text generated by Google | | `sources` | Array | Cited sources, each containing `title` and `url` | | `sourcesCount` | Number | Total number of sources cited in the overview | ### How to scrape Google AI Overview results 1. **Open the Actor** - Find [Google AI Overview Scraper](https://apify.com/actor4you/google-ai-overview-scraper) on Apify Store and click **Try for free** to open the Actor console. 2. **Add your queries** - In the **Queries** field, enter the search terms you want to track, one per line. For SEO monitoring, use queries that are important to your brand - e.g., `best CRM software`, `your brand name review`, `alternatives to [competitor]`. 3. **Set your target market** - Select the **country code** for the Google domain you want to query (US, UK, DE, FR, etc.) and set the **search language** and **interface language** to match your audience. 4. **Choose device type** - Leave **Mobile results** as `false` (default) for desktop AI overviews, or enable it to see the mobile version. AI overviews can differ between devices. 5. **Run the scraper** - Click **Start**. The Actor processes each query and collects AI overview data. A batch of 100 queries typically finishes in a few minutes. 6. **Download or connect your data** - View results in the **Dataset** tab. Export as JSON, CSV, or Excel. For ongoing monitoring, set up a schedule and connect the output to Google Sheets, Looker Studio, or your SEO dashboard via the API. ### How much does it cost to scrape Google AI Overviews? Every Apify account includes **$5 in free monthly credits**, which is enough to run hundreds of queries and evaluate whether the Actor fits your workflow. The Actor uses **compute units** proportional to run duration and memory. Scraping 100 queries typically costs between $0.10 and $0.50. You can see exact compute unit consumption after each run in your Apify dashboard. For enterprise-scale SERP monitoring (thousands of queries daily), the Apify platform handles scaling, retries, and proxy rotation automatically - no servers to manage on your side. ### Input parameters | Parameter | Description | |-----------|-------------| | **Queries** | Search queries to check for AI overviews, one per line. | | **Mobile results** | Toggle mobile rendering (default: `false`). | | **Country code** | Target a specific Google country domain (e.g., `us`, `gb`, `in`). | | **Search language** | Filter search results by language (default: `en`). | | **Language code** | Set the Google interface language (default: `en`). | See the **Input** tab on the Actor page for the complete configuration reference. ### Output example ```json { "query": "what is a CRM system", "type": "paragraph", "content": "A CRM (Customer Relationship Management) system is software that helps businesses manage interactions with current and potential customers. It centralizes customer data - contact information, purchase history, support tickets, and communication logs - into a single platform.\n\nModern CRM systems like Salesforce, HubSpot, and Zoho go beyond simple contact management. They include sales pipeline tracking, marketing automation, customer service tools, and analytics dashboards. Small businesses often start with free CRM tiers and scale up as their needs grow.\n\nKey benefits of using a CRM include improved customer retention, more efficient sales processes, better team collaboration, and data-driven decision making.", "sources": [ { "title": "What is CRM? - Salesforce", "url": "https://www.salesforce.com/crm/what-is-crm/" }, { "title": "The Ultimate Guide to CRM - HubSpot", "url": "https://www.hubspot.com/products/crm" }, { "title": "CRM Software Reviews - G2", "url": "https://www.g2.com/categories/crm" }, { "title": "CRM Definition - Gartner", "url": "https://www.gartner.com/en/information-technology/glossary/crm" } ], "sourcesCount": 4 } ```` ### Other AI search scrapers on Apify Track your brand's presence across every major AI-powered search experience: - **[Google AI Mode Scraper](https://apify.com/actor4you/google-ai-mode-scraper)** - Extract results from Google's newer AI Mode, the conversational search experience that produces longer, more detailed AI answers. Pair it with this Actor to cover both AI search formats on Google. - **[ChatGPT Search Scraper](https://apify.com/actor4you/chatgpt-scraper)** - Capture how ChatGPT answers search queries about your brand, products, or industry. Monitor your visibility in OpenAI's search-integrated assistant. - **[Perplexity Scraper](https://apify.com/actor4you/perplexity-scraper)** - Extract answers and source citations from Perplexity AI. Essential for understanding your brand's footprint in the fastest-growing AI answer engine. Combine all four scrapers for a complete **AI search monitoring** stack. Understand exactly how every leading AI engine talks about your brand, which sources they cite, and how their answers change over time. ### Frequently asked questions #### Is it legal to scrape Google AI Overviews? Scraping publicly available information from search engines is generally considered legal in most jurisdictions. Google AI Overviews are shown to every user who performs a search - this Actor simply captures that same public data in a structured format. Always ensure your use case complies with applicable laws and terms of service in your region. #### Is there a Google AI Overview API? Google does not provide a dedicated **Google AI Overview API** for programmatic access to AI-generated search summaries. This Actor serves as an effective alternative - it provides a **REST API** through the Apify platform that returns structured AI overview data for any query. Authenticate with your Apify API token and integrate it into any application, script, or data pipeline. #### How can I use this for SEO monitoring and brand tracking? Google AI Overview Scraper is built for ongoing **SERP monitoring** workflows. Schedule it to run daily or weekly with your target keywords and brand queries. Track which queries trigger AI overviews, whether your site is cited as a source, how the overview content describes your brand, and how these factors change over time. Export data to Google Sheets or your BI tool for trend analysis. This is especially valuable because AI overviews can reduce click-through rates on traditional organic results - knowing when and how they appear for your keywords is critical for modern SEO strategy. #### Can I monitor Google SGE results with this Actor? Yes. Google AI Overviews were previously known as **Search Generative Experience (SGE)** results during their experimental phase. This Actor captures the same feature under its current production name. Whether you've been tracking SGE or are starting fresh with AI overview monitoring, this Actor covers it. # Actor input Schema ## `queries` (type: `string`): One or more search queries, each on a new line. ## `mobileResults` (type: `boolean`): Whether to fetch mobile search results. ## `countryCode` (type: `string`): Country for the Google Search domain (e.g. 'us' for google.com, 'gb' for google.co.uk). Defaults to United States. ## `searchLanguage` (type: `string`): Restricts search results to pages in a specific language. ## `languageCode` (type: `string`): Language of the Google Search interface (menus, buttons). May also affect search results. ## Actor input object example ```json { "queries": "What are the top 5 CRM tools", "mobileResults": false, "searchLanguage": "en", "languageCode": "en" } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "queries": "What are the top 5 CRM tools" }; // Run the Actor and wait for it to finish const run = await client.actor("actor4you/google-ai-overview-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "queries": "What are the top 5 CRM tools" } # Run the Actor and wait for it to finish run = client.actor("actor4you/google-ai-overview-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "queries": "What are the top 5 CRM tools" }' | apify call actor4you/google-ai-overview-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=actor4you/google-ai-overview-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Google AI Overview Scraper", "description": "Scrape Google AI Overview results for your search queries. Returns AI-generated overviews with cited sources.", "version": "0.0", "x-build-id": "XMKF0gFGMb3jPvSTW" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/actor4you~google-ai-overview-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-actor4you-google-ai-overview-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/actor4you~google-ai-overview-scraper/runs": { "post": { "operationId": "runs-sync-actor4you-google-ai-overview-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/actor4you~google-ai-overview-scraper/run-sync": { "post": { "operationId": "run-sync-actor4you-google-ai-overview-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "queries" ], "properties": { "queries": { "title": "Search Queries", "type": "string", "description": "One or more search queries, each on a new line." }, "mobileResults": { "title": "Mobile Results", "type": "boolean", "description": "Whether to fetch mobile search results.", "default": false }, "countryCode": { "title": "Country", "enum": [ "us", "gb", "ca", "au", "de", "fr", "es", "it", "nl", "pl", "br", "mx", "ar", "in", "jp", "kr", "cn", "af", "al", "dz", "as", "ad", "ao", "ai", "aq", "ag", "am", "aw", "at", "az", "bs", "bh", "bd", "bb", "by", "be", "bz", "bj", "bm", "bt", "bo", "ba", "bw", "bv", "io", "bn", "bg", "bf", "bi", "kh", "cm", "cv", "ky", "cf", "td", "cl", "cx", "cc", "co", "km", "cg", "cd", "ck", "cr", "ci", "hr", "cu", "cy", "cz", "dk", "dj", "dm", "do", "ec", "eg", "sv", "gq", "er", "ee", "et", "fk", "fo", "fj", "fi", "gf", "pf", "tf", "ga", "gm", "ge", "gh", "gi", "gr", "gl", "gd", "gp", "gu", "gt", "gn", "gw", "gy", "ht", "hm", "va", "hn", "hk", "hu", "is", "id", "ir", "iq", "ie", "il", "jm", "jo", "kz", "ke", "ki", "kp", "kw", "kg", "la", "lv", "lb", "ls", "lr", "ly", "li", "lt", "lu", "mo", "mk", "mg", "mw", "my", "mv", "ml", "mt", "mh", "mq", "mr", "mu", "yt", "fm", "md", "mc", "mn", "me", "ms", "ma", "mz", "mm", "na", "nr", "np", "an", "nc", "nz", "ni", "ne", "ng", "nu", "nf", "mp", "no", "om", "pk", "pw", "ps", "pa", "pg", "py", "pe", "ph", "pn", "pt", "pr", "qa", "re", "ro", "ru", "rw", "sh", "kn", "lc", "pm", "vc", "ws", "sm", "st", "sa", "sn", "rs", "sc", "sl", "sg", "sk", "si", "sb", "so", "za", "gs", "lk", "sd", "sr", "sj", "sz", "se", "ch", "sy", "tw", "tj", "tz", "th", "tl", "tg", "tk", "to", "tt", "tn", "tr", "tm", "tc", "tv", "ug", "ua", "ae", "um", "uy", "uz", "vu", "ve", "vn", "vg", "vi", "wf", "eh", "ye", "zm", "zw" ], "type": "string", "description": "Country for the Google Search domain (e.g. 'us' for google.com, 'gb' for google.co.uk). Defaults to United States." }, "searchLanguage": { "title": "Search Language", "enum": [ "en", "de", "es", "fr", "it", "pt", "nl", "pl", "ru", "ja", "ko", "ar", "bg", "ca", "cs", "da", "el", "et", "fi", "hr", "hu", "id", "is", "iw", "lt", "lv", "no", "ro", "sk", "sl", "sr", "sv", "th", "tr", "zh-CN", "zh-TW" ], "type": "string", "description": "Restricts search results to pages in a specific language.", "default": "en" }, "languageCode": { "title": "Interface Language", "enum": [ "en", "de", "es", "fr", "it", "pt-BR", "pt-PT", "nl", "pl", "ru", "ja", "ko", "ar", "af", "sq", "sm", "az", "eu", "be", "bn", "bh", "bs", "bg", "ca", "zh-CN", "zh-TW", "hr", "cs", "da", "eo", "et", "fo", "fi", "fy", "gl", "ka", "el", "gu", "iw", "hi", "hu", "is", "id", "ia", "ga", "jw", "kn", "la", "lv", "lt", "mk", "ms", "ml", "mt", "mr", "ne", "no", "nn", "oc", "fa", "pa", "ro", "gd", "sr", "si", "sk", "sl", "su", "sw", "sv", "tl", "ta", "te", "th", "ti", "tr", "uk", "ur", "uz", "vi", "cy", "xh", "zu" ], "type": "string", "description": "Language of the Google Search interface (menus, buttons). May also affect search results.", "default": "en" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```