# 🔥 Google Search Scraper (`powerai/google-search-scraper`) Actor Scrape Google SERPs for any query. Get organic results, related searches, People Also Ask, and optional AI Overviews in clean JSON. - **URL**: https://apify.com/powerai/google-search-scraper.md - **Developed by:** [PowerAI](https://apify.com/powerai) (community) - **Categories:** SEO tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 1 bookmarks - **User rating**: No ratings yet ## Pricing from $9.99 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## 🔥 Google Search Scraper Scrape Google Search Engine Results Pages (SERPs). Add one or more queries and extract organic results, related searches, People Also Ask, and optional AI Overviews in clean JSON. ### ✨ Key Features - 🔍 Scrape **organic results** with title, link, snippet, and rank - ❓ Extract **People Also Ask** and **related searches** - 🤖 Optional **Google AI Overview** capture - 🌍 Set **country** and **interface language** - 📱 Optional **mobile** SERP results - 📋 Structured JSON output, streamed while the run is in progress ### 💪 Why Choose This Actor? - **Focused**: Built for Google SERP extraction - **Flexible**: Multiple queries, country/language, site filters - **Efficient**: Results are pushed continuously while the job runs - **Structured**: Renamed, integration-friendly field names - **Reliable**: Stable public SERP extraction ### 🎯 Perfect For - 📊 SEO rank tracking and SERP monitoring - 🏢 Competitor and market research - 🔔 Brand mention and AI Overview monitoring - 🤖 LLM / RAG pipelines that need clean search snippets ### 📝 Input Requirements - `searchTerms` (required): One or more search queries or Google Search URLs - `maxPages` (optional): Max SERP pages per query. Default: `1` - `country` (optional): Country code, e.g. `us`, `uk`, `de`. Default: `us` - `language` (optional): UI language code, e.g. `en`, `zh-CN`. Default: `en` - `locationCode` (optional): Google UULE location code - `siteFilter` (optional): Limit to a domain, e.g. `example.com` - `mobile` (optional): Mobile SERP. Default: `false` - `includeUnfiltered` (optional): Include filtered-out results. Default: `false` - `captureAiOverview` (optional): Full AI Overview extraction. Default: `false` - `saveHtmlSnapshot` (optional): Save HTML snapshot URL. Default: `false` - `saveHtml` (optional): Embed HTML in dataset items. Default: `false` #### Input Example ```json { "searchTerms": [ "What are the top 5 CRM tools" ], "maxPages": 1, "country": "us", "language": "en" } ```` #### Output Example ```json { "query": { "term": "best CRM tools", "page": 1, "country": "US", "language": "en", "domain": "google.com" }, "serpUrl": "http://www.google.com/search?q=best+CRM+tools&hl=en", "hasMore": true, "organic": [ { "rank": 1, "title": "Best CRM Software of 2026", "link": "https://www.example.com/best-crm", "displayLink": "www.example.com › best-crm", "snippet": "Compare the top CRM platforms..." } ], "relatedSearches": [ { "text": "best free CRM", "link": "https://www.google.com/search?q=best+free+CRM" } ], "alsoAsked": [ { "question": "What is the most popular CRM?", "answer": "..." } ], "scrapedAt": "2026-07-21T04:00:00.000Z" } ``` ### 🚀 How to Use 1. Add one or more queries to `searchTerms` 2. Optionally set `maxPages`, `country`, `language`, and `captureAiOverview` 3. Click **Start** and download results as JSON, CSV, Excel, or HTML ### 📌 Notes - Free users of this actor have run and page-size limits; upgrade for unlimited usage # Actor input Schema ## `searchTerms` (type: `array`): One or more Google search queries (or full Google Search URLs). Each item is scraped separately. Supports operators like site:example.com or javascript OR python. ## `maxPages` (type: `integer`): Maximum SERP pages to scrape per search term. Each page has about 10 organic results. ## `country` (type: `string`): Google country / domain code (e.g. us, uk, de, jp). Default is United States. ## `language` (type: `string`): Google UI language code (hl), e.g. en, zh-CN, de, ja. ## `locationCode` (type: `string`): Optional Google UULE location code for local search emulation. ## `siteFilter` (type: `string`): Limit results to a domain, e.g. example.com (applied as site:example.com). ## `mobile` (type: `boolean`): Return mobile Google SERP results instead of desktop. ## `includeUnfiltered` (type: `boolean`): Include lower-quality results that Google normally filters out. ## `captureAiOverview` (type: `boolean`): Enable full AI Overview extraction when Google shows one. May take slightly longer. ## `saveHtmlSnapshot` (type: `boolean`): Store SERP HTML in key-value store and return a snapshot URL. Useful for debugging; may slow the run. ## `saveHtml` (type: `boolean`): Include raw HTML on each dataset item. Makes the dataset much larger. ## Actor input object example ```json { "searchTerms": [ "What are the top 5 CRM tools" ], "maxPages": 1, "country": "us", "language": "en", "mobile": false, "includeUnfiltered": false, "captureAiOverview": false, "saveHtmlSnapshot": false, "saveHtml": false } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchTerms": [ "What are the top 5 CRM tools" ], "maxPages": 1, "country": "us", "language": "en", "mobile": false, "includeUnfiltered": false, "captureAiOverview": false, "saveHtmlSnapshot": false, "saveHtml": false }; // Run the Actor and wait for it to finish const run = await client.actor("powerai/google-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchTerms": ["What are the top 5 CRM tools"], "maxPages": 1, "country": "us", "language": "en", "mobile": False, "includeUnfiltered": False, "captureAiOverview": False, "saveHtmlSnapshot": False, "saveHtml": False, } # Run the Actor and wait for it to finish run = client.actor("powerai/google-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchTerms": [ "What are the top 5 CRM tools" ], "maxPages": 1, "country": "us", "language": "en", "mobile": false, "includeUnfiltered": false, "captureAiOverview": false, "saveHtmlSnapshot": false, "saveHtml": false }' | apify call powerai/google-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=powerai/google-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "🔥 Google Search Scraper", "description": "Scrape Google SERPs for any query. Get organic results, related searches, People Also Ask, and optional AI Overviews in clean JSON.", "version": "0.0", "x-build-id": "TV03Y4OGdUOCF1Kxw" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/powerai~google-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-powerai-google-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/powerai~google-search-scraper/runs": { "post": { "operationId": "runs-sync-powerai-google-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/powerai~google-search-scraper/run-sync": { "post": { "operationId": "run-sync-powerai-google-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchTerms" ], "properties": { "searchTerms": { "title": "Search terms", "type": "array", "description": "One or more Google search queries (or full Google Search URLs). Each item is scraped separately. Supports operators like site:example.com or javascript OR python.", "items": { "type": "string" } }, "maxPages": { "title": "Max pages per search", "minimum": 1, "type": "integer", "description": "Maximum SERP pages to scrape per search term. Each page has about 10 organic results.", "default": 1 }, "country": { "title": "Country", "type": "string", "description": "Google country / domain code (e.g. us, uk, de, jp). Default is United States.", "default": "us" }, "language": { "title": "Interface language", "type": "string", "description": "Google UI language code (hl), e.g. en, zh-CN, de, ja.", "default": "en" }, "locationCode": { "title": "Exact location (UULE)", "type": "string", "description": "Optional Google UULE location code for local search emulation." }, "siteFilter": { "title": "Site filter", "type": "string", "description": "Limit results to a domain, e.g. example.com (applied as site:example.com)." }, "mobile": { "title": "Mobile results", "type": "boolean", "description": "Return mobile Google SERP results instead of desktop.", "default": false }, "includeUnfiltered": { "title": "Include unfiltered results", "type": "boolean", "description": "Include lower-quality results that Google normally filters out.", "default": false }, "captureAiOverview": { "title": "Capture Google AI Overview", "type": "boolean", "description": "Enable full AI Overview extraction when Google shows one. May take slightly longer.", "default": false }, "saveHtmlSnapshot": { "title": "Save HTML snapshot", "type": "boolean", "description": "Store SERP HTML in key-value store and return a snapshot URL. Useful for debugging; may slow the run.", "default": false }, "saveHtml": { "title": "Save HTML in dataset", "type": "boolean", "description": "Include raw HTML on each dataset item. Makes the dataset much larger.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```