# Google Search Results Scraper (`thirdwatch/google-search-scraper`) Actor Scrape Google Search results for any query. Get titles, URLs, snippets, and site links. Supports web, news, images, videos, and shopping. Filter by country, language, and time range. Stealth browser bypasses Google anti-bot detection. - **URL**: https://apify.com/thirdwatch/google-search-scraper.md - **Developed by:** [Thirdwatch](https://apify.com/thirdwatch) (community) - **Categories:** SEO tools, News, Lead generation - **Stats:** 1 total users, 0 monthly users, 0.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $5.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Google Search Results Scraper > Scrape Google Search results for any query. Get titles, URLs, snippets, and site links across web, news, images, videos, and shopping. ### What you get Extract structured search results from Google for any query. Supports all search types (web, news, images, videos, shopping), time filters, and localization by country and language. Perfect for SEO research, market analysis, and content monitoring. ### Output fields | Field | Description | |-------|-------------| | `position` | Rank on the search results page | | `title` | Result title | | `url` | Destination URL | | `displayUrl` | Breadcrumb-style URL shown in Google results | | `description` | Snippet/description text | | `query` | The search query that produced this result | | `searchType` | Type of search (web, news, etc.) | | `page` | Which page of results this came from | | `siteLinks` | Sub-links if present (title + url) | | `timestamp` | ISO 8601 timestamp | ### Example output ```json { "position": 1, "title": "Kubernetes vs Docker: What you need to know in 2026", "url": "https://northflank.com/blog/kubernetes-vs-docker", "displayUrl": "https://northflank.com > blog > kubernetes-vs-docker", "description": "Kubernetes is incredibly powerful but also more complex than Docker alone.", "query": "kubernetes vs docker comparison", "searchType": "web", "page": 1, "siteLinks": [] } ```` ### Input parameters | Parameter | Required | Description | |-----------|----------|-------------| | `queries` | Yes | Search terms to look up | | `maxResults` | No | Max total results across all queries (default: 100) | | `maxResultsPerQuery` | No | Max results per query (default: 50) | | `countryCode` | No | Country for localized results -- us, uk, in, de, fr, etc. (default: us) | | `languageCode` | No | Language code -- en, es, fr, de, hi, etc. (default: en) | | `searchType` | No | Search type: web, news, images, videos, shopping (default: web) | | `timeFilter` | No | Time filter: any, pastHour, pastDay, pastWeek, pastMonth, pastYear | ### Use cases - **SEO professionals**: Track keyword rankings and competitor positions - **Market researchers**: Analyze search results for industry trends - **Content creators**: Find trending topics and content gaps - **Brand monitoring**: Track brand mentions across Google results - **Academic research**: Study search result patterns and biases ### Pricing Pay-per-result pricing at $0.008 per result. | Results | Cost | |---------|------| | 10 | $0.08 | | 100 | $0.80 | | 1,000 | $8.00 | ### Tips - **Start small** -- test with `maxResults: 5` to verify results before scaling up - **Use time filters** -- for trending topics, `pastWeek` gives fresher results - **Country matters** -- the same query returns different results for "us" vs "in" vs "uk" ### Limitations - Google rate limits search requests -- large runs may take longer - Some queries may encounter CAPTCHA challenges (automatically retried) - Results depend on Google's ranking algorithms and may vary by region # Actor input Schema ## `queries` (type: `array`): List of search terms to look up on Google. Each query will return up to maxResultsPerQuery results. ## `maxResults` (type: `integer`): Maximum total number of results across all queries. Set to 0 for unlimited. ## `maxResultsPerQuery` (type: `integer`): Maximum number of results to return per query. ## `countryCode` (type: `string`): Country code for localized results (e.g. 'us', 'uk', 'in', 'de', 'fr'). ## `languageCode` (type: `string`): Language code for results (e.g. 'en', 'es', 'fr', 'de', 'hi'). ## `searchType` (type: `string`): Type of Google search to perform. ## `timeFilter` (type: `string`): Filter results by recency. ## Actor input object example ```json { "queries": [ "web scraping tools" ], "maxResults": 100, "maxResultsPerQuery": 50, "countryCode": "us", "languageCode": "en", "searchType": "web", "timeFilter": "any" } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "queries": [ "web scraping tools" ], "maxResults": 100, "maxResultsPerQuery": 50, "countryCode": "us", "languageCode": "en", "searchType": "web", "timeFilter": "any" }; // Run the Actor and wait for it to finish const run = await client.actor("thirdwatch/google-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "queries": ["web scraping tools"], "maxResults": 100, "maxResultsPerQuery": 50, "countryCode": "us", "languageCode": "en", "searchType": "web", "timeFilter": "any", } # Run the Actor and wait for it to finish run = client.actor("thirdwatch/google-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "queries": [ "web scraping tools" ], "maxResults": 100, "maxResultsPerQuery": 50, "countryCode": "us", "languageCode": "en", "searchType": "web", "timeFilter": "any" }' | apify call thirdwatch/google-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=thirdwatch/google-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Google Search Results Scraper", "description": "Scrape Google Search results for any query. Get titles, URLs, snippets, and site links. Supports web, news, images, videos, and shopping. Filter by country, language, and time range. Stealth browser bypasses Google anti-bot detection.", "version": "1.0", "x-build-id": "YAOEEJwpkF6eTiQjD" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/thirdwatch~google-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-thirdwatch-google-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/thirdwatch~google-search-scraper/runs": { "post": { "operationId": "runs-sync-thirdwatch-google-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/thirdwatch~google-search-scraper/run-sync": { "post": { "operationId": "run-sync-thirdwatch-google-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "queries" ], "properties": { "queries": { "title": "Search Queries", "type": "array", "description": "List of search terms to look up on Google. Each query will return up to maxResultsPerQuery results.", "default": [], "items": { "type": "string" } }, "maxResults": { "title": "Max Total Results", "minimum": 0, "maximum": 10000, "type": "integer", "description": "Maximum total number of results across all queries. Set to 0 for unlimited.", "default": 100 }, "maxResultsPerQuery": { "title": "Max Results Per Query", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of results to return per query.", "default": 50 }, "countryCode": { "title": "Country Code", "type": "string", "description": "Country code for localized results (e.g. 'us', 'uk', 'in', 'de', 'fr').", "default": "us" }, "languageCode": { "title": "Language Code", "type": "string", "description": "Language code for results (e.g. 'en', 'es', 'fr', 'de', 'hi').", "default": "en" }, "searchType": { "title": "Search Type", "enum": [ "web", "news", "images", "videos", "shopping" ], "type": "string", "description": "Type of Google search to perform.", "default": "web" }, "timeFilter": { "title": "Time Filter", "enum": [ "any", "pastHour", "pastDay", "pastWeek", "pastMonth", "pastYear" ], "type": "string", "description": "Filter results by recency.", "default": "any" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```