# Google Search Scraper - Most Comprehensive (`kaix/google-serp-scraper`) Actor πŸ”₯ ~$1/1K pages πŸ”₯ Scrape Google into 40+ structured sections: organic results, knowledge panel with cast/ratings/streaming prices, finance with earnings, shopping with filters, AI overview, PAA with answers, perspectives, video key moments, hotels, local pack, flights, lyrics, sports, ads. - **URL**: https://apify.com/kaix/google-serp-scraper.md - **Developed by:** [Kai](https://apify.com/kaix) (community) - **Categories:** Lead generation, SEO tools, E-commerce - **Stats:** 4 total users, 3 monthly users, 94.2% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $0.90 / 1,000 pages This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Google SERP Scraper Scrape Google search results into structured JSON. Returns a complete `SerpPage` per page with 60+ sections β€” the deepest extraction available at $1/1K pages. ### Why use this over SerpAPI, DataForSEO, or Serper? | | This actor | SerpAPI | DataForSEO | Serper | ScraperLink (Apify) | |--|:-:|:-:|:-:|:-:|:-:| | SERP features | ~60 | ~45 | ~48 | ~12 | ~6 | | Cost per 1K pages | ~$1 | $5–15 | $0.60–2 | $0.30–1 | $0.50 | | Latency | ~3s/page | ~2.5s | 6s–5min | 1.8s | ~2s | - 60+ SERP sections: organic, knowledge panel, AI overview, finance (OHLC + earnings + company info), shopping, hotels, flights (status + calendar + listings), sports (standings + leaderboards + athlete stats), weather (hourly + 7-day), lyrics, dictionary, translation, currency, recipes, forums, perspectives, local pack with GPS, and 40+ more - $1/1K pages β€” 5–15x cheaper than SerpAPI with comparable depth - Features no competitor extracts: film showtimes, popular destinations, nutrition widget, award ceremonies, movie recommendations, local filters, flights price calendar, interactive widget detection - Where SerpAPI wins: $2M legal shield, 99.95% SLA - Where DataForSEO wins: cheapest at scale ($0.60/1K queue), e-commerce features (explore brands, courses, podcasts), integrated SEO metrics, historical data - Full i18n across 12+ languages without hardcoded English text - Real structured data: ratings as numbers, coordinates as floats, prices parsed, entities with KG MIDs ### Use cases - Monitor SERP features for SEO. Track which sections appear for your keywords - Feed structured SERP data into competitive intelligence pipelines - Build price comparison databases from shopping results across regions - Track finance data (stock prices, earnings, related markets) as they appear on Google - Aggregate People Also Ask questions with answers for content research - Monitor local pack rankings and reviews for local SEO ### How to use #### Basic search ```json { "query": "instant pot" } ```` #### Scrape multiple pages ```json { "query": "best laptop 2025", "maxNumberOfPages": 5 } ``` #### Geo-targeted search (search as if from Japan, in Japanese) ```json { "query": "ラーパン レシピ", "gl": "jp", "hl": "ja" } ``` #### Sort by date ```json { "query": "climate change policy", "sort": "date" } ``` ### Input | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | query | string | required | Google search query. Supports operators: `"exact phrase"`, `-exclude`, `site:example.com` | | maxNumberOfPages | integer | 1 | Number of SERP pages to scrape. Each page has ~10 organic results plus all other sections. Set to 0 for unlimited. | | gl | string | us | Country code for geo-targeting (`us`, `jp`, `de`, `kr`, `vn`) | | hl | string | en | Interface language (`en`, `ja`, `de`, `ko`, `vi`) | | sort | string | - | Sort expression (e.g., `date` for newest first) | ### Output Each page is one item in the dataset β€” a full `SerpPage` object. #### Organic results ```json { "position": 1, "url": "https://instantpot.com/", "title": "Shop Instant Pot & Instant Appliances | Official Website", "description": "Instant Pot is a well-known brand providing kitchen appliances. Find pressure cookers, air fryers, slow cookers and more.", "siteName": "Instant Pot", "richSnippet": { "extensions": ["Free shipping", "30-day returns"], "rating": 4.5, "reviewCount": "2.1K" } } ``` #### Knowledge Panel (film/TV example) ```json { "name": "Avengers: Endgame", "label": "PG-13 2019 Β· Action/Sci-fi Β· 3h 1m", "kgMid": "/m/0126b8kv", "entityType": "FILM", "cast": ["Robert Downey Jr.", "Scarlett Johansson", "Chris Evans"], "director": "Anthony Russo, Joe Russo", "budget": "356 million USD (2019)", "runningTime": "3h 1m", "releaseDate": "April 26, 2019 (USA)", "googleUsersRating": "92%", "ratings": [ {"source": "IMDb", "score": "8.4/10", "url": "https://www.imdb.com/title/tt4154796/"}, {"source": "Rotten Tomatoes", "score": "94%", "url": "https://www.rottentomatoes.com/m/avengers_endgame"} ], "streamingLinks": [ {"platform": "Disney+", "url": "https://www.disneyplus.com/play/b39aa962-be56-4b09-a536-98617031717f", "price": "Subscription"}, {"platform": "Apple TV", "url": "https://tv.apple.com/us/movie/avengers-endgame/umc.cmc.4ao9tm6b6rz4sy7yj5v13ltf8", "price": "From $3.99"} ] } ``` #### Finance ```json { "name": "Apple Inc", "exchange": "NASDAQ", "ticker": "AAPL", "price": "270.23", "change": "+6.83", "changePercent": "2.59%", "open": "266.96", "high": "272.30", "low": "266.72", "marketCap": "3.97T", "peRatio": "34.19", "weekHigh52": "288.61", "weekLow52": "189.81", "dividend": "0.38%", "companyInfo": { "ceo": "Tim Cook (Aug 24, 2011–)", "founders": "Steve Jobs, Ronald Wayne, Steve Wozniak", "headquarters": "Cupertino, California, United States", "employees": "166,000 (2025)" }, "earnings": {"quarter": "Q1 2026", "epsBeat": "+6.25%", "revenueBeat": "+3.78%"}, "relatedMarkets": [ {"name": "Dow Jones Industrial Average", "price": "49,447.43", "changePercent": "1.79%"}, {"name": "S&P 500", "price": "7,126.06", "changePercent": "1.20%"} ] } ``` #### Shopping ```json { "productCount": 32, "filterGroups": ["Capacity", "Category", "Product Rating", "Stores", "Features"], "products": [ { "name": "Instant Pot Pro 6-Quart Pressure Cooker", "price": 160.26, "store": "Home Depot", "rating": 4.5, "reviewCount": "275", "deliveryInfo": "Free delivery", "monthlyPayment": "$20.28/mo", "monthlyTerm": "x 36" } ] } ``` #### People Also Ask (with answers) ```json { "question": "Which Instant Pot to make L-reuteri yogurt?", "snippet": "Make sure you use the Instant Pot Pro, which has a sous vide setting and a yogurt setting that goes for 36 hours.", "source": "Cultured Food Life", "sourceUrl": "https://www.culturedfoodlife.com/recipe/l-reuteri-in-an-instant-pot/" } ``` #### Video key moments ```json { "title": "I Used Every 2026 MacBook for a Month", "url": "https://www.youtube.com/watch?v=bjPq4goP2A8", "channel": "TechReviewer", "duration": "14:32", "keyMoments": [ {"time": 0, "label": "I've Had Every 2026 MacBook for a Month"}, {"time": 79, "label": "The MacBook Neo is better than you think"}, {"time": 289, "label": "The MacBook Air M5's identity crisis"} ] } ``` #### Hotels ```json { "name": "Hotel Europe Saint-Severin", "price": "$158", "rating": 4.4, "reviewCount": "1.4K", "stars": 3, "starClassification": "3-star tourist hotel", "latitude": 48.852751, "longitude": 2.344313 } ``` #### Flight status ```json { "flightNumber": "UA 123", "origin": "LHR", "destination": "EWR", "status": "Departing on time", "departureTime": "07:45", "duration": "8h 5m flight." } ``` #### Lyrics ```json { "text": "Is this the real life? Is this just fantasy? Caught in a landslide, no escape from reality...", "artist": "Queen", "album": "A Night at the Opera", "releaseYear": "1975", "genre": "Hard rock, Progressive rock, Art rock", "source": "Musixmatch" } ``` ### All sections extracted | Section | Example queries | |---------|----------------| | Organic results (with rich snippets) | All queries | | Knowledge Panel (cast, director, budget, ratings, streaming) | "avengers endgame", "taylor swift" | | Finance (full stock data + company info + earnings) | "aapl stock", "bitcoin price" | | Shopping (products + filter groups) | "instant pot", "iphone 16" | | Product Page GPC (offers from multiple stores) | "buy iphone 16 pro max" | | AI Overview (structured text + references) | Most informational queries | | People Also Ask (with answers) | Most queries | | Things to Know (with nested AI overviews) | Product/entity queries | | Perspectives (Reddit, X, TikTok, YouTube, Instagram) | Most queries | | Top Stories | News-related queries | | Inline Videos (with key moments) | Video queries | | Local Pack (with open status, reviews, services) | "near me" queries | | Hotels (with coordinates + star classification) | "hotels in paris" | | Flights (price calendar + airline listings) | "flights to tokyo" | | Flight Status | "UA 123 flight status" | | Weather (hourly + 7-day forecast) | "weather new york" | | Sports (matches, standings, leaderboards) | "nba scores", "bundesliga" | | Lyrics | "lyrics bohemian rhapsody" | | Awards (winners + host + network) | "oscars 2025 winners" | | Movie Recommendations | "amazon prime movies" | | Dictionary (pronunciation, synonyms, etymology) | "define serendipity" | | Translation (with romanization) | "translate hello to japanese" | | Currency (with conversion table) | "usd to eur" | | Recipes | Recipe queries | | Forums (with vote counts) | Discussion queries | | Ads (text + PLA) | Commercial queries | | Web Description | Most queries (59%) | | Featured Snippet (paragraph/list/table) | Informational queries | | Attraction Admissions (ticket prices) | "tour eiffel" | | Local KP (busyness, merchant info) | Business queries | | Spell Check | Typo queries | ### Proxy tips The default Apify proxy works for most queries. If you get blocked (empty results or captcha pages), switch to residential proxies: ```json { "query": "your query", "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ``` Residential proxies cost more but have higher success rates against Google's anti-bot detection. ### Limitations - Google typically returns up to ~400 results per query (40 pages) - Results may vary by proxy region even with `gl` set - AI Overview availability varies by query and region ### Pricing Charged per page. Each page contains the full `SerpPage` object with all sections above. # Actor input Schema ## `query` (type: `string`): Google search query. Supports operators: "exact phrase", -exclude, site:example.com, filetype:pdf, etc. ## `maxNumberOfPages` (type: `integer`): Maximum number of SERP pages to scrape. Each page contains ~10 organic results plus all other sections (shopping, PAA, AI overview, etc.). Set to 0 for unlimited (scrapes all available pages). Google typically has up to 40 pages per query. ## `gl` (type: `string`): Country code for geo-targeting results (e.g. "us", "vn", "jp", "de", "kr"). ## `hl` (type: `string`): Interface language code (e.g. "en", "vi", "ja", "de", "ko"). ## `sort` (type: `string`): Time filter (tbs parameter). Examples: "qdr:d" (past day), "qdr:w" (past week), "qdr:m" (past month), "qdr:y" (past year). ## `proxyConfiguration` (type: `object`): Select proxies to be used. ## Actor input object example ```json { "query": "instant pot", "maxNumberOfPages": 1, "gl": "us", "hl": "en", "proxyConfiguration": { "useApifyProxy": true } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "query": "instant pot", "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("kaix/google-serp-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "query": "instant pot", "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("kaix/google-serp-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "query": "instant pot", "proxyConfiguration": { "useApifyProxy": true } }' | apify call kaix/google-serp-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=kaix/google-serp-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Google Search Scraper - Most Comprehensive", "description": "πŸ”₯ ~$1/1K pages πŸ”₯ Scrape Google into 40+ structured sections: organic results, knowledge panel with cast/ratings/streaming prices, finance with earnings, shopping with filters, AI overview, PAA with answers, perspectives, video key moments, hotels, local pack, flights, lyrics, sports, ads.", "version": "0.1", "x-build-id": "DUvgexsLfFe2cYrW9" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/kaix~google-serp-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-kaix-google-serp-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/kaix~google-serp-scraper/runs": { "post": { "operationId": "runs-sync-kaix-google-serp-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/kaix~google-serp-scraper/run-sync": { "post": { "operationId": "run-sync-kaix-google-serp-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "query" ], "properties": { "query": { "title": "Search Query", "type": "string", "description": "Google search query. Supports operators: \"exact phrase\", -exclude, site:example.com, filetype:pdf, etc." }, "maxNumberOfPages": { "title": "Max Number of Pages", "minimum": 0, "type": "integer", "description": "Maximum number of SERP pages to scrape. Each page contains ~10 organic results plus all other sections (shopping, PAA, AI overview, etc.). Set to 0 for unlimited (scrapes all available pages). Google typically has up to 40 pages per query.", "default": 1 }, "gl": { "title": "Country (gl)", "type": "string", "description": "Country code for geo-targeting results (e.g. \"us\", \"vn\", \"jp\", \"de\", \"kr\").", "default": "us" }, "hl": { "title": "Language (hl)", "type": "string", "description": "Interface language code (e.g. \"en\", \"vi\", \"ja\", \"de\", \"ko\").", "default": "en" }, "sort": { "title": "Sort / Time Filter", "type": "string", "description": "Time filter (tbs parameter). Examples: \"qdr:d\" (past day), \"qdr:w\" (past week), \"qdr:m\" (past month), \"qdr:y\" (past year)." }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Select proxies to be used.", "default": { "useApifyProxy": true } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```