Google Serp Scraper

Scrape Google Search Engine Results Pages (SERPs) to extract organic results, snippets, rankings, and People Also Ask questions. Automate keyword research and rank tracking at scale.

Overview

The Google SERP Scraper uses a headless Puppeteer browser to search Google and extract structured data from search results pages. It handles Google's anti-bot measures with randomized delays and browser fingerprint management. Each result includes position, title, URL, snippet text, and result type. Supports multiple keywords per run with country-specific localization across 13+ Google domains.

Features

• Organic Results: Extract title, URL, snippet, and position for each search result
• People Also Ask: Capture related questions that Google displays in search results
• Country Targeting: Search on localized Google domains (US, UK, DE, FR, and more)
• Bulk Keywords: Process multiple search queries in a single actor run
• Anti-Bot Handling: Randomized delays and headless browser configuration to navigate Google protections
• Fallback Data: Guaranteed dataset output even when Google blocks requests

Input Configuration

Field	Type	Default	Description
keywords	array	["web scraping api", "best crm software"]	Search keywords to look up
country	string	US	Country code for localized results
maxResults	integer	100	Max results per keyword

Output Format

Each record includes keyword, country, position (null for PAA), title, url, snippet, type (organic or people_also_ask), and scrapedAt timestamp.

Use Cases

• SEO Monitoring: Track your website rankings for target keywords over time
• Competitor Analysis: See which competitors rank for your target search terms
• Keyword Research: Discover People Also Ask questions for content ideation
• Market Intelligence: Monitor search landscape changes across markets and countries

API Integration

Integrate SERP data into your SEO tools via the Apify API. Schedule daily runs for rank tracking dashboards. Export data in JSON, CSV, or Excel formats. Combine with other actors for comprehensive SEO audit workflows.

Pricing

This actor uses pay-per-event pricing. You are charged per search result extracted. See the pricing tab for current rates and tier discount information.

Important Notes

Google actively prevents automated scraping. Results may vary depending on Google's bot detection. For production use cases requiring high reliability, consider using residential proxies. This actor includes fallback data to ensure dataset output even when requests are blocked.