Google Search Scraper

Extract Google Search results at scale. Scrape organic results, featured snippets, People Also Ask questions, and related searches for any query. Filter by 50+ countries and 40+ languages.

Features

• Organic Results — Title, URL, description, position rank, displayed URL, and date (when shown)
• Featured Snippets — Extract Google's answer box / position zero content with source attribution
• People Also Ask — Questions and answers from Google's PAA section
• Related Searches — Discover related queries for keyword expansion
• 50+ Countries — Geo-targeted results via Google's gl parameter
• 40+ Languages — Localized interface and ranking via Google's hl parameter
• Google Search Operators — Supports site:, intitle:, inurl:, filetype:, -exclude, "exact match"
• CAPTCHA Handling — Graceful detection and retry with 15+ rotating user agents
• Consent Page Handling — Detects and reports EU GDPR consent pages
• Pay Per Event — Only pay for results actually scraped

Use Cases

SEO Research & Audit

• Analyze which pages rank for your target keywords
• Study title tags, meta descriptions, and URL structures of top-ranking pages
• Identify featured snippet opportunities for your content
• Track People Also Ask questions to inform your FAQ sections and content strategy

Competitor Analysis

• Monitor competitor rankings across hundreds of keywords
• Discover which competitors appear in featured snippets
• Analyze competitor URL structures and content patterns
• Track new entrants appearing in your target SERPs

SERP Tracking & Rank Monitoring

• Daily/weekly tracking of keyword positions for your domain
• Monitor ranking changes after algorithm updates or content changes
• Track position history across multiple countries and languages
• Alert on ranking drops for critical keywords

Keyword Research & Discovery

• Extract "Related Searches" to discover new keyword opportunities
• Mine "People Also Ask" for long-tail keyword ideas and content topics
• Analyze search intent by studying what Google shows for different queries
• Build comprehensive keyword maps by scraping related terms

Content Marketing

• Research what content formats Google prefers (lists, tables, paragraphs)
• Identify content gaps by analyzing top 10 results for target queries
• Study featured snippet formats to optimize your content for position zero
• Discover trending topics by monitoring SERP changes

Market Research

• Analyze brand visibility across product-related searches
• Monitor industry trends through search result patterns
• Study regional differences in search results across countries
• Track emerging competitors and new market entrants

Lead Generation

• Find businesses ranking for specific service keywords
• Extract company websites from search results for outreach
• Build prospect lists from geo-targeted searches
• Identify potential partners through industry keyword searches

Input Parameters

Parameter	Type	Default	Description
queries	Array of strings	(required)	Search queries to scrape. Supports Google operators.
maxResults	Integer	10	Max organic results per query (1-100).
country	String	"us"	Country code for geo-targeted results (50+ options).
language	String	"en"	Interface language code (40+ options).
includeRelatedSearches	Boolean	false	Extract related searches from the bottom of results.
maxConcurrency	Integer	1	Concurrent requests (1-10). Lower = safer.
proxyConfiguration	Object	Apify GOOGLE_SERP	Proxy settings. STRONGLY recommended.

Example Input

{
  "queries": [
    "best project management software 2026",
    "site:github.com machine learning frameworks",
    "\"artificial intelligence\" startup funding",
    "intitle:review wireless headphones"
  ],
  "maxResults": 20,
  "country": "us",
  "language": "en",
  "includeRelatedSearches": true
}

Output Format

Each organic result is stored as an individual dataset item:

{
  "query": "best project management software 2026",
  "position": 1,
  "title": "15 Best Project Management Software of 2026 - Forbes",
  "url": "https://www.forbes.com/advisor/business/software/best-project-management-software/",
  "displayedUrl": "www.forbes.com > advisor > business > software",
  "description": "Compare the top project management tools including Monday.com, Asana, ClickUp, and more. Updated for 2026 with pricing and feature comparisons.",
  "date": "Feb 15, 2026",
  "searchUrl": "https://www.google.com/search?q=best+project+management+software+2026&gl=us&hl=en&num=20&pws=0",
  "country": "us",
  "language": "en",
  "page": 1,
  "scrapedAt": "2026-03-01T12:00:00.000Z"
}

A summary record is also generated per query:

{
  "query": "best project management software 2026",
  "resultType": "searchOverview",
  "totalOrganicResults": 20,
  "resultStats": "About 234,000,000 results (0.42 seconds)",
  "hasFeaturedSnippet": true,
  "featuredSnippet": {
    "text": "The best project management software in 2026 includes...",
    "sourceUrl": "https://www.forbes.com/...",
    "sourceTitle": "15 Best Project Management Software..."
  },
  "peopleAlsoAskCount": 4,
  "peopleAlsoAsk": [
    {
      "question": "What is the best project management software?",
      "answer": "According to recent reviews...",
      "sourceUrl": "https://...",
      "sourceTitle": "..."
    }
  ],
  "relatedSearchesCount": 8,
  "relatedSearches": [
    "free project management software",
    "project management software for small teams",
    "monday vs asana vs clickup"
  ]
}

Proxy Recommendations

Google aggressively blocks automated requests. For reliable scraping:

• Best: Use Apify Proxy with GOOGLE_SERP proxy group (optimized for Google)
• Good: Use Apify residential proxies
• Risky: Datacenter proxies (expect CAPTCHAs after 10-20 requests)
• Not recommended: No proxy (will be blocked quickly)

Tips for Best Results

1. Start small — Test with 1-2 queries and 10 results before scaling up
2. Use GOOGLE_SERP proxies — Purpose-built for Google scraping
3. Keep concurrency low — 1-2 concurrent requests is safest
4. Vary your queries — Identical repeated queries are more likely to trigger CAPTCHAs
5. Use country="us" — EU countries may show consent pages that block scraping
6. Leverage Google operators — site:, intitle:, -exclude for precise results

Limitations

• Google actively fights automated scraping; occasional CAPTCHAs are expected
• Results may vary slightly from what you see in a browser (personalization, A/B tests)
• Google's HTML structure changes frequently; selectors are updated regularly
• Maximum 100 results per query (Google's hard limit on the num parameter)
• Some result types (images, videos, maps, shopping) are not extracted

Cost Estimation

The actor charges per result scraped. Approximate costs:

• 10 queries x 10 results = ~100 results
• 50 queries x 20 results = ~1,000 results
• 100 queries x 50 results = ~5,000 results

Changelog

v1.0 (2026-03-01)

• Initial release
• Organic results with title, URL, description, position, displayed URL, date
• Featured snippet extraction (paragraph, list, and table formats)
• People Also Ask questions and answers
• Related searches
• 50+ country codes, 40+ language codes
• 15 rotating user agents
• CAPTCHA and consent page detection
• Pay-per-event pricing