🔍 Google Search Results (SERP) Scraper

Scrape Google Search results at scale. Extract organic results, People Also Ask questions, related searches, and search metadata — all without a browser.

Features

• Organic Results — position, title, URL, description, displayed URL
• People Also Ask — extract PAA questions from the SERP
• Related Searches — get Google's suggested related queries
• Search Metadata — total results count and search time
• Country & Language Targeting — use 40+ Google country domains with residential proxies
• Device Emulation — desktop or mobile SERP layouts
• Pagination — scrape multiple pages of results per query
• Batch Queries — process multiple search queries in one run

Input

Parameter	Type	Default	Description
queries	array	["web scraping"]	List of search queries
countryCode	string	us	Two-letter country code (e.g., us, gb, de)
languageCode	string	en	Language code (e.g., en, de, fr)
maxResultsPerQuery	integer	10	Max organic results per query
device	string	desktop	Device type: desktop or mobile
maxPages	integer	1	Max result pages per query (1–10)

Example Input

{
  "queries": ["best project management tools", "web scraping python"],
  "countryCode": "us",
  "languageCode": "en",
  "maxResultsPerQuery": 30,
  "device": "desktop",
  "maxPages": 3
}

Output

Each dataset item represents one page of results for a query:

{
  "query": "best project management tools",
  "page": 1,
  "device": "desktop",
  "countryCode": "us",
  "languageCode": "en",
  "googleDomain": "google.com",
  "totalResults": "1250000000",
  "searchTime": "0.45",
  "organicResultsCount": 10,
  "organicResults": [
    {
      "query": "best project management tools",
      "page": 1,
      "position": 1,
      "title": "The 15 Best Project Management Tools in 2024",
      "url": "https://example.com/best-pm-tools",
      "description": "Compare the top project management software...",
      "displayedUrl": "example.com › best-pm-tools"
    }
  ],
  "peopleAlsoAsk": [
    "What is the best free project management tool?",
    "What is the most popular project management tool?"
  ],
  "relatedSearches": [
    "project management tools free",
    "project management tools for small teams"
  ],
  "scrapedAt": "2024-01-15T10:30:00.000Z"
}

Proxy & Anti-blocking

This actor uses Apify Residential Proxies with country targeting to minimize blocking. Requests are automatically retried up to 5 times with different proxy sessions if Google returns a CAPTCHA or blocks the request.

Use Cases

• SEO Monitoring — track keyword rankings over time
• Competitor Analysis — see who ranks for your target keywords
• Market Research — discover content gaps and opportunities
• SERP Feature Tracking — monitor People Also Ask and related searches
• Lead Generation — find companies ranking for specific terms

Cost Estimation

Each Google search page uses 1 residential proxy request. A typical run with 10 queries × 1 page each ≈ 10 requests. Residential proxy cost is the primary factor.

Limitations

• Google may serve different layouts which can affect parsing accuracy
• Heavy usage may trigger CAPTCHAs despite residential proxies — use reasonable concurrency
• Ads and shopping results are not extracted (organic results only)

Support

If you encounter issues, please open an issue on the actor's GitHub page or contact the author.