Google SERP Scraper - Extract Search Results with Positions, Snippets & Related Questions

Extract organic search results from Google with full SERP data including rankings, snippets, sitelinks, People Also Ask questions, and Related Searches. Built for SEO professionals, marketers, and researchers who need reliable Google search data at scale.

What is Google SERP Scraper?

Google SERP Scraper is a powerful web scraping tool designed to extract comprehensive search engine results page data from Google. Unlike limited API solutions, this scraper provides full organic result details including exact rankings, rich snippets, sitelinks, domain information, and contextual data like People Also Ask questions and Related Searches.

This actor is built for SEO professionals who need to monitor keyword rankings across multiple countries and languages, content marketers researching competitor strategies, and businesses tracking their search visibility. With support for unlimited queries, multi-page pagination, and precise geolocation targeting, you can extract exactly the SERP data you need without manual copy-pasting or limited API quotas.

The scraper uses advanced browser automation with Playwright to bypass Google's anti-bot protections, fingerprint randomization to appear as real users, and smart session management to maximize extraction success rates. Whether you need to track 10 keywords or 10,000, analyze local search results in different countries, or monitor SERP features like Featured Snippets and People Also Ask boxes, Google SERP Scraper delivers production-ready data in structured JSON format.

Output Data Fields

Field	Type	Description
type	string	Item type: result for organic results, related for People Also Ask and Related Searches
query	string	The search query that produced this result
page	integer	SERP page number (1-based indexing)
position	integer	Organic ranking position (1-based, continues across pages)
title	string	Result title text (clickable headline)
url	string	Destination URL of the organic result
snippet	string or null	Meta description or snippet text shown in SERP
domain	string or null	Extracted domain name (without www prefix)
sitelinks	array	Array of sitelink objects with title and url fields
peopleAlsoAsk	array	List of questions from People Also Ask box (only in related items)
relatedSearches	array	List of related search queries (only in related items)

Tutorial: How to Scrape Google Search Results in 7 Steps

Step 1: Add queries to scrape Create a list of search queries you want to extract. You can use plain keywords, phrases, or Google operators like site:, intitle:, or -excluded terms.

Step 2: Configure localization Set the country parameter (e.g., us, uk, de) to target specific geographic search results and language parameter (e.g., en, es, fr) to control the Google interface language. This combination determines which regional search results you receive.

Step 3: Set result limits Use maxResults to define how many organic results to extract per query (e.g., 50 for top 50 rankings) and resultsPerPage to control pagination efficiency (10-100 results per page, higher values reduce requests but may trigger blocks).

Step 4: Enable related data extraction Keep includeRelated set to true to capture People Also Ask questions and Related Searches from the first page of results. This data is valuable for content ideation and understanding search intent.

Step 5: Configure proxy settings Use Apify Proxy (enabled by default) to rotate IP addresses and avoid Google blocks. For higher success rates, consider upgrading to residential proxies in the proxy configuration object.

Step 6: Run the actor Click "Start" to begin extraction. The actor will automatically paginate through results, handle anti-bot protections, and retry failed requests up to 3 times per page.

Step 7: Export your data Download results in JSON, CSV, XML, Excel, or HTML format. Each organic result includes position, title, URL, snippet, domain, and sitelinks. Related data items contain People Also Ask and Related Searches arrays.

Input Parameters

Field	Type	Required	Default	Description
queries	array of strings	Yes	-	Search queries to execute on Google. Supports standard search syntax and operators.
maxResults	integer	No	10	Maximum number of organic results to extract per query. The actor will paginate automatically.
resultsPerPage	integer	No	10	Number of results requested per page (1-100). Higher values reduce requests but may increase block rate.
country	string	No	us	Country code for geolocation targeting (Google gl parameter). Examples: us, uk, de, fr, ca.
language	string	No	en	Language code for Google interface (Google hl parameter). Examples: en, es, de, fr, ja.
includeRelated	boolean	No	true	Extract People Also Ask questions and Related Searches from the first page of results.
proxy	object	No	{ "useApifyProxy": true }	Proxy configuration. Apify Proxy is required to avoid IP blocks. Configure residential proxies for best results.

Example Input

{
  "queries": [
    "best project management software 2026",
    "site:github.com web scraping",
    "how to improve SEO rankings",
    "\"machine learning\" tutorial",
    "cheap flights to Barcelona -ads"
  ],
  "maxResults": 50,
  "resultsPerPage": 10,
  "country": "us",
  "language": "en",
  "includeRelated": true,
  "proxy": {
    "useApifyProxy": true
  }
}

Example Output

Organic result item:

{
  "type": "result",
  "query": "best project management software 2026",
  "page": 1,
  "position": 1,
  "title": "15 Best Project Management Software Tools for 2026",
  "url": "https://www.softwareadvice.com/project-management/",
  "snippet": "Compare top project management platforms including Asana, Monday.com, and Trello. Find the best solution for your team size and budget with our comprehensive comparison guide.",
  "domain": "softwareadvice.com",
  "sitelinks": [
    {
      "title": "Best Overall",
      "url": "https://www.softwareadvice.com/project-management/#best-overall"
    },
    {
      "title": "Best for Teams",
      "url": "https://www.softwareadvice.com/project-management/#teams"
    },
    {
      "title": "Best Free Tools",
      "url": "https://www.softwareadvice.com/project-management/#free"
    },
    {
      "title": "Pricing Comparison",
      "url": "https://www.softwareadvice.com/project-management/pricing/"
    }
  ]
}

Related data item:

{
  "type": "related",
  "query": "best project management software 2026",
  "peopleAlsoAsk": [
    "What is the most popular project management software?",
    "Is Microsoft Project still used?",
    "What is the difference between Asana and Monday.com?",
    "Which project management tool is best for small teams?",
    "Are there free alternatives to Jira?"
  ],
  "relatedSearches": [
    "best free project management software",
    "project management software comparison",
    "asana vs monday vs clickup",
    "project management tools for agile teams",
    "best project management software for construction",
    "project management software with gantt charts",
    "cloud-based project management platforms",
    "project management software reviews 2026"
  ]
}

Legal and Compliance

Web scraping public Google search results is generally legal in jurisdictions following the precedent set by hiQ Labs v. LinkedIn (9th Circuit, 2019), which established that scraping publicly accessible data does not violate the Computer Fraud and Abuse Act. However, you must comply with Google's Terms of Service and robots.txt directives, and respect rate limits to avoid service disruption.

This actor is designed for legitimate business purposes such as SEO monitoring, market research, academic studies, and competitive analysis. Users are responsible for ensuring their use complies with applicable laws in their jurisdiction, including data protection regulations like GDPR. Do not use this tool to collect personal information, violate copyright, or engage in activities prohibited by Google's Terms of Service. Always implement reasonable rate limiting and respect website resources.

Pricing

Google SERP Scraper runs on the Apify platform with pay-as-you-go pricing based on compute usage and proxy bandwidth. Typical costs:

• Small projects (1-100 queries, 10 results each): $0.10 - $0.50 per run
• Medium projects (100-1000 queries, 50 results each): $2 - $10 per run
• Large projects (1000+ queries, 100 results each): $15 - $100 per run

Pricing factors include number of queries, results per query, proxy type (datacenter vs residential), and retry attempts. Residential proxies increase success rates but cost more than datacenter proxies. The actor uses 1 concurrent request by default to minimize blocks, which affects runtime but improves reliability.

Apify offers a free tier with $5 monthly credit, suitable for testing and small-scale monitoring. For production use, consider monthly subscriptions starting at $49 with included compute credits and discounted proxy pricing. Monitor usage in real-time through the Apify Console.

Frequently Asked Questions

How many search results can I extract per query? You can extract unlimited organic results by setting the maxResults parameter. However, Google typically shows around 500-1000 results maximum per query depending on the search term. The actor will automatically paginate through all available pages until reaching your specified limit or Google's natural result cap.

Does this scraper work with Google's anti-bot protections? Yes, this actor uses Playwright browser automation with fingerprint randomization, session rotation, and Apify Proxy to bypass most anti-bot measures. However, Google's protections are aggressive, so you may experience occasional CAPTCHA challenges or rate limits on high-volume extractions. Using residential proxies significantly improves success rates.

Can I scrape Google search results for different countries and languages? Absolutely. Use the country parameter to target specific geographic regions (Google's gl parameter) and language to set the interface language (hl parameter). For example, "country": "de" and "language": "de" will show German search results as they appear to users in Germany. This is essential for local SEO monitoring and international market research.

What is the difference between maxResults and resultsPerPage? maxResults controls the total number of organic results extracted per query (e.g., 50 means top 50 rankings), while resultsPerPage determines how many results Google returns per page (1-100). Higher resultsPerPage values reduce the number of page loads needed but may trigger blocks more easily. For example, maxResults: 50 with resultsPerPage: 10 will scrape 5 pages per query.

How do I handle CAPTCHA or rate limiting errors? If you encounter CAPTCHAs or 429 rate limit errors, try these solutions: (1) Enable residential proxies in the proxy configuration for better IP reputation, (2) Reduce concurrent requests by keeping maxConcurrency: 1, (3) Decrease resultsPerPage to 10-20 to appear more human-like, (4) Add delays between runs by scheduling with longer intervals, or (5) Split large query lists across multiple smaller actor runs.

Related Actors by lanky_quantifier

Expand your web scraping capabilities with these complementary actors:

• Google Maps Scraper - Extract business listings, reviews, ratings, phone numbers, and addresses from Google Maps with geolocation targeting and category filtering.

• LinkedIn Company Scraper - Scrape LinkedIn company profiles including employee counts, industry, headquarters location, specialties, and recent posts for B2B research.

• Amazon Product Scraper - Extract product details, prices, ratings, reviews, and seller information from Amazon with support for multiple marketplaces and ASIN lookups.

• Reddit Thread Scraper - Collect Reddit posts, comments, scores, and user data from subreddits and threads for sentiment analysis and community research.

• Contact Information Scraper - Discover email addresses, phone numbers, and social media profiles from any website using pattern matching and heuristic detection.