Google Search Scraper

Scrape Google search pages at $1.50 per 1,000 SERPs, about 40% cheaper than the leading Apify alternative. Each run gives you one record per SERP page with organic results, paid ads, People Also Ask (including pre-rendered answers with source attribution), related queries, featured snippet, the full AI Overview body plus its source citations, and pagination metadata. Built in Go, HTTP only, no JavaScript rendering, no proxy setup required.

What you get per SERP page

• Organic results: title, URL, displayed URL, description, source name, position, the keywords Google bolded inside the snippet, sub-page site links, plus context fields like commentsAmount (Reddit), views (YouTube), lastUpdated, and date.
• Paid results and shopping ads: text ads land in paidResults[] with title, destination URL (not the Google tracking redirect), displayed URL, description, and ad position. Shopping carousel cards land in paidProducts[] with title, URL, merchant, price, and image URL.
• People Also Ask: every PAA question. When Google pre-renders the first answer (most "best X", "how to", "what is" queries), that item also gets the full answer text, source title, source URL, and publish date.
• Related queries: deduplicated "Related searches" suggestions from the bottom of the SERP.
• Featured snippet: the highlighted answer box at the top of the SERP, when present.
• AI Overview: the full synthesized AI answer text (intro paragraphs plus the detailed bullet list), and the citation cards Google credits, each with title, URL, and excerpt.
• Pagination signals: resultsTotal (the "About X results" number) and hasNextPage.
• Raw HTML on demand: set saveHtmlToKeyValueStore: true to get a public URL to the saved page in the Key-Value Store.

Why use this actor

• Pay per page, no monthly subscription. $0.001 actor-start and $0.0015 per SERP page returned. Free Apify accounts get $5 credit, enough for about 3,300 SERPs.
• Full AI Overview extraction. Both the synthesized AI body text (intro plus bullet detail) and the citation cards Google credits, each with title, URL, and excerpt.
• PAA with attribution. When Google pre-renders the first People Also Ask answer (most "best X" / "how to" queries), you get the answer text, source title, source URL, and publish date.
• Paid ads add-on. Optional extractAds toggle adds session-rotated retries to maximise ad discovery on commerce queries.
• No proxy or browser setup. Apify's GOOGLE_SERP proxy is wired in under the hood. You only choose the country and language.
• Built for AI agents (MCP) and Apify workflows. Native integration with Apify schedulers, webhooks, datasets, and the Model Context Protocol.

What you can do with Google SERP data

• SEO rank tracking: monitor your domain's position for thousands of keywords daily.
• AEO / GEO research: see what Google's AI Overview tells users about your topic, and which sources it cites.
• Lead generation: pull URLs of every site that ranks for your target ICP keywords, then enrich.
• Competitive monitoring: track which competitors appear in your category's SERPs.
• Content gap analysis: read every PAA question and answer Google shows for your topic.
• AI agent grounding: feed structured SERP data to LLM agents via MCP or OpenAI tool use, so they can answer "what does the internet say about X" with citations.

Use with AI agents (MCP)

This actor works as a Model Context Protocol tool out of the box. Connect any MCP-compatible client (Claude Desktop, Claude.ai, Cursor, VS Code, custom agents).

Apify MCP server URL:

https://mcp.apify.com?tools=santamaria-automations/google-search-scraper

Example prompt once connected:

Use google-search-scraper to find the top 20 organic Google results for "best vector database" in the US and return the URLs, titles, and descriptions.

Input

You only need a list of search queries. Everything else has sensible defaults.

{
  "queries": ["best CRM software", "python web scraping tutorial"],
  "countryCode": "us",
  "languageCode": "en",
  "resultsPerPage": 10,
  "maxPagesPerQuery": 1,
  "includePeopleAlsoAsk": true,
  "includeRelatedSearches": true
}

Input parameters

Parameter	Type	Default	What it does
queries	string[]	(none)	Keywords to search. Each runs as a separate Google query.
searchUrls	string[]	(none)	Optional: paste Google search URLs directly. All URL filters are preserved.
countryCode	string	us	ISO 3166-1 alpha-2 country code (us, gb, de, au, ...). Sets Google's gl parameter when non-default.
languageCode	string	en	Language code (en, de, fr, es, ...). Sets Google's hl parameter when non-default.
resultsPerPage	int	10	Results to request per page (10 to 100). Default 10 gives the richest output (Google pre-renders PAA answers, AI Overview body text, and source descriptions on smaller-num SERPs). Raise to 100 if you want more results per request and don't mind a slimmer feature set.
maxPagesPerQuery	int	1	Pages to fetch per query (1 to 10). Each page is one billable event.
mobileResults	bool	false	Use Google's mobile interface. Mobile SERPs sometimes show a different result mix and ad placements.
forceExactMatch	bool	false	Wraps each query in quotes ("..."), Google's verbatim mode.
includePeopleAlsoAsk	bool	true	Extract the PAA section from page 1.
includeRelatedSearches	bool	true	Extract related-search suggestions from the bottom of page 1.
saveHtmlToKeyValueStore	bool	false	Save the raw SERP HTML to the Key-Value Store. Useful for debugging or custom extraction.
extractAds	bool	false	Add-on: enable comprehensive paid-results extraction. Retries each query with rotated proxy sessions up to two more times and merges any new ads found. Adds one billable ads-extraction-attempt event per SERP page ($1.50 per 1,000). Recommended for commerce / comparison / lead-gen queries.

Proxy configuration is handled internally. The actor always routes through Apify's GOOGLE_SERP proxy group, which is the recommended way to reliably scrape Google at scale.

Output

One record per SERP page. To get one row per organic result, append &view=organicResults to the dataset URL or pick the view in the Apify UI.

{
  "searchQuery": {
    "term": "best CRM software",
    "url": "http://www.google.com/search?q=best+CRM+software",
    "device": "DESKTOP",
    "page": 1,
    "domain": "google.com",
    "countryCode": "us",
    "languageCode": "en"
  },
  "resultsTotal": 122,
  "hasNextPage": true,
  "organicResults": [
    {
      "title": "What's the best CRM you're using right now and why?",
      "url": "https://www.reddit.com/r/CRM/comments/1o0r9ot/whats_the_best_crm_youre_using_right_now_and_why/",
      "displayedUrl": "Reddit · r/CRM",
      "description": "Hey everyone, I'm looking for honest recommendations on CRM platforms...",
      "websiteTitle": "Reddit · r/CRM",
      "emphasizedKeywords": [],
      "siteLinks": [],
      "commentsAmount": "200+ comments",
      "views": null,
      "lastUpdated": "7 months ago",
      "date": null,
      "position": 1,
      "type": "organic"
    }
  ],
  "paidResults": [
    {
      "title": "Boost Growth with ServiceNow® - CRM Tools That Maximize ROI",
      "url": "https://www.servicenow.com/solutions/crm/crm-system.html",
      "displayedUrl": "ServiceNow",
      "description": null,
      "adPosition": 1,
      "type": "paid"
    }
  ],
  "paidProducts": [],
  "featuredSnippet": null,
  "peopleAlsoAsk": [
    {
      "question": "Which is the best CRM software?",
      "answer": "Top 10 Best CRM Software In India\nSalesforce CRM. ...\nHubSpot CRM. ...\nFreshsales by Freshworks. ...\nMicrosoft Dynamics 365 CRM. ...\nPipedrive. ...",
      "title": "Top 10 CRM Software in India, Bigsun",
      "url": "https://bigsunworld.com/blog/top-10-crm-software-in-india.html",
      "date": "16 Sept 2025"
    },
    { "question": "What is no 1 CRM?", "answer": null, "title": null, "url": null, "date": null }
  ],
  "relatedQueries": [
    { "title": "Top 10 CRM software", "url": "http://www.google.com/search?q=Top+10+CRM+software" }
  ],
  "suggestedResults": [],
  "aiOverview": {
    "type": "static",
    "content": "The \"best\" CRM software depends on your business size, budget, and primary goals. Top overall options include HubSpot for marketing automation, Pipedrive for sales-driven teams, Zoho CRM for high customization on a budget, and Salesforce for large, scaling enterprises\n\nThe leading CRM platforms stand out in different areas:\n\nHubSpot CRM: Best overall for marketing and beginners. It features a robust, forever-free tier and offers seamless integration of sales, marketing, and customer service hubs. Paid starter plans begin around $15/user/month.\n\nPipedrive: Best for sales teams and pipeline management. It features a clean, visual, and intuitive interface designed explicitly to close deals fast. Starts around $14/user/month (billed annually). U.S. Chamber of Commerce +2\n\nZoho CRM: Best value and deeply customizable. It offers extensive workflow automation and AI tools, making it highly scalable for growing businesses. Starts around $14/user/month.\n\nSalesforce: Best for large businesses and enterprises. It is the world's number one CRM, offering unmatched customization and AI capabilities, though it requires a steeper learning curve",
    "sources": [
      {
        "url": "https://www.reddit.com/r/CRM/comments/1o0r9ot/whats_the_best_crm_youre_using_right_now_and_why/",
        "title": "What's the best CRM you're using right now and why?",
        "description": "Very easy and automated sales CRM for B2B. * TilapiaTango. • 8mo ago. Salesforce. For decades and it's worked well..."
      },
      {
        "url": "https://www.forbes.com/advisor/business/software/best-crm-software/",
        "title": "10 Best CRM Software Of 2026 – Forbes Advisor",
        "description": "Innovation. * View All Innovation. * Cloud 100. * Enterprise Commerce. * Enterprise Security and Protection..."
      },
      {
        "url": "https://www.uschamber.com/co/start/strategy/low-cost-crm-tools",
        "title": "10 Free or Low-Cost CRM Tools for Small Businesses",
        "description": "Explore top vendors with free or low-cost CRM options * HubSpot offers a free CRM packed with features..."
      }
    ]
  },
  "kvsHtmlUrl": "https://api.apify.com/v2/key-value-stores/STORE_ID/records/best_CRM_software_page1",
  "url": "http://www.google.com/search?q=best+CRM+software",
  "scrapedAt": "2026-06-03T12:00:00Z"
}

Output field reference

• searchQuery: metadata about which query, page, device, country, and language produced this record.
• resultsTotal: the "About X,XXX,XXX results" number Google shows above the SERP. Null when Google does not show the counter for that query.
• hasNextPage: true if Google offers a Next page link. Re-run with a higher maxPagesPerQuery to fetch more.
• organicResults[]: every organic web result on the page (see field table below).
• paidResults[]: text ads above or below organic results, with title, destination URL, displayed URL, description, and ad position.
• paidProducts[]: shopping ads (product cards with title, URL, merchant, price, image).
• featuredSnippet: the highlighted answer box at the top of the SERP, or null when absent.
• peopleAlsoAsk[]: PAA questions. The first item gets answer, title, url, and date populated from the source citation card when Google pre-renders the answer. Subsequent items return question only.
• relatedQueries[]: deduplicated related-search suggestions from the bottom of the SERP.
• suggestedResults[]: reserved for future enrichment, currently always returned as an empty array.
• aiOverview: Google AI Overview block. content carries the full synthesized AI answer (intro paragraphs plus the bullet detail list). sources lists the citation cards with url, title, and description (the excerpt Google credits). Null when the SERP has no AI Overview.
• kvsHtmlUrl: public link to the raw HTML in the Apify Key-Value Store. Present only when saveHtmlToKeyValueStore is true.
• url: convenience copy of searchQuery.url.
• scrapedAt: ISO 8601 UTC timestamp the page was fetched.

Per-organic-result fields

• title, url, description: the basics.
• displayedUrl: the breadcrumb-style URL Google shows under the title.
• websiteTitle: the short source name (e.g. Salesforce, Reddit · r/CRM, Expedia).
• emphasizedKeywords: words Google bolded inside the description (it bolds query matches).
• siteLinks: sub-page links Google groups beneath the main result, for big sites. Empty array when none.
• commentsAmount: comment count Google shows for Reddit / forum results (e.g. "200+ comments"). Null when absent.
• views: view count for YouTube results (e.g. "44.7K+ views"). Null when absent.
• lastUpdated: relative time stamp Google shows next to the result (e.g. "7 months ago"). Null when absent.
• date: publish date Google shows for article results (e.g. "Feb 5, 2026"). Null when absent.
• position: 1-based rank on the SERP. With pagination, page 2 starts at position 11, page 3 at 21, and so on.
• type: always organic for this array. Featured snippets and AI Overview sources live in their own top-level fields.

Pricing

Pay-per-event, no monthly fee, no commitment. Apify's free plan gives you $5 of credit, which covers about 3,300 SERP pages with this actor.

Event	Price	When charged
Actor start	$0.001	Once per run, when the container starts.
Scraped search result page	$0.0015 ($1.50 per 1,000)	Per SERP page successfully fetched and parsed.
Paid results extraction (add-on)	$0.0015 ($1.50 per 1,000)	Per SERP page when extractAds: true. Triggers up to two extra fetches with rotated proxy sessions to maximise ad discovery.

Example total cost:

• 1 query, 1 page (default 10 results): $0.001 + $0.0015 = $0.0025
• 10 queries, 1 page each: $0.001 + $0.015 = $0.016
• 1,000 queries, 1 page each: $0.001 + $1.50 = $1.50
• 100 queries, 1 page each, with extractAds: $0.001 + $0.15 + $0.15 = $0.30

Apify's GOOGLE_SERP proxy is required and is charged separately against your Apify proxy quota. The Free plan includes about 1,000 SERP requests per month; Creator and higher plans include 10,000+ per month.

How to scrape Google by keyword

Provide one or more search terms. Each runs as a separate Google query, and the results land in a single dataset:

{ "queries": ["hotels in Seattle", "best CRM software"] }

How to scrape Google by URL

Paste full Google search URLs to preserve every filter (country, language, time range, file type, and so on):

{
  "searchUrls": [
    "https://www.google.com/search?q=hotels+in+Seattle&gl=us&tbs=qdr:w"
  ]
}

Limitations you should know about

This actor is HTTP-only and routes through Apify's GOOGLE_SERP proxy. A few fields depend on what Google chooses to include in the SERP for a given query:

• peopleAlsoAsk[0].answer is populated whenever Google pre-renders the first PAA answer (which happens on most "best X", "how to" and "what is" queries). For the other PAA questions, answer stays null because Google loads those via JavaScript only when the user clicks the expander. When Google pre-renders the first answer, you also get title, url, and date of the source article.
• aiOverview.content is populated when Google pre-renders the AI body (most "best X" / "how to" / "what is" queries). The content includes intro paragraphs plus the bullet detail list and the inline source citations Google embeds in the text. For queries where Google shows the AI Overview UI but does not pre-render the body, you still get the source cards with their descriptions.
• aiOverview appears only when Google shows it for that query. AI Overview triggers on roughly half the queries we tested (more often on "how to" and "best X" queries, less on travel or product queries). When the SERP has no AI Overview at all, this field is null.
• resultsTotal is null for some queries because Google does not always show the "About X results" counter.
• paidResults and paidProducts depend on the fetch. Google rotates ads aggressively, so the same query can return ads on one fetch and no ads on the next. Enable extractAds: true to retry with rotated proxy sessions and merge any new ads found.

Tips and FAQs

How many results per page can I get? Up to 100 with resultsPerPage: 100. Google's modern SERPs interleave AI overviews and knowledge panels, so the actual organicResults count is often 8 to 12 even with num=100. That is Google's behaviour, not a parser limitation. Smaller num values (default 10) give the richest output because Google pre-renders PAA answers and AI Overview body text on smaller-num SERPs.

How do I get more results, paginate or change resultsPerPage? Set maxPagesPerQuery: 10 to fetch up to 10 pages (roughly 80 to 100 unique organic results at resultsPerPage: 10, or up to 1,000 at resultsPerPage: 100). Each page is one billable event.

Why is resultsTotal sometimes null? Google does not always show the "About X results" counter, particularly for localised travel queries, AI-overview-heavy SERPs, and mobile layouts.

How do I export to CSV or Excel? Use Apify's Export → CSV / XLSX. To get one row per organic result, append &view=organicResults to the dataset URL or pick the view in the UI.

Can I scrape Google in any country? Yes. Set countryCode to any ISO 3166-1 alpha-2 code. Combine with languageCode for the closest match to a real user in that country.

Does this work for AI Overview content? Yes. The actor extracts both the full AI Overview body text (intro plus the bullet detail list) and the citation cards Google credits. There are still rare cases where Google shows the AI Overview UI but does not pre-render the body server-side; in those cases you still get the sources.

How does this compare to ScrapingBee, SerpAPI, or Bright Data? All three are great but subscription-based with monthly minimums. This actor is pay-per-event, costs nothing when idle, and integrates natively into Apify workflows (webhooks, schedulers, dataset transformations, MCP). For very high-volume daily SERP scraping a dedicated subscription may still be cheaper at scale; for everything else, pay-per-event wins.

Is scraping Google Search legal? Public Google Search results are publicly accessible. Most jurisdictions allow scraping public data for legitimate purposes (research, SEO, market intelligence). Respect Google's Terms of Use and consult a lawyer for your specific use case.

Coming soon

• Google AI Mode add-on (separate conversational AI search endpoint).
• Custom data function, so you can run your own JS extractor against the saved HTML.
• Cross-platform comparison add-ons: Perplexity, ChatGPT, Copilot, and Gemini.

Feedback

Found a bug or want a feature? Open an issue on the Apify Issues tab. We ship fixes fast.