Google Search Results Scraper

Google Search Results Scraper

Google Search Results Scraper is a production-ready Google SERP scraper that lets you scrape Google search results at scale — including organic listings, paid ads, shopping products, People Also Ask, related queries, and optional AI Overviews — and export clean JSON or CSV via the Apify platform. Built for marketers, developers, data analysts, and researchers, it solves the pain of unreliable scraping by using a Google SERP scraping proxy with automatic residential fallback, precise filters, and standardized output so you can scrape Google search results reliably, programmatically, and at scale.

What data / output can you get?

Below are the exact fields this Google search results scraping tool pushes to the Apify dataset (one item per query/page aggregation). Export via JSON/CSV or access through the dataset API.

Data type	Description	Example value
searchQuery.term	Final query string sent to Google (with applied filters)	"“javascript” site:example.com intitle:"guide""
searchQuery.url	The SERP URL fetched	"https://www.google.com/search?q=javascript&gl=us&hl=en"
searchQuery.device	Device used for the request	"DESKTOP"
searchQuery.page	Page number (1-based) included in this item	1
searchQuery.type	Search type identifier	"SEARCH"
searchQuery.domain	Search engine domain	"google.com"
searchQuery.countryCode	Country code used (GL)	"US"
searchQuery.languageCode	Interface language (HL)	"en"
searchQuery.locationUule	Exact location UULE (if provided)	"w+CAIQICI..."
searchQuery.resultsPerPage	Count of organic results collected so far in this item	10
url	Final SERP URL for the page	"https://www.google.com/search?q=javascript&gl=us&hl=en"
hasNextPage	Indicates if another page is available	true
serpProviderCode	Provider code flag	"O"
resultsTotal	Parsed “About X results” number (if found)	123000000
relatedQueries[]	Top related queries derived from organic titles	[{"title":"JavaScript tutorial","url":"https://www.google.com/search?q=JavaScript+tutorial&hl=en&gl=us"}]
organicResults[]	Organic listings with metadata	[{"title":"MDN Web Docs","url":"https://developer.mozilla.org/...","displayedUrl":"developer.mozilla.org","description":"...","emphasizedKeywords":["javascript"],"siteLinks":[{"title":"Guide","url":"https://developer.mozilla.org/...","description":""}],"productInfo":{},"type":"organic","position":1}]
paidResults[]	Paid ads (Google Ads) with positions (if any)	[{"title":"Learn JavaScript","url":"https://example.com%22,%22displayedUrl%22:%22example.com%22,%22description%22:%22%22,%22emphasizedKeywords%22:%5B%22javascript%22%5D,%22siteLinks%22:%5B%5D,%22productInfo%22:%7B%7D,%22type%22:%22paid%22,%22position%22:1}]
paidProducts[]	Shopping product cards/prices (if any)	[{"title":"JavaScript Book","displayedUrl":"books.example.com","prices":["$19.99"]}]
aiOverview	AI Overview text and references (if enabled)	{"text":"Summary of topic ...","references":[{"title":"MDN Web Docs","url":"https://developer.mozilla.org/..."}]}
suggestedResults[]	Suggestions derived from related queries	[{"title":"JavaScript tutorial","url":"https://www.google.com/search?q=JavaScript+tutorial&hl=en&gl=us","type":"organic","position":1}]
peopleAlsoAsk[]	PAA questions with optional links	[{"answer":null,"question":"What is JavaScript used for?","title":"What is JavaScript used for?","url":"https://example.com/faq","date":null}]
customData	Echo of add-on settings for traceability	{"perplexitySearch":{"enablePerplexity":false,"searchRecency":null,"returnImages":false,"returnRelatedQuestions":false},"chatGptSearch":{"enableChatGpt":false},"maximumLeadsEnrichmentRecords":0,"leadsEnrichmentDepartments":[]}
htmlSnapshotUrl	KV store key for saved HTML (if enabled)	"javascript_20260412_120101_p1.html"
html	Full HTML when “Save HTML to dataset” is enabled	"..."

Bonus/optional outputs:

• organicResults[].icon when includeIcons is enabled.
• html when saveHtml is true; htmlSnapshotUrl when saveHtmlToKeyValueStore is true.

Key features

• ⚙️ Robust proxy fallback (Google SERP → Residential) Always uses Apify proxy with the GOOGLE_SERP group by default and automatically falls back to Residential proxy (up to 3 retries) if blocked — then sticks with residential for the rest of the run. Ideal for Google SERP scraping proxy reliability.

• 📦 Real-time, standardized JSON Pushes dataset items in a consistent, SERP-style structure: searchQuery, organicResults, paidResults, paidProducts, peopleAlsoAsk, relatedQueries, aiOverview, suggestedResults, and more — perfect for a Google search results JSON API workflow.

• 🧪 Precise filtering controls Apply forceExactMatch, site or relatedToSite, wordsInTitle/wordsInText/wordsInUrl, quickDateRange, beforeDate/afterDate (absolute or relative), fileTypes, and includeUnfilteredResults.

• 🌍 Geo & language targeting Control countryCode (GL), searchLanguage (LR), interface language (HL), and exact locationUule for accurate, localized SERPs.

• 📱 Mobile or desktop modes Toggle mobileResults for mobile SERPs or keep the default desktop device. Useful for device-specific rank checks.

• 🧠 Generative search add‑ons ($) Enable aiMode with optional serpApiKey to enrich results with AI Overviews; add Perplexity AI search and ChatGPT search signals for cross-engine analysis.

• 💰 Paid ads focus ($) Turn on focusOnPaidAds to improve ad detection with an ad-specialized proxy workflow and targeted retries.

• 🧩 HTML snapshots for debugging Use saveHtml and/or saveHtmlToKeyValueStore to capture SERP HTML for auditing, parsing, or troubleshooting.

• 🧑‍💻 Developer-friendly and export-ready Works with Apify datasets for export to JSON/CSV or via API. Integrates into pipelines (e.g., “Google SERP scraping API” use cases) and scales to scrape Google SERP at scale.

How to use Google Search Results Scraper - step by step

1. Sign in to Apify Log in at console.apify.com or create a free account.

2. Open the actor Find “Google Search Results Scraper” in your Actors and open it.

3. Add your input In the Input tab, paste one or more search terms or full Google Search URLs into queries (one per line).

4. Configure location & language Optionally set countryCode, searchLanguage (LR), languageCode (HL), and locationUule for precise geotargeting.

5. Apply filters & limits Adjust resultsPerPage (1–100), maxPagesPerQuery, enable forceExactMatch, add wordsInTitle/Text/Url, set quickDateRange or beforeDate/afterDate, and choose fileTypes.

6. Choose device & extras Toggle mobileResults, includeUnfilteredResults, and decide whether to saveHtml or saveHtmlToKeyValueStore. Enable includeIcons if you need favicon image data.

7. Turn on add-ons (optional, $) Activate aiMode with serpApiKey for AI Overviews, and/or enable Perplexity or ChatGPT add-ons. Use focusOnPaidAds for ad-centric runs.

8. Start and monitor Click Start. Watch the Log for progress and proxy fallback messages. The actor streams dataset items as pages are scraped.

9. Export your data Go to the Dataset tab to preview and export results in JSON or CSV, or access them programmatically via the Apify API.

Pro Tip: For large jobs or scheduled runs, orchestrate this Google search results extractor with the Apify API and pipe the dataset to your data warehouse or BI tools.

Use cases

Use case name	Description
SEO rank tracking & SERP monitoring	Track organic positions, People Also Ask, and related queries across locations and languages to optimize visibility.
PPC ad intelligence	Capture paidResults and paidProducts to analyze competitors’ ad copy, landing pages, and shopping placements.
Market & competitive research	Aggregate SERPs for target keywords to map content leaders, brand presence, and emerging trends.
Content strategy & PAA mining	Extract peopleAlsoAsk to surface question clusters for content briefs and answer-engine optimization.
Lead generation