Google AI Overview Scraper
Pricing
from $1.99 / 1,000 search results
Google AI Overview Scraper
Scrapes Google AI Overviews (SGE) for any query. Extracts the overview text and HTML, model/provider, sources, inline references, follow-up/related questions, organic results, extraction confidence, and more.
Pricing
from $1.99 / 1,000 search results
Rating
0.0
(0)
Developer
Search API
Maintained by CommunityActor stats
0
Bookmarked
136
Total users
1
Monthly active users
5 days ago
Last modified
Categories
Share
Extract Google AI Overview answers together with citations, related questions, organic-result context, and explicit no-overview status records. The Actor supports one query or a deduplicated list of queries and processes searches concurrently within a user-defined limit.
Input
| Field | Required | Default | Description |
|---|---|---|---|
query | No | — | Single search query, processed first. |
queries | No | [] | Additional search queries. If both query inputs are empty, the Actor uses What is quantum computing. |
maxItems | No | 10 | Maximum query records, from 1 to 100. |
maxConcurrency | No | 3 | Concurrent Google searches, from 1 to 10. |
gl | No | us | Two-letter Google country code. |
hl | No | en | Google interface language code. |
maxRequestRetries | No | 2 | Bounded retries for temporary transport failures. Explicit CAPTCHA pages are never retried. |
navigationTimeoutSecs | No | 45 | Navigation timeout. |
requestHandlerTimeoutSecs | No | 120 | Whole-page extraction timeout. |
resultsWaitSecs | No | 15 | Wait for the Google result shell before extraction. |
proxyConfiguration | No | GOOGLE_SERP | GOOGLE_SERP uses Apify's HTTP-only Google search transport. Standard/custom proxies use Playwright; Residential runs without a country align to gl. |
Output
The 39-field schema includes:
- stable query identity, position, locale, search URL, and scrape timestamp;
- AI Overview text, sanitized HTML, character and token estimates, model/provider, confidence, and matched selector;
- normalized source citations and inline references;
- related/follow-up questions and up to ten organic results;
hasAiOverviewanderrorTypefor successful searches where Google shows no overview.
Unavailable optional values are omitted recursively. Valid zero counts and false values are retained. Challenge pages, raw Google responses, cookies, authorization data, and proxy credentials are never stored.
Extraction behavior
With GOOGLE_SERP, the Actor uses the proxy group's required HTTP search transport and parses the returned HTML directly. Other configurations use Playwright with a consistent desktop fingerprint per session, a locale and Residential country aligned with hl/gl, short-lived sessions, bounded concurrency, and session rotation. Both paths validate response status and content type before parsing. Explicit CAPTCHA or unusual-traffic pages fail closed with a TARGET_BLOCKED status and are not bypassed.
Local verification
npm cinpm testnpm run validate:datasetapify validate-schemaapify run --purge
Google commonly challenges local and datacenter IP addresses. Local external access to GOOGLE_SERP may be disabled by the Apify account plan, so validate that transport in Apify Cloud. Authentication, CAPTCHA, and access controls are not bypassed.


