Google AI Overview Scraper avatar

Google AI Overview Scraper

Pricing

from $1.99 / 1,000 search results

Go to Apify Store
Google AI Overview Scraper

Google AI Overview Scraper

Scrapes Google AI Overviews (SGE) for any query. Extracts the overview text and HTML, model/provider, sources, inline references, follow-up/related questions, organic results, extraction confidence, and more.

Pricing

from $1.99 / 1,000 search results

Rating

0.0

(0)

Developer

Search API

Search API

Maintained by Community

Actor stats

0

Bookmarked

136

Total users

1

Monthly active users

5 days ago

Last modified

Share

Extract Google AI Overview answers together with citations, related questions, organic-result context, and explicit no-overview status records. The Actor supports one query or a deduplicated list of queries and processes searches concurrently within a user-defined limit.

Input

FieldRequiredDefaultDescription
queryNoSingle search query, processed first.
queriesNo[]Additional search queries. If both query inputs are empty, the Actor uses What is quantum computing.
maxItemsNo10Maximum query records, from 1 to 100.
maxConcurrencyNo3Concurrent Google searches, from 1 to 10.
glNousTwo-letter Google country code.
hlNoenGoogle interface language code.
maxRequestRetriesNo2Bounded retries for temporary transport failures. Explicit CAPTCHA pages are never retried.
navigationTimeoutSecsNo45Navigation timeout.
requestHandlerTimeoutSecsNo120Whole-page extraction timeout.
resultsWaitSecsNo15Wait for the Google result shell before extraction.
proxyConfigurationNoGOOGLE_SERPGOOGLE_SERP uses Apify's HTTP-only Google search transport. Standard/custom proxies use Playwright; Residential runs without a country align to gl.

Output

The 39-field schema includes:

  • stable query identity, position, locale, search URL, and scrape timestamp;
  • AI Overview text, sanitized HTML, character and token estimates, model/provider, confidence, and matched selector;
  • normalized source citations and inline references;
  • related/follow-up questions and up to ten organic results;
  • hasAiOverview and errorType for successful searches where Google shows no overview.

Unavailable optional values are omitted recursively. Valid zero counts and false values are retained. Challenge pages, raw Google responses, cookies, authorization data, and proxy credentials are never stored.

Extraction behavior

With GOOGLE_SERP, the Actor uses the proxy group's required HTTP search transport and parses the returned HTML directly. Other configurations use Playwright with a consistent desktop fingerprint per session, a locale and Residential country aligned with hl/gl, short-lived sessions, bounded concurrency, and session rotation. Both paths validate response status and content type before parsing. Explicit CAPTCHA or unusual-traffic pages fail closed with a TARGET_BLOCKED status and are not bypassed.

Local verification

npm ci
npm test
npm run validate:dataset
apify validate-schema
apify run --purge

Google commonly challenges local and datacenter IP addresses. Local external access to GOOGLE_SERP may be disabled by the Apify account plan, so validate that transport in Apify Cloud. Authentication, CAPTCHA, and access controls are not bypassed.