Google AI Overview Scraper

Collect public Google Search results for a set of queries. When an AI Overview is shown, the dataset can include its answer text, sections, cited sources, and follow-up questions, along with other visible search-result modules.

How to use

1. Enter one or more search phrases or provide public Google Search URLs in startUrls.
2. Choose the language, country, and SafeSearch setting.
3. Select the result modules to include and set the result limit.
4. Run the Actor and review the search records in the dataset.

Example:

{
  "queries": ["what is artificial intelligence"],
  "country": "us",
  "language": "en",
  "safeSearch": true,
  "maxItems": 10,
  "includeOrganicResults": true,
  "includeVideoResults": true,
  "includeRelatedQueries": true
}

Input

Input	Description	Default
queries	Search phrases to run on public Google Search pages.	—
startUrls	Public Google Search URLs. Supplied URLs replace generated queries.	—
language / country	Language and regional Google Search settings.	en / us
safeSearch	Apply Google SafeSearch to generated query URLs.	true
maxItems	Maximum search records across the run (1–100).	25
page	Starting Google results page for generated searches (1–1,000).	1
maxPages	Maximum rendered views per query (1–10). Additional views scroll the same page to reveal more results.	1
includeOrganicResults	Include visible organic result cards.	true
includeVideoResults	Include standalone video-result cards.	true
includeRelatedQueries	Include follow-up prompts, People Also Ask questions, and related searches.	true
includePageText	Include cleaned visible text from the Google Search results area.	false
proxyConfiguration	Optional Apify Proxy configuration for public search pages.	—

Output

Each dataset row represents a search query and includes searchQuery and searchUrl. If present on the page, it can also include:

• AI Overview: answer title, text and formatted HTML, section headings and items, cited sources, and counts.
• Related questions and searches: follow-up prompts, People Also Ask questions, related searches, and their counts.
• Search results: organic and standalone video cards with visible titles, links, publishers, dates, descriptions, and other card details.
• Optional page text: cleaned visible text and character and word counts when includePageText is enabled.
• Search context: final and canonical URLs, page title, language, country, and search page type.

Google may show different modules depending on the query, language, country, and availability. Missing scalar values are null; arrays remain empty when no matching module is visible. Citation and result snippets are visible card text. The Actor does not open citation destinations. YouTube links included only as AI Overview citations are not treated as standalone video results.

Example dataset item:

{
  "searchQuery": "sample topic",
  "searchUrl": "https://www.google.com/search?q=sample+topic&hl=en&gl=us",
  "searchLanguage": "en",
  "searchCountry": "us",
  "hasAiOverview": true,
  "aiOverviewTitle": "AI Overview",
  "aiOverviewText": "Answer text displayed by Google for this search.",
  "aiOverviewSources": [
    {
      "sourcePosition": 1,
      "sourceTitle": "Example Source",
      "sourceLink": "https://example.org/article",
      "sourceDomain": "example.org"
    }
  ],
  "followUpQueries": [],
  "peopleAlsoAskQuestions": [],
  "organicResults": [],
  "videoResults": [],
  "hasPageText": false
}

The Output tab shows the available result fields. The run output includes links to the dataset and run summary.

Limits and responsible use

Results depend on the query, locale, time, and modules Google makes available. More queries and rendered views can increase run time. This Actor reads public pages only and does not sign in or bypass access checks. It is not affiliated with Google.