Google AI Overview & Gemini Search Scraper

Extract real-time Google AI Overviews (Gemini-powered search summaries), citations, linked sources, and SERP rankings at scale. Monitor your brand visibility in generative search and dominate Generative Engine Optimization (GEO).

---

What is Google AI Overview & Gemini Search Scraper?

When users search on Google, Google frequently generates an AI Overview powered by Gemini right above organic search results. These synthesized answers prominently cite selected websites, shaping search traffic and user decisions before anyone clicks on traditional organic listings.

The Google AI Overview & Gemini Search Scraper monitors and extracts these generative summaries. It captures the complete synthesized answer, every cited source link, domain attributions, and organic rankings for any keyword or country.

---

Why Monitor Google AI Overviews?

• Generative Engine Optimization (GEO / AEO): Track whether your brand or products appear in Google's AI-generated summaries for high-value search queries.
• Citation & Backlink Intelligence: Discover which authority websites Google cites as sources for industry topics.
• Competitor Tracking: Identify competitors who are being recommended by Gemini in AI summaries and reverse-engineer their content visibility.
• Comprehensive Coverage: Handle searches where AI Overviews are present, as well as searches where Google serves traditional results, ensuring zero data loss.
• Global Localization: Track AI Overviews across different countries and languages worldwide.

---

Key Features

• Gemini Synthesis Extraction: Captures full AI-generated answers, including formatted text, bullet lists, and paragraphs.
• Source & Citation Mapping: Extracts every external URL, domain name, snippet, and position cited inside the AI Overview.
• Smart Status Detection: Intelligently identifies whether an AI Overview was generated (GENERATED), not present for the query (NOT_PRESENT), or available via manual generation button (GENERATE_BUTTON_FOUND).
• Organic Fallback Results: Automatically collects organic SERP results (titles, URLs, snippets) alongside or as a fallback when AI Overviews are not triggered.
• Flexible Search Modes: Pass simple keyword queries or exact Google search URLs with custom search parameters.
• Export Anywhere: Download structured data in JSON, CSV, Excel, or consume it directly via API, Webhooks, or cloud integrations.

---

Input Configuration

Configure your search run through the visual dashboard or by passing a JSON payload:

Field	Type	Required	Description	Default
queries	Array of strings	No*	List of keywords or questions to search.	["what is generative engine optimization"]
searchUrls	Array of strings	No*	Direct Google search URLs for customized filtering.	[]
countryCode	String	No	Two-letter country code (e.g., US, GB, ES, DE, FR, MX, CA).	"US"
languageCode	String	No	Language code for search interface and results (e.g., en, es, fr, de).	"en"
includeOrganicResults	Boolean	No	Include organic search results alongside or as fallback.	true
maxOrganicResults	Integer	No	Maximum number of organic SERP results to extract per query.	10
proxyConfiguration	Object	No	Proxy settings. Residential proxies are strongly recommended.	Apify Residential
maxConcurrency	Integer	No	Maximum concurrent search tabs.	2

* Note: Provide at least one search query in queries or one URL in searchUrls.

Example Input

{
  "queries": [
    "what is generative engine optimization",
    "best crm software for startups"
  ],
  "countryCode": "US",
  "languageCode": "en",
  "includeOrganicResults": true,
  "maxOrganicResults": 5,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

Output Data Structure

Each processed search query yields a structured record in the dataset with comprehensive metadata:

• query: The searched keyword or question.
• searchUrl: The direct Google search URL executed.
• countryCode: Target country code.
• languageCode: Target language code.
• scrapedAt: ISO timestamp of the scraping run.
• hasAiOverview: true if a Gemini AI Overview was found; false otherwise.
• aiOverviewStatus:
  • GENERATED: AI Overview was successfully generated and captured.
  • NOT_PRESENT: Query did not trigger an AI Overview (common for navigational or transactional searches).
  • GENERATE_BUTTON_FOUND: An interactive prompt to generate an overview was displayed.
• aiOverview: (Present when hasAiOverview is true)
  • text: Plain text representation of the AI answer.
  • markdownText: Structured markdown text including bullet lists and sections.
  • citations: List of cited sources with title, url, domain, and position.
• citationsCount: Number of distinct cited sources.
• organicResults: List of organic search results (title, URL, domain, snippet, rank).

---

Example Output: Search with AI Overview

{
  "query": "what is generative engine optimization",
  "searchUrl": "https://www.google.com/search?q=what+is+generative+engine+optimization&hl=en&gl=us",
  "countryCode": "US",
  "languageCode": "en",
  "scrapedAt": "2026-11-02T12:00:00.000Z",
  "hasAiOverview": true,
  "aiOverviewStatus": "GENERATED",
  "overviewTextSummary": "Generative Engine Optimization (GEO) is the practice of optimizing digital content...",
  "citationsCount": 3,
  "aiOverview": {
    "text": "Generative Engine Optimization (GEO) is the practice of optimizing digital content to increase visibility in AI-generated search engines and answer engines such as Google AI Overviews and ChatGPT Search. Key strategies include citing authoritative sources, using direct language, and structuring data with clear schema markup.",
    "markdownText": "Generative Engine Optimization (GEO) is the practice of optimizing digital content to increase visibility in AI-generated search engines...\n\n- Cite authoritative sources\n- Use direct, factual language\n- Structure content with schema markup",
    "citations": [
      {
        "position": 1,
        "title": "GEO: Generative Engine Optimization Guide",
        "url": "https://example.com/insights/geo-guide",
        "domain": "example.com",
        "snippet": "Learn how generative engines choose sources and synthesize answers."
      },
      {
        "position": 2,
        "title": "Understanding AI Overviews in Search",
        "url": "https://industry-analytics.org/ai-search",
        "domain": "industry-analytics.org",
        "snippet": "An analysis of citation patterns in Google AI summaries."
      }
    ]
  },
  "organicResults": [
    {
      "position": 1,
      "title": "What is GEO? Complete Beginner's Guide",
      "url": "https://example.com/what-is-geo",
      "domain": "example.com",
      "snippet": "Discover the fundamentals of optimizing for AI search models."
    }
  ]
}

---

Example Output: Search without AI Overview

{
  "query": "buy wireless mechanical keyboard",
  "searchUrl": "https://www.google.com/search?q=buy+wireless+mechanical+keyboard&hl=en&gl=us",
  "countryCode": "US",
  "languageCode": "en",
  "scrapedAt": "2026-11-02T12:01:00.000Z",
  "hasAiOverview": false,
  "aiOverviewStatus": "NOT_PRESENT",
  "overviewTextSummary": null,
  "citationsCount": 0,
  "organicResults": [
    {
      "position": 1,
      "title": "Top Mechanical Keyboards 2026",
      "url": "https://techstore.com/keyboards",
      "domain": "techstore.com",
      "snippet": "Browse premium wireless mechanical keyboards with fast delivery."
    }
  ]
}

---

Best Practices & Proxy Tips

1. Use Residential Proxies: Google enforces strict bot detection and IP filtering. Selecting RESIDENTIAL proxies in the proxy configuration ensures continuous access and high success rates.
2. Targeting Accuracy: Match your countryCode with the location of your proxies for localized search results (e.g., US proxies with countryCode: "US").
3. Pacing: Keep concurrency between 1 and 3 concurrent requests to ensure smooth execution without rate limits.