Google SERP Scraper v2.0 - Organic Results, Local Pack, Featured Snippets, Knowledge Panel, Sitelinks, Shopping Ads & PAA Answers

Scrape Google search results for SEO analysis, keyword research, and competitive intelligence. Extract organic results with sitelinks and emphasized keywords, featured snippets, People Also Ask with click-expanded answers, Knowledge Panels with social profiles, shopping/product ads, top and bottom text ads, local pack, and related searches. Multi-page pagination (up to 10 pages per query), multi-location, multi-device, and 20+ language support. CAPTCHA detection with configurable retries. Powered by Camoufox stealth browser. Essential for rank tracking, SERP feature analysis, and content strategy.

What's New in v2.0

• Multi-Page Pagination - Scrape up to 10 Google result pages per query using maxPagesPerQuery (page 2 = results 11-20, etc.)
• Sitelinks Extraction - Both expanded (large format with descriptions) and inline (compact) sitelinks under organic results
• PAA Answer Extraction - Click-to-expand People Also Ask answers with full answer text, source URL, and source domain
• Knowledge Panel - Full extraction including title, subtitle, description, entity attributes (founded, CEO, headquarters, etc.), social profile links, and images
• Shopping / Product Ads - Product carousel extraction with title, price, merchant, rating, review count, and image URL
• Emphasized Keywords - Extract <em> and <b> tags from descriptions showing which exact keywords Google highlights for your query
• Top vs Bottom Ad Split - Ads now include placement: 'top' | 'bottom' so you can see where competitors' ads appear
• CAPTCHA Detection - Automatic detection when Google blocks with CAPTCHA; results include captchaDetected: true flag and the request retries with a different proxy
• Configurable Retries - maxRetries parameter (1-5, default 3) for controlling retry behavior on failures and CAPTCHAs
• Expanded Language Support - Added Dutch (nl), Russian (ru), Polish (pl), Swedish (sv), Danish (da), Norwegian (no), Finnish (fi), Turkish (tr), Thai (th), and Vietnamese (vi) - now 20 languages total
• Camoufox Stealth Browser - Uses Camoufox fingerprint-resistant browser with automatic fallback to standard Firefox
• Per-Page Pricing - Now charged per SERP page scraped at $0.05/page (only successful scrapes are charged; CAPTCHAs are free)

Features

• Organic Results - Title, URL, displayed URL, description, position, sitelinks, and emphasized keywords for every result
• Sitelinks - Expanded sitelinks (with descriptions) and inline sitelinks extracted per organic result
• Emphasized Keywords - Bolded/highlighted words from descriptions showing Google's exact keyword matching
• Local Pack - Map pack businesses with name, address, rating, review count, phone, and category
• Featured Snippets - Position 0 answer boxes with content, source URL, source title, and type (paragraph, list, or table)
• People Also Ask - Questions with click-expanded full answers, source URLs, and source domains
• Knowledge Panel - Entity info, description with source, attributes (Founded, CEO, Headquarters, etc.), social profiles
• Shopping / Product Ads - Product title, price, merchant, URL, rating, review count, and image
• Paid Text Ads - Ad copy, display URL, description, and top vs bottom placement
• Related Searches - Google's suggested related search queries
• Multi-Page Pagination - Scrape 1-10 pages per query using &start= parameter
• Multi-Location - Any geographic location worldwide via UULE encoding
• Device Targeting - Desktop and mobile results (different SERPs)
• Language Support - 20 languages: en, es, fr, de, it, pt, ja, zh, ko, ar, nl, ru, pl, sv, da, no, fi, tr, th, vi
• CAPTCHA Detection - Automatic detection with retry on different proxy
• Configurable Retries - 1-5 retry attempts per request
• Anti-Detection - Camoufox stealth browser + GOOGLE_SERP residential proxies
• No Login Required - Works with public Google search data
• Demo Mode - Test with realistic sample data before going live (free)
• Webhook Delivery - Real-time results delivered to your webhook as each query completes

Who Should Use This Actor?

SEO Agencies & Consultants

Track client keyword rankings across multiple pages, monitor SERP feature opportunities (featured snippets, Knowledge Panels, sitelinks), and build competitive analysis reports. Schedule daily or weekly rank tracking runs.

Content Marketing Teams

Discover featured snippet opportunities, extract full PAA answers for content ideas, analyze emphasized keywords to understand Google's matching, and map user intent behind target keywords.

PPC Managers

Research competitor ad copy with top vs bottom placement tracking, identify which keywords trigger shopping ads, and analyze ad positioning strategies across multiple SERP pages.

Local SEO Specialists

Monitor local pack rankings, track map pack positions with ratings and review counts, and compare local results across different locations.

E-Commerce Teams

Track product keyword rankings, monitor shopping/product ad placements with pricing data, and analyze competitor SERP presence across pages 1-10.

Market Research Analysts

Analyze search landscapes for market entry, extract Knowledge Panel data for entity research, understand information demand patterns, and track industry trends.

Quick Start

Demo Mode (Free Test)

{
  "demoMode": true
}

Basic Keyword Search

{
  "queries": ["best crm software", "project management tools"],
  "location": "United States",
  "language": "en",
  "device": "desktop",
  "demoMode": false
}

Multi-Page Deep Scrape

{
  "queries": ["best crm software"],
  "location": "United States",
  "maxPagesPerQuery": 5,
  "maxResults": 10,
  "demoMode": false
}

Scrapes pages 1-5 (results 1-50) for each query.

Local Search (with Location)

{
  "queries": ["pizza near me", "plumber"],
  "location": "New York, NY, USA",
  "language": "en",
  "includeLocalPack": true,
  "demoMode": false
}

Full SERP Analysis

{
  "queries": ["how to start a business"],
  "location": "United States",
  "includeAds": true,
  "includeShoppingAds": true,
  "includePAA": true,
  "expandPAAAnswers": true,
  "includeFeaturedSnippet": true,
  "includeKnowledgePanel": true,
  "includeRelatedSearches": true,
  "includeSitelinks": true,
  "includeEmphasizedKeywords": true,
  "maxPagesPerQuery": 3,
  "maxResults": 10,
  "demoMode": false
}

Input Parameters

Parameter	Type	Default	Description
Search Settings
queries	array	["best pizza near me"]	Search keywords to scrape (one per line or comma-separated)
location	string	United States	Geographic location for localized results (e.g., "New York, NY, USA")
language	string	en	Language code: en, es, fr, de, it, pt, ja, zh, ko, ar, nl, ru, pl, sv, da, no, fi, tr, th, vi
device	string	desktop	Device type: desktop or mobile
maxResults	integer	10	Number of organic results to extract per page (1-100)
maxPagesPerQuery	integer	1	Number of Google result pages to scrape per query (1-10). Page 2 = results 11-20, etc.
SERP Features
includeAds	boolean	false	Extract paid text ads with top/bottom placement tracking
includeShoppingAds	boolean	false	Extract product/shopping ads with prices, ratings, and merchant info
includePAA	boolean	true	Extract People Also Ask questions
expandPAAAnswers	boolean	true	Click each PAA question to extract the full answer text and source URL (slower but more valuable)
includeLocalPack	boolean	true	Extract local business results (map pack) with ratings, reviews, categories
includeFeaturedSnippet	boolean	true	Extract featured snippet content (paragraph, list, or table type)
includeKnowledgePanel	boolean	true	Extract Knowledge Panel data: entity info, attributes, social profiles
includeRelatedSearches	boolean	true	Extract related search suggestions at bottom of SERP
includeSitelinks	boolean	true	Extract sitelinks (sub-links) under organic results with titles, URLs, and descriptions
includeEmphasizedKeywords	boolean	true	Extract bolded/emphasized words from descriptions showing exact keyword matches
Advanced
maxRetries	integer	3	Maximum retry attempts per request when CAPTCHA or errors occur (1-5)
proxyConfiguration	object	GOOGLE_SERP	Proxy settings. GOOGLE_SERP group recommended for best results
demoMode	boolean	true	Return realistic sample data without actual scraping (free, no proxy usage)
webhookUrl	string	-	Optional webhook URL to receive results in real-time as each query completes

Output Format

Each SERP page scraped produces one result object:

{
  "query": "best pizza near me",
  "page": 1,
  "location": "New York, NY, USA",
  "language": "en",
  "device": "desktop",
  "totalResults": "About 458,000,000 results",
  "searchTime": "(0.42 seconds)",
  "organicResults": [
    {
      "position": 1,
      "title": "Best Pizza in NYC - Top Rated Pizzerias",
      "url": "https://example.com/best-pizza-nyc",
      "displayedUrl": "example.com > food > pizza",
      "description": "Discover the best pizza places in New York City with our curated guide...",
      "emphasizedKeywords": ["best pizza", "pizza places", "New York City"],
      "sitelinks": [
        {
          "title": "Manhattan Locations",
          "url": "https://example.com/best-pizza-nyc/manhattan",
          "description": "Top rated pizzerias in Manhattan"
        },
        {
          "title": "Brooklyn Locations",
          "url": "https://example.com/best-pizza-nyc/brooklyn"
        }
      ]
    }
  ],
  "ads": [
    {
      "position": 1,
      "title": "Order Pizza Delivery - 50% Off First Order",
      "url": "https://pizzadelivery.com/order",
      "displayedUrl": "https://pizzadelivery.com/order",
      "description": "Hot, fresh pizza delivered to your door in 30 minutes...",
      "adLabel": "Sponsored",
      "placement": "top"
    },
    {
      "position": 2,
      "title": "Pizza Catering NYC - Large Party Orders",
      "url": "https://partypizza.com/catering",
      "displayedUrl": "https://partypizza.com/catering",
      "description": "Catering for events of all sizes...",
      "adLabel": "Sponsored",
      "placement": "bottom"
    }
  ],
  "shoppingResults": [
    {
      "position": 1,
      "title": "Ooni Koda 16 Pizza Oven",
      "price": "$399.00",
      "source": "Amazon",
      "url": "https://www.amazon.com/ooni-koda-16",
      "rating": 4.7,
      "reviewCount": 3842,
      "imageUrl": "https://encrypted-tbn0.gstatic.com/shopping?q=..."
    }
  ],
  "peopleAlsoAsk": [
    {
      "question": "What is the best pizza place in NYC?",
      "answer": "Joe's Pizza is consistently rated as one of the best pizza places in NYC, known for their classic New York-style slices since 1975...",
      "answerSource": "example.com",
      "answerUrl": "https://example.com/best-pizza-nyc"
    },
    {
      "question": "Is NYC pizza better than Chicago pizza?",
      "answer": "New York-style and Chicago-style pizza are fundamentally different...",
      "answerSource": "foodnetwork.com",
      "answerUrl": "https://www.foodnetwork.com/pizza-styles"
    }
  ],
  "localPack": [
    {
      "name": "Joe's Pizza",
      "address": "7 Carmine St, New York, NY",
      "rating": 4.5,
      "reviewCount": 2847,
      "phone": "(212) 555-1234",
      "category": "Pizza restaurant"
    }
  ],
  "featuredSnippet": {
    "type": "paragraph",
    "content": "According to local reviews, the best pizza in NYC can be found at Joe's Pizza, Di Fara Pizza, and Lucali...",
    "sourceUrl": "https://example.com/pizza-guide",
    "sourceTitle": "Complete Guide to NYC Pizza"
  },
  "knowledgePanel": {
    "title": "Pizza",
    "subtitle": "Dish",
    "description": "Pizza is a dish of Italian origin consisting of a usually round, flat base of leavened wheat-based dough topped with tomatoes, cheese, and often various other ingredients.",
    "descriptionSource": "Wikipedia",
    "descriptionUrl": "https://en.wikipedia.org/wiki/Pizza",
    "imageUrl": "https://encrypted-tbn0.gstatic.com/images?q=...",
    "attributes": {
      "Region of origin": "Italy",
      "Main ingredients": "Dough, sauce, cheese",
      "Course": "Main course"
    },
    "socialProfiles": [
      {
        "platform": "Instagram",
        "url": "https://www.instagram.com/example"
      }
    ]
  },
  "relatedSearches": [
    "best pizza manhattan",
    "best pizza brooklyn",
    "best pizza near me open now",
    "best pizza delivery nyc"
  ],
  "scrapedAt": "2026-02-22T10:30:00.000Z",
  "captchaDetected": false
}

Notes on the output:

• page indicates which Google results page (1 = first page, 2 = second page, etc.)
• position on organic results uses absolute numbering across pages (page 2 starts at 11 if maxResults is 10)
• emphasizedKeywords is an array of the exact words Google bolds in the result description
• sitelinks can be expanded (with descriptions) or inline (title + URL only)
• ads include placement of either top or bottom to show where on the SERP they appeared
• shoppingResults may include rating, reviewCount, and imageUrl when available
• peopleAlsoAsk answers are only populated when expandPAAAnswers: true (requires clicking each question)
• knowledgePanel attributes vary by entity type (companies have CEO/Founded, people have Born/Occupation, etc.)
• captchaDetected flags whether Google served a CAPTCHA instead of results (the request will auto-retry)
• SERP features like local pack, featured snippet, Knowledge Panel, ads, and shopping results typically only appear on page 1

Pricing (Pay-Per-Event)

Event	Description	Price
serp_scraped	Per SERP page successfully scraped	$0.05

Example costs:

• 10 keywords, 1 page each: 10 pages x $0.05 = $0.50
• 10 keywords, 3 pages each: 30 pages x $0.05 = $1.50
• 50 keywords, 1 page each: 50 pages x $0.05 = $2.50
• 100 keywords, 1 page each: 100 pages x $0.05 = $5.00
• 100 keywords, 5 pages each: 500 pages x $0.05 = $25.00
• Demo mode: $0.00 (always free)
• CAPTCHA-blocked pages: $0.00 (not charged)

Understanding SERP Elements

What are "Sitelinks"? Sub-links that appear under an organic result, showing important pages within that site. They come in two formats: expanded sitelinks (large format with descriptions, usually 4-6 links) and inline sitelinks (compact, one-line links). Google shows sitelinks for authoritative, well-structured sites.

What are "Emphasized Keywords"? The words Google bolds in result descriptions (<em> and <b> tags). These show exactly which words from your query Google matched in the result. Valuable for understanding keyword relevance and how Google interprets queries.

What is a "Knowledge Panel"? The information box on the right side of desktop SERPs (or top on mobile) showing entity details sourced from Google's Knowledge Graph. Includes description, attributes (Founded, CEO, Headquarters for companies), social profile links, and images. Appears for well-known entities like companies, people, places, and topics.

What is the "Local Pack"? The map with 3 business listings that appears for local searches like "pizza near me". Includes business name, rating, address, phone, and category.

What is "People Also Ask" (PAA)? The expandable question boxes Google shows. With expandPAAAnswers: true, this actor clicks each question to extract the full answer text and source URL. Great for content ideas and understanding user intent.

What is a "Featured Snippet"? The highlighted answer box at position 0, pulled from a website. Can be paragraph, list, or table format. Highly coveted for SEO.

What are "Shopping Ads"? Product cards in the carousel at the top of commercial SERPs showing product image, title, price, merchant, and ratings. These are paid product listing ads (PLAs).

Common Scenarios

Scenario 1: Daily Rank Tracking (Multi-Page)

{
  "queries": ["crm software", "best crm", "crm comparison", "crm reviews"],
  "location": "United States",
  "device": "desktop",
  "maxResults": 10,
  "maxPagesPerQuery": 5,
  "includeSitelinks": false,
  "includeEmphasizedKeywords": false,
  "includeAds": false,
  "demoMode": false
}

Scrape 5 pages per keyword (top 50 results) for comprehensive rank tracking. Disable features you don't need to speed up runs.

Scenario 2: Featured Snippet & PAA Content Research

{
  "queries": ["what is crm", "how to choose crm", "crm vs erp"],
  "includeFeaturedSnippet": true,
  "includePAA": true,
  "expandPAAAnswers": true,
  "includeKnowledgePanel": true,
  "demoMode": false
}

Extract full PAA answers and featured snippets to discover content opportunities and understand what Google considers authoritative answers.

Scenario 3: Local SEO Monitoring

{
  "queries": ["plumber", "emergency plumber", "water heater repair"],
  "location": "Dallas, TX, USA",
  "includeLocalPack": true,
  "demoMode": false
}

Track local pack positions for your business and competitors.

Scenario 4: PPC & Shopping Ad Research

{
  "queries": ["buy crm software", "crm pricing", "crm free trial"],
  "includeAds": true,
  "includeShoppingAds": true,
  "demoMode": false
}

Analyze competitor ad copy with top vs bottom placement, and discover shopping ad opportunities with pricing data.

Scenario 5: Competitor Sitelink & SERP Dominance Analysis

{
  "queries": ["hubspot", "salesforce", "zoho crm"],
  "includeSitelinks": true,
  "includeKnowledgePanel": true,
  "includeEmphasizedKeywords": true,
  "demoMode": false
}

Analyze which competitors earn sitelinks and Knowledge Panels, and see which keywords Google emphasizes in their results.

Scenario 6: Multi-Language International SEO

{
  "queries": ["mejor software crm", "logiciel crm", "crm software"],
  "language": "es",
  "location": "Spain",
  "maxPagesPerQuery": 3,
  "demoMode": false
}

Track rankings across different languages and locations for international SEO campaigns.

Webhook & Automation Integration

Zapier / Make.com / n8n

1. Create a webhook trigger in your automation platform
2. Copy the webhook URL to webhookUrl
3. Route results to Google Sheets, CRM, Airtable, etc.

Popular automations:

• Rankings -> Google Sheets (daily rank tracking dashboard)
• Position changes -> Slack alert (rank drop/gain notifications)
• Featured snippets -> Airtable (content opportunity database)
• Local pack data -> CRM (local SEO client reporting)
• PAA answers -> Content calendar (topic ideas with ready-made answers)
• Knowledge Panel data -> Entity research database

Apify Scheduled Runs

Schedule daily or weekly runs for consistent rank tracking data. Results are delivered to webhooks in real-time as each SERP page completes.

FAQ

Q: Do I need a Google account?

A: No. This scraper uses public Google search results. No login required.

Q: Why do results differ from my browser?

A: Google personalizes results based on your account, location, and search history. This scraper returns non-personalized results. Specify a location to get location-specific results.

Q: Can I track mobile vs desktop rankings?

A: Yes. Set device to mobile or desktop. Google shows different results for each device type.

Q: How many total results can I get per query?

A: Up to 100 results per page x 10 pages = 1,000 results per query. The recommended setup is maxResults: 10 with maxPagesPerQuery set to however deep you need (e.g., 5 pages = top 50 results).

Q: Can I search in other languages?

A: Yes. 20 languages are supported: English (en), Spanish (es), French (fr), German (de), Italian (it), Portuguese (pt), Japanese (ja), Chinese (zh), Korean (ko), Arabic (ar), Dutch (nl), Russian (ru), Polish (pl), Swedish (sv), Danish (da), Norwegian (no), Finnish (fi), Turkish (tr), Thai (th), and Vietnamese (vi).

Q: What happens when Google shows a CAPTCHA?

A: The actor automatically detects CAPTCHAs, marks the result with captchaDetected: true, and retries the request with a different proxy (up to maxRetries times). CAPTCHA-blocked results are not charged.

Q: What is the difference between expandPAAAnswers: true and false?

A: When true, the actor clicks each People Also Ask question to expand it and extract the full answer text, source URL, and source domain. When false, only the question text is extracted (faster but less data). Answer expansion is valuable for content strategy research.

Q: Are sitelinks always available?

A: No. Google only shows sitelinks for authoritative, well-structured sites. Most results do not have sitelinks. When they appear, they come in two formats: expanded (large, with descriptions) and inline (compact, title + URL only).

Q: How does multi-page pagination work?

A: Set maxPagesPerQuery to the number of Google result pages you want. Each page is a separate request with &start= parameter. Page 1 = results 1-10, page 2 = results 11-20, etc. (assuming maxResults: 10). Each page counts as one serp_scraped event for billing.

Common Problems & Solutions

"Results don't match my browser"

• Google personalizes results based on account, location, and history
• This scraper returns non-personalized results
• Specify a location for location-specific results

"No local pack returned"

• Not all searches trigger a local pack
• Try more specific location queries like "plumber miami" instead of "plumber"
• Local pack is only shown for queries with local intent

"CAPTCHA detected on many queries"

• Increase maxRetries to 5 for more retry attempts
• Use the default GOOGLE_SERP proxy group for best results
• Reduce the number of concurrent queries if running very large batches
• CAPTCHA-blocked results are not charged

"PAA answers are empty"

• Set expandPAAAnswers: true to click-expand each question
• Some PAA questions may not have expandable answers
• PAA sections typically only appear on page 1

"Demo data showing"

• Set demoMode: false to scrape real Google results

---

Support

• Actor Arsenal: Full Actor Catalog
• Developer: John Rippy

---

Built by John Rippy | Actor Arsenal