Free Google Search Results (SERP) Scraper - Only $0.25 per 1,000 results

Ultra-fast Google Search scraper with 1000 free results/month. Extract comprehensive SERP data including rank, title, snippet, URL, domain, favicon, and deeplinks. 50 concurrent requests for maximum performance.

Features

• Bulk Keyword Scraping: Process up to 100 keywords in a single run
• Ultra-Fast Performance: 50 concurrent HTTP requests for maximum speed
• High-Volume Scraping: Can fetch 1000+ results in seconds
• Concurrent Processing: HTTP requests and HTML parsing in parallel
• Comprehensive Data: Rank, domain, URL, title, snippet, favicon, deeplinks, keyword
• Global Coverage: Support for 176 countries with automatic domain mapping
• Scalable Pricing: Free tier (1000/month) + Pay-per-use ($0.25/1000)

Input

Field	Type	Required	Description	Default
queries	Array	Yes	Array of search queries (1-100 keywords)	-
country	String	No	Country code (us, nl, de, uk, jp, au, etc.)	us
cr	String	No	Country restrict parameter (e.g., countryDE)	-
maxResults	Integer	No	Maximum results per query	10

Input Examples

Multiple Keywords (Bulk Scraping)

{
  "queries": [
    "artificial intelligence",
    "machine learning",
    "deep learning"
  ],
  "country": "us",
  "maxResults": 10
}

Single Keyword

{
  "queries": ["koffie"],
  "country": "de",
  "maxResults": 10
}

With Country Restrict

{
  "queries": ["machine learning"],
  "country": "nl",
  "cr": "countryDE",
  "maxResults": 20
}

Output

Each result contains:

Field	Type	Description
rank	Integer	SERP position (1, 2, 3, ...)
domain	String	Display domain name
url	String	Full result URL
title	String	Page title
snippet	String	Meta description/snippet
favicon	String	Favicon URL or base64 data URI
deeplink	String	Breadcrumb path (e.g., "domain.com › page › subpage")
keyword	String	The search query that returned this result

Output Example

[
  {
    "rank": 1,
    "domain": "Pons",
    "url": "https://de.pons.com/%C3%BCbersetzung/niederl%C3%A4ndisch-deutsch/koffie",
    "title": "KOFFIE - Niederländisch-Deutsch Übersetzung",
    "snippet": "Übersetzung Niederländisch-Deutsch für KOFFIE im PONS Online-Wörterbuch nachschlagen! Gratis Vokabeltrainer, Verbtabellen, Aussprachefunktion.",
    "favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAMAAA...",
    "deeplink": "https://de.pons.com › übersetzung",
    "keyword": "koffie"
  },
  {
    "rank": 2,
    "domain": "Kaffee Henk",
    "url": "https://www.kaffeehenk.de/?srsltid=AfmBOorVJOb3RWHj67_FdYafeEGVWn1igSwK7KAWW8NlsLygRP6elS4g",
    "title": "Größtes und günstigstes Kaffeesortiment in Europa!",
    "snippet": "Hier finden Sie die besten kaffee wie Melitta, Jacobs, Tchibo, Dallmayr, Segafredo, Lavazza, Eduscho und Mövenpick.",
    "favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAMAAA...",
    "deeplink": "https://www.kaffeehenk.de",
    "keyword": "koffie"
  },
  {
    "rank": 3,
    "domain": "Langenscheidt",
    "url": "https://de.langenscheidt.com/niederlaendisch-deutsch/koffie",
    "title": "Niederländisch-Deutsch Übersetzung für \"koffie\"",
    "snippet": "Übersetzung für 'koffie' im kostenlosen Niederländisch-Deutsch Wörterbuch von LANGENSCHEIDT – mit Beispielen, Synonymen und Aussprache.",
    "favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAMAAA...",
    "deeplink": "https://de.langenscheidt.com › niederlaendisch-deutsch",
    "keyword": "koffie"
  }
]

Supported Countries

The scraper supports 176 countries with automatic Google domain mapping:

Africa (46 countries)

Algeria (dz), Angola (ao), Benin (bj), Botswana (bw), Burkina Faso (bf), Burundi (bi), Cameroon (cm), Cape Verde (cv), Central African Republic (cf), Chad (td), Congo DRC (cd), Congo (cg), Côte d'Ivoire (ci), Djibouti (dj), Egypt (eg), Ethiopia (et), Gabon (ga), Gambia (gm), Ghana (gh), Guinea-Bissau (gw), Kenya (ke), Lesotho (ls), Libya (ly), Madagascar (mg), Malawi (mw), Mali (ml), Mauritius (mu), Morocco (ma), Mozambique (mz), Namibia (na), Niger (ne), Nigeria (ng), Rwanda (rw), São Tomé and Príncipe (st), Senegal (sn), Seychelles (sc), Sierra Leone (sl), Somalia (so), South Africa (za), Tanzania (tz), Togo (tg), Tunisia (tn), Uganda (ug), Zambia (zm), Zimbabwe (zw)

Americas (26 countries)

Argentina (ar), Bahamas (bs), Bolivia (bo), Brazil (br), Canada (ca), Chile (cl), Colombia (co), Costa Rica (cr), Cuba (cu), Dominica (dm), Dominican Republic (do), Ecuador (ec), El Salvador (sv), Guatemala (gt), Guyana (gy), Haiti (ht), Honduras (hn), Jamaica (jm), Mexico (mx), Nicaragua (ni), Panama (pa), Paraguay (py), Peru (pe), Trinidad and Tobago (tt), United States (us), Uruguay (uy), Venezuela (ve)

Asia (46 countries)

Afghanistan (af), Armenia (am), Azerbaijan (az), Bahrain (bh), Bangladesh (bd), Bhutan (bt), Brunei (bn), Cambodia (kh), China (cn), Georgia (ge), Hong Kong (hk), India (in), Indonesia (id), Iraq (iq), Israel (il), Japan (jp), Jordan (jo), Kazakhstan (kz), South Korea (kr), Kuwait (kw), Kyrgyzstan (kg), Laos (la), Lebanon (lb), Malaysia (my), Maldives (mv), Mongolia (mn), Myanmar (mm), Nepal (np), Oman (om), Pakistan (pk), Palestine (ps), Philippines (ph), Qatar (qa), Saudi Arabia (sa), Singapore (sg), Sri Lanka (lk), Taiwan (tw), Tajikistan (tj), Thailand (th), Timor-Leste (tl), Turkey (tr), Turkmenistan (tm), United Arab Emirates (ae), Uzbekistan (uz), Vietnam (vn), Yemen (ye)

Europe (49 countries)

Albania (al), Andorra (ad), Austria (at), Belarus (by), Belgium (be), Bosnia and Herzegovina (ba), Bulgaria (bg), Croatia (hr), Cyprus (cy), Czech Republic (cz), Denmark (dk), Estonia (ee), Finland (fi), France (fr), Germany (de), Gibraltar (gi), Greece (gr), Guernsey (gg), Hungary (hu), Iceland (is), Ireland (ie), Isle of Man (im), Italy (it), Jersey (je), Kosovo (xk), Latvia (lv), Liechtenstein (li), Lithuania (lt), Luxembourg (lu), North Macedonia (mk), Malta (mt), Moldova (md), Montenegro (me), Netherlands (nl), Norway (no), Poland (pl), Portugal (pt), Romania (ro), Russia (ru), San Marino (sm), Serbia (rs), Slovakia (sk), Slovenia (si), Spain (es), Sweden (se), Switzerland (ch), Ukraine (ua), United Kingdom (uk), Vatican City (va)

Oceania (9 countries)

Australia (au), Fiji (fj), Kiribati (ki), Nauru (nr), New Zealand (nz), Papua New Guinea (pg), Samoa (ws), Tonga (to), Vanuatu (vu)

Note: Special domains are automatically handled (e.g., Indonesia uses google.co.id, UK uses google.co.uk, USA uses google.com).

Pricing

Free Tier

• 1,000 results per month - Free forever
• Perfect for small-scale projects and testing
• No credit card required
• Automatic monthly reset

Pay-Per-Use Tier

• $0.25 per 1,000 results - Cheapest in the market
• No monthly limits
• Only pay for what you use
• Ideal for high-volume scraping
• Example costs:
  • 1,000 results = $0.25
  • 10,000 results = $2.50
  • 100,000 results = $25.00

When free tier limit is reached, the actor will prompt you to upgrade to pay-per-use pricing.

How It Works

The scraper uses high-performance concurrent scraping:

1. Session Initialization: Establishes cookies with Google
2. Parallel Fetching: Makes up to 50 concurrent requests to WRGA endpoint
3. Concurrent Parsing: Parses all HTML responses in parallel using thread pool
4. Negative Search: If more results needed, performs additional concurrent fetches excluding top domains
5. Deduplication: Ensures unique results and assigns continuous ranking

Concurrency Control:

• Semaphore limits: 50 concurrent requests
• Connection pooling: 50 keepalive, 100 max connections
• All operations are non-blocking with asyncio

Performance

• Small batches: ~1 second for 10 results
• Medium batches: ~3-5 seconds for 100 results
• Large batches: ~10-15 seconds for 1000 results
• Concurrency: 50 parallel HTTP requests + concurrent parsing
• Connection pooling: 50 keepalive connections for efficiency
• Retry logic: Exponential backoff with 3 attempts per request

Technical Details

• Parser: lxml with XPath selectors
• HTTP Client: httpx with async support
• Timeouts: 5s connect, 60s read
• Retry Logic: Exponential backoff (max 3 attempts)
• Session Management: Cookie-based session initialization

Use Cases

• SEO monitoring and competitor analysis
• SERP position tracking
• Market research and trend analysis
• Content gap analysis
• Brand mention monitoring
• Academic research

Limitations

• Google may rate-limit heavy usage
• Some results may have generic favicons
• Deeplinks may fall back to full URLs for certain sites
• Requires active internet connection

License

MIT License - free to use for commercial and non-commercial projects.

Privacy

This actor does not store any personal data. All scraped data is publicly available on Google Search.