SERP Scraper - Google, Bing & DuckDuckGo for LLM/RAG
Pricing
from $2.10 / 1,000 results
SERP Scraper - Google, Bing & DuckDuckGo for LLM/RAG
Scrape search engine results by keyword: organic results (title, URL, snippet, position) and Related Searches. Bing (default, reliable) plus DuckDuckGo and best-effort Google, all rendered in a hardened browser. Any country & language, pagination, no API key. Ideal for SEO, RAG and LLM grounding.
Pricing
from $2.10 / 1,000 results
Rating
0.0
(0)
Developer
Get Anything
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
0
Monthly active users
39 minutes ago
Last modified
Categories
Share
SERP Scraper — Google, Bing & DuckDuckGo for LLM / RAG
Scrape search engine results by keyword and get clean, structured data — no API key, any country and language. Built as the reliable "search" half of a RAG web browser: feed live search results into ChatGPT / Claude, do rank tracking, or mine keyword ideas.
Engines
| Engine | Reliability | Notes |
|---|---|---|
| DuckDuckGo (default) | ✅ High | Organic results rendered in a hardened browser. Recommended for production. |
| Bing | ⚠️ Best-effort | Often returns an empty page to cloud IPs. Try it, but use DuckDuckGo for reliable runs. |
| ⚠️ Best-effort | Google aggressively CAPTCHA-walls cloud/datacenter IPs. This engine renders the basic (gbv=1) page and retries on a fresh residential IP, but success is not guaranteed — use DuckDuckGo for reliable results. |
Why not Google-only? Google serves a
/sorryCAPTCHA to virtually all cloud IPs. No scraper can reliably beat that without a paid CAPTCHA-solving service, so this actor defaults to DuckDuckGo, which returns comparable results on every run.
What you get
One item per organic result:
| Field | Description |
|---|---|
query | The search query |
engine | Engine used (bing / duckduckgo / google) |
position | Rank on the SERP (1-based, across pages) |
title | Result title |
url | Destination URL |
displayedUrl | Breadcrumb URL shown by the engine (when available) |
domain | Hostname of the result |
snippet | Result snippet text |
relatedSearches | (first result only) related search phrases |
scrapedAt | ISO 8601 timestamp |
Input
{"queries": ["best web scraping tools", "apify alternatives"],"engine": "duckduckgo","maxResults": 20,"country": "us","language": "en","includeRelatedSearches": true,"maxRetries": 3,"proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }}
| Field | Type | Default | Description |
|---|---|---|---|
queries | array | — | One or more search queries (supports site:, intitle:, quotes) |
engine | string | duckduckgo | duckduckgo, bing, or google |
maxResults | integer | 10 | Organic results per query (paginates to reach it) |
country | string | us | Two-letter country code |
language | string | en | Two-letter language code |
includeRelatedSearches | boolean | true | Collect "Related searches" |
maxRetries | integer | 3 | Retries on a fresh IP when blocked (mainly Google) |
proxyConfiguration | object | Residential | Proxy — residential strongly recommended |
Use cases
- LLM / RAG grounding — feed live search results into ChatGPT / Claude pipelines.
- SEO & rank tracking — monitor rankings for target keywords across countries.
- Market & competitor research — capture Related Searches for content and keyword ideas.
- Content & lead discovery — harvest ranking pages for a topic at scale.
🤖 Use with Claude or ChatGPT (MCP)
Run this actor straight from Claude, ChatGPT, Cursor or any MCP client via the Apify MCP server. In Claude Desktop: Settings → Connectors → Add custom connector → https://mcp.apify.com, then ask it to search the web. Or expose just this tool:
{ "mcpServers": { "apify": { "url": "https://mcp.apify.com?tools=get_anything/serp-scraper" } } }
Full guide: Connect Apify actors to Claude & ChatGPT.
Notes
- Only public search-results-page data is collected.
- Residential proxy is strongly recommended for all engines and is what makes Google's retry logic effective.
Related actors
- LLM Web Scraper - Website to Markdown for RAG & ChatGPT
- AI Web Search Scraper - SERP & Page Content for LLM RAG
- Web Unblocker - Anti-Bot Scraper (Cloudflare, DataDome)
- YouTube Transcript Scraper - LLM-Ready Video Text
⭐ Like this Actor?
If it saved you time, please leave a quick rating. It helps other people find it, and it keeps it maintained. Found a bug or need a field? Open an issue and I'll respond quickly.
🤝 Support & custom scrapers
Need help, a missing field, or a scraper for a site that isn't covered? Email get.anything2026@gmail.com or message me on LinkedIn.
More scrapers for jobs, real estate, e-commerce and AI data: getanything-site.vercel.app