SERP Scraper - Google, Bing & DuckDuckGo for LLM/RAG avatar

SERP Scraper - Google, Bing & DuckDuckGo for LLM/RAG

Pricing

from $2.10 / 1,000 results

Go to Apify Store
SERP Scraper - Google, Bing & DuckDuckGo for LLM/RAG

SERP Scraper - Google, Bing & DuckDuckGo for LLM/RAG

Scrape search engine results by keyword: organic results (title, URL, snippet, position) and Related Searches. Bing (default, reliable) plus DuckDuckGo and best-effort Google, all rendered in a hardened browser. Any country & language, pagination, no API key. Ideal for SEO, RAG and LLM grounding.

Pricing

from $2.10 / 1,000 results

Rating

0.0

(0)

Developer

Get Anything

Get Anything

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

4 days ago

Last modified

Share

SERP Scraper — Google, Bing & DuckDuckGo for LLM / RAG

Scrape search engine results by keyword and get clean, structured data — no API key, any country and language. Built as the reliable "search" half of a RAG web browser: feed live search results into ChatGPT / Claude, do rank tracking, or mine keyword ideas.

Engines

EngineReliabilityNotes
Bing (default)✅ HighHigh-quality organic results, rendered in a hardened browser. Recommended for production.
DuckDuckGo✅ HighPrivacy-friendly results, browser-rendered.
Google⚠️ Best-effortGoogle aggressively CAPTCHA-walls cloud/datacenter IPs. This engine renders the basic (gbv=1) page and retries on a fresh residential IP, but success is not guaranteed — use Bing for reliable results.

Why not Google-only? Google serves a /sorry CAPTCHA to virtually all cloud IPs. No scraper can reliably beat that without a paid CAPTCHA-solving service, so this actor defaults to Bing, which returns comparable results on every run.

What you get

One item per organic result:

FieldDescription
queryThe search query
engineEngine used (bing / duckduckgo / google)
positionRank on the SERP (1-based, across pages)
titleResult title
urlDestination URL
displayedUrlBreadcrumb URL shown by the engine (when available)
domainHostname of the result
snippetResult snippet text
relatedSearches(first result only) related search phrases
scrapedAtISO 8601 timestamp

Input

{
"queries": ["best web scraping tools", "apify alternatives"],
"engine": "bing",
"maxResults": 20,
"country": "us",
"language": "en",
"includeRelatedSearches": true,
"maxRetries": 3,
"proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }
}
FieldTypeDefaultDescription
queriesarray—One or more search queries (supports site:, intitle:, quotes)
enginestringbingbing, duckduckgo, or google
maxResultsinteger10Organic results per query (paginates to reach it)
countrystringusTwo-letter country code
languagestringenTwo-letter language code
includeRelatedSearchesbooleantrueCollect "Related searches"
maxRetriesinteger3Retries on a fresh IP when blocked (mainly Google)
proxyConfigurationobjectResidentialProxy — residential strongly recommended

Use cases

  • LLM / RAG grounding — feed live search results into ChatGPT / Claude pipelines.
  • SEO & rank tracking — monitor rankings for target keywords across countries.
  • Market & competitor research — capture Related Searches for content and keyword ideas.
  • Content & lead discovery — harvest ranking pages for a topic at scale.

🤖 Use with Claude or ChatGPT (MCP)

Run this actor straight from Claude, ChatGPT, Cursor or any MCP client via the Apify MCP server. In Claude Desktop: Settings → Connectors → Add custom connector → https://mcp.apify.com, then ask it to search the web. Or expose just this tool:

{ "mcpServers": { "apify": { "url": "https://mcp.apify.com?tools=get_anything/serp-scraper" } } }

Full guide: Connect Apify actors to Claude & ChatGPT.

Notes

  • Only public search-results-page data is collected.
  • Residential proxy is strongly recommended for all engines and is what makes Google's retry logic effective.