Multi-Engine SERP Scraper — Google, Bing, Yahoo, Yandex, Baidu
Pricing
from $3.40 / 1,000 serp results
Multi-engine SERP scraper: Google, Bing, Yahoo, DuckDuckGo, Ecosia, Yandex and Baidu in one run. Built for rank tracking and SERP comparison. Flat JSON row per result: title, URL, snippet, rank, page, engine, total results. Per-engine language/region and pagination. No API keys, no login.
Search queries to run, one per entry. Search operators like site: and filetype: work inline (e.g. annual report filetype:pdf site:example.com).
[ "best python web framework", "rust async runtime comparison"]Engines to query. Each result row is tagged with its engine. Bing, DuckDuckGo, Baidu and Yahoo are the most reliable from datacenter IPs; Google, Ecosia and Yandex may serve captchas without residential proxies (blocked engines are logged and skipped, never fail the run).
[ "bing", "duckduckgo"]Search as a desktop or mobile browser. Only Google and Bing actually change their response based on this (Bing: a mobile signal also helps avoid its bot-block page). Other engines accept the field but ignore it — see the Device support table in the README.
BCP-47 language code, e.g. en, de, pt-BR. Mapped per engine: Google hl/gl/lr, Bing mkt/setlang/cc, DuckDuckGo kl, Yandex lang: operator, Yahoo vl. Baidu and Ecosia do not take a language param.
Country hint. Two-letter code for Google (gl) and Bing (cc), e.g. de, gb. For Yandex pass a numeric lr region id (e.g. 213 = Moscow). Ignored by engines without a region param.
SERP pages to fetch per query per engine. Pagination uses each engine's native offset param (Google start, Bing first, DuckDuckGo s, Ecosia p, Yandex p, Baidu pn, Yahoo b). Stops early when a page is empty or blocked.
Results requested per page where the engine supports it (Google num, Bing count, Baidu rn, Yahoo n). 0 = engine default (~10, DuckDuckGo ~25).
Hard cap on total results pushed across all queries and engines. Each result returned is billed as one dataset item — see Pricing in the README. 0 = no cap (costs then scale with queries × engines × pages; use with care).
Include sponsored/ad results (marked with ad: true). Off = organic results only.
Optional proxy. Bing, DuckDuckGo, Baidu and Yahoo usually work without one. Google, Ecosia and Yandex serve captchas to datacenter IPs — use Apify residential proxy to unlock them.
How many searches to run at the same time. Higher is faster but more likely to get rate-limited or blocked by a search engine. Extra pages within a single search are always fetched one at a time with a short delay between them, regardless of this setting.