Bing Search Scraper & DuckDuckGo SERP API

Bing Search Scraper & DuckDuckGo Scraper (SERP)

Extract organic search results from Bing or DuckDuckGo. Get titles, URLs, snippets, and positions as flat JSON — no API key, no headless browser, no start fee.

Features

• Two engines — DuckDuckGo (default, via its HTML endpoint) or Bing. Switch with one parameter.
• Automatic pagination — fetches multiple pages (about 10 results each) until maxResults is reached or the engine has no more results
• Clean output — DuckDuckGo redirect wrappers resolved to the target URL, HTML entities decoded, empty string when a result has no snippet
• Retries and proxy — uses browser-like requests with exponential backoff on rate limits, server errors and timeouts. If a search returns nothing, the actor retries with a new Apify Proxy session (datacenter, then residential).

Input

Parameter	Type	Required	Default	Description
query	string	Yes	—	Search query (same as typing into the search box)
maxResults	integer	No	20	Maximum results to return (1–200)
engine	string	No	ddg	Search engine: ddg (DuckDuckGo) or bing

Output

Each result is a flat JSON object:

{
    "title": "Web Scraping Guide — Rate Limits and robots.txt",
    "url": "https://example.com/web-scraping-guide",
    "snippet": "An overview of web scraping practices including rate limiting, respecting robots.txt, and handling errors.",
    "position": 1,
    "engine": "ddg"
}

Field	Type	Description
title	string	Page title from the search result
url	string	URL of the result (DuckDuckGo redirect wrappers are resolved; Bing URLs are returned as Bing links them)
snippet	string	Description snippet shown in search results
position	integer	Rank position in search results (1-indexed)
engine	string	Which engine produced this result (ddg or bing)

Use Cases

• SEO monitoring — track your ranking for target keywords on Bing/DDG
• Competitor research — find who ranks for industry terms
• Content discovery — surface relevant pages for a topic
• Price comparison — search for products across the web
• Lead generation — find businesses in specific niches

Pricing

Pay-per-event, no start fee: $3.10 per 1,000 search results on the Apify Free plan, with lower prices on paid plans. Each result pushed to the dataset is one event.

Event	Free	Starter	Scale	Business	Enterprise
Search result (RESULT)	$3.10	$2.60	$2.30	$1.90	$1.90

Prices in USD per 1,000 events.

Cost examples (Free plan)

Scenario	Results	Cost
Quick lookup	10	$0.031
Standard search	20	$0.062
Deep research	100	$0.31
Bulk keywords (1K queries × 20 results)	20,000	$62.00

Limitations

• Organic results only — only standard web results are extracted (Bing b_algo blocks, DuckDuckGo result blocks); ads, rich snippets, news/image/video boxes and related searches are not returned.
• No JavaScript rendering — results come from the static HTML page; JS-rendered content is not included
• Rate limits — both engines may throttle frequent requests; the actor backs off and retries with a new proxy session, but a run that gets no results ends FAILED
• Regional results — results reflect the location of the IP used; there is no country/language option
• Pagination depth — both engines limit deep pagination; a large maxResults may return fewer items

Python 3.11, async httpx, BeautifulSoup + lxml, Apify SDK.

Related Actors

• Google News Scraper - News Articles by Keyword — Scrape Google News articles for any keyword: headlines, sources, publish dates, URLs and snippets.
• Google Trends Scraper - Interest Over Time & Related Queries — Scrape Google Trends: interest over time and related queries for up to 5 compared keywords, by country, time range and category.
• Tech Stack Detector - Website Technology Lookup — Detect the tech stack of a website: CMS, frameworks, analytics, CDN, payment and hosting technologies, from HTTP headers, HTML, scripts and cookies.