Bing Search Scraper: Organic Results, Ads & Related Searches

Bing Search Scraper turns Bing results pages into clean JSON: organic results with the real destination URLs (Bing's bing.com/ck/a?... redirect links are decoded), sitelinks, text ads and shopping ads with landing pages, Bing's Copilot AI answer with its sources, People also ask, related searches, answer boxes and the total results estimate. Choose the market, device, date range and SafeSearch, and scrape up to 10 pages per query.

Most Bing scrapers charge for every organic result and return only titles, links and snippets. This one charges per results page ($0.002 for up to 10 organic results plus every SERP feature on the page), so SEO rank tracking costs a fraction of per-result pricing. It also checks every page: Bing quietly serves bots a degraded page with results for the wrong query, and the Actor detects that, retries in a fresh session and never charges for it.

What data can you get from Bing?

Section	Fields
Organic results	position (overall rank across pages), rankOnPage, title, url (real URL, decoded), displayUrl, domain, siteName, snippet, date (ISO) + dateText, sitelinks[{title, url, snippet}]
Text ads	placement (top / middle / bottom / sidebar), position, title, url (landing page, decoded), displayUrl, domain, advertiser, description, callouts, sitelinks[{title, url}]
Shopping ads	title, price, merchant, shipping, url, domain, placement
Copilot AI answer	aiAnswer.text (the generated summary) and aiAnswer.sources[{title, url}]
Answer box / knowledge panel	answerBox.type (fact / entity / answer), title, subtitle, answer, url
People also ask	question, sourceUrl, answer (usually null, because Bing loads answers on click)
Related searches	query, url
Page info	query, page, url of the results page, totalResults (number) + totalResultsText, marketDetected / regionDetected (what Bing actually used), spellingCorrection, counts of every section, duplicatesRemoved, warnings, scrapedAt

Every page item has the same keys (null or [] when a section isn't on the page).

Use cases

• SEO rank tracking on Bing. Track where your pages rank for 100s of keywords, by market and device, on a schedule. Positions are de-duplicated and numbered across pages (1-100).
• Competitor and ad intelligence. See who bids on your keywords, their ad copy, sitelinks, callouts and landing pages, and which products show in shopping ads.
• AI visibility (GEO). See what Bing's Copilot answer says for your topics and which sources it cites.
• Content research. Mine People also ask and related searches for content ideas and FAQs.
• Market research and lead lists of websites (domains, not personal data) for any topic and country.
• Feeding LLM agents and RAG pipelines with fresh web search results, via the API or MCP.

How to use it

1. Click Try for free.
2. Enter one or more Search queries (one per line).
3. Choose Results pages per query (up to 10; page 1 holds up to 10 organic results, often fewer on commercial queries, so use 2-3 pages for a top-10/top-20 ranking), the Market and, optionally, device, date range, SafeSearch or a site restriction.
4. Click Start and download the results as JSON, CSV, Excel or HTML, or read them through the API.

Input examples

Track the first three results pages for three keywords in the UK:

{
    "queries": ["project management software", "best crm for small business", "kanban board app"],
    "maxPagesPerQuery": 3,
    "market": "en-GB",
    "device": "desktop"
}

German results from the past week, one row per organic result for spreadsheets:

{
    "queries": ["künstliche intelligenz gesetz"],
    "maxPagesPerQuery": 2,
    "market": "de-DE",
    "freshness": "week",
    "outputFormat": "flat"
}

Mobile results through Apify Proxy (US IPs):

{
    "queries": ["pizza delivery", "running shoes"],
    "device": "mobile",
    "market": "en-US",
    "proxyConfiguration": { "useApifyProxy": true, "apifyProxyCountry": "US" }
}

Input	Default	Notes
queries	project management software, eiffel tower, best running shoes	Required. Exactly what you'd type into Bing; quoted phrases work. Up to 1,000 per run.
maxPagesPerQuery	1	1–10. Stops early (without charging) when Bing has no more new results.
market	en-US	41 markets (en-GB, de-DE, fr-FR, es-MX, ja-JP, ...). See Tips for how en-US works.
language	market's language	Bing interface language (setlang), e.g. en or pt-BR.
device	desktop	mobile scrapes the mobile results page (page 1 only).
safeSearch	moderate	strict or off.
freshness	any	day, week or month.
site	–	Adds site:example.com to every query (see Tips).
outputFormat	flat	flat: one item per results page plus one row per organic result (rows are free). page: page items only.
maxConcurrency	2	Queries scraped in parallel (1–3).
proxyConfiguration	no proxy	Apify Proxy (datacenter) recommended for more than ~100 pages per run. Residential is not supported.

Output example

One results page (real output, shortened):

{
    "id": "bing:page:1080cccf0aebe24b",
    "type": "page",
    "query": "project management software",
    "page": 1,
    "url": "https://www.bing.com/search?q=project+management+software&form=QBLH",
    "device": "desktop",
    "market": "en-US",
    "marketDetected": "en-US",
    "totalResults": 26800,
    "totalResultsText": "26,800 results",
    "organicCount": 3,
    "adsCount": 6,
    "organicResults": [
        {
            "position": 1,
            "rankOnPage": 1,
            "title": "10 Best Project Management Software Of 2026",
            "url": "https://www.forbes.com/advisor/business/software/best-project-management-software/",
            "displayUrl": "https://www.forbes.com › ... › software › best-project-management-software",
            "domain": "forbes.com",
            "siteName": "Forbes",
            "snippet": "Compare 22 providers of project management software based on pricing, features, integrations and customer …",
            "date": "2026-09-25",
            "dateText": "Sep 25, 2026",
            "sitelinks": [
                { "title": "Airtable Review", "url": "https://www.forbes.com/advisor/business/software/airtable-review/", "snippet": "Airtable is a cloud-based project management software that allows teams to store, organize …" }
            ]
        }
    ],
    "ads": [
        {
            "position": 1,
            "placement": "top",
            "title": "Asana for Project Management - asana.com - Get Started for Free",
            "url": "https://asana.com/uses/project-management?utm_campaign=...",
            "displayUrl": "https://asana.com › Asana › Manage-projects",
            "domain": "asana.com",
            "advertiser": "Asana",
            "description": "Millions of users in 190 countries trust Asana to help them manage work. ...",
            "callouts": null,
            "sitelinks": [{ "title": "Pricing & Plans", "url": "https://asana.com/pricing?utm_campaign=..." }]
        }
    ],
    "aiAnswer": {
        "text": "Project management software helps teams plan, track, and deliver projects efficiently, with top tools in 2026 including ClickUp, monday.com, Jira, and ProofHub. ...",
        "sources": [{ "title": "10 Best Project Management Software Of 2026", "url": "https://www.forbes.com/advisor/business/software/best-project-management-software/" }]
    },
    "answerBox": null,
    "peopleAlsoAsk": [],
    "relatedSearches": [
        { "query": "project management software comparison 2026", "url": "https://www.bing.com/search?q=project+management+software+comparison+2026&FORM=QSRE9" }
    ],
    "duplicatesRemoved": 0,
    "warnings": [],
    "scrapedAt": "2026-11-02T13:45:42.117Z"
}

The full sample (four pages and a flat row) is in samples/sample-output.json. In the Apify Console the dataset has ready-made tables: Results pages, Organic results, Ads, SERP features and Flat organic rows.

How much does it cost?

You pay per results page that is successfully scraped. There's no start fee and no subscription.

Event	Price	When
results-page	$0.002	One Bing results page saved to the dataset (up to ~10 organic results plus all ads, AI answer, People also ask and related searches on that page).

Never charged: degraded or challenge pages from Bing, pages with no results, pages where Bing only repeats earlier results, and flat per-result rows (outputFormat: "flat").

Worked examples:

• 1,000 results pages ≈ $2.00 (up to ~10,000 organic results).
• Daily rank tracking of 100 keywords, 3 pages each: 300 pages = $0.60 per day.
• One results page for one keyword = $0.002: up to 10 organic results (often fewer on commercial queries) with ads and SERP features included.

Set Maximum cost per run on the run to cap your spend; the Actor stops cleanly when the budget is reached.

Tips and limits (please read)

• Bing degrades automated traffic. Bing rarely blocks with an error. Instead it returns a normal-looking page whose results only match the first word of your query, or belong to someone else's search. The Actor imitates a person searching from the bing.com home page, which avoids this in our tests, and it checks every page (layout signals and whether results mention your query). Degraded pages are retried in a new session (up to 3 tries) and never charged. If many pages are degraded, enable Apify Proxy.
• Use Apify Proxy for more than ~100 pages per run. Each query then gets a fresh datacenter IP. Residential proxies are not supported (see the FAQ).
• Market and country. For every market except en-US the Actor applies the market explicitly (Bing's setmkt). For en-US, forcing the market made Bing return degraded pages in our tests, so the Actor lets Bing choose the market from the IP address and language. On US IPs that is the US market; from elsewhere you get English results localised to the IP's country. For true US results, use Apify Proxy with country US. marketDetected and regionDetected show what Bing actually used.
• site: searches. In our tests from datacenter IPs, Bing ignored site: restrictions for automated clients. The Actor detects this (results not on your domain) and doesn't charge, but the run may return nothing. If that happens, drop the restriction and filter by domain yourself.
• Mobile scrapes page 1 only, because Bing's mobile page loads more results by infinite scroll.
• Results per page vary. Bing decides how many organic results each page shows: up to 10, but commercial queries (and questions that get a Copilot answer) often get only 2–3 on page 1, because ads, shopping ads, the AI answer and other answer blocks fill the page. That is the same page a person sees, not a blocked one. Such pages carry a note in warnings, and RUN_SUMMARY counts them (pagesWithFewOrganicResults).
• No results are skipped between pages. Pagination follows Bing's own "next page" offset, so if page 1 shows 2 results, page 2 starts at result 3. Positions continue across pages, and repeats are removed (duplicatesRemoved).
• Result count. totalResults / totalResultsText appear only when Bing shows its "About N results" bar; Bing often hides it, and then they are null and the page's warnings says so.
• People also ask answers are loaded by Bing only when a question is clicked, so answer is usually null. The question and its source URL are included.
• Speed. Requests are spaced like a person browsing (1–3.5 s between pages, at most one request per second overall): roughly 1,000–2,000 pages per hour with the default 2 parallel queries.

FAQ

Is it legal to scrape Bing? This Actor only reads public search results pages, without logging in. It doesn't collect personal data such as e-mail addresses or phone numbers. You're responsible for how you use the data and for complying with applicable laws (e.g. copyright and GDPR) and Bing's terms. If in doubt, ask a lawyer.

Why did a query come back as "blocked"? Bing served degraded or challenge pages three times in a row for that query. Nothing was charged. Enable Apify Proxy and run it again. RUN_SUMMARY in the key-value store lists the reason per query.

Do I need a proxy? Can I use residential proxies? Usually no proxy is needed: the Actor works from Apify's own servers. For runs of more than ~100 pages, enable Proxy configuration with Apify Proxy's automatic (datacenter) proxies, so each query gets a fresh IP. Residential proxies are not supported: if you select the RESIDENTIAL group, the Actor logs a warning and uses Apify datacenter proxy instead. Your own proxy URLs (custom proxies) are used as given.

Why are there fewer than 10 organic results on a page? That's what Bing showed: on commercial queries, ads, shopping carousels and the AI answer push organic results down, and Bing's own "next page" link continues right after them. The page's warnings field says so. Scrape 2–3 pages per query for a full top-10 or top-20 ranking.

Can I get the real URL instead of bing.com/ck/a?...? Yes, always. Organic links, sitelinks, related searches and ad landing pages are decoded.

Does it support Bing News, Images or Videos? No, only web results pages.

Integrations

• API: start runs and read the dataset with the Apify API or the JavaScript / Python clients (Actor ID rjmacarthy/bing-search-scraper).
• Make, Zapier, n8n: use the Apify integrations to run the Actor and push results into Google Sheets, Airtable, Slack or your CRM.
• Schedules and webhooks: run daily for rank tracking and get notified when a run finishes.
• MCP / AI agents: add the Actor to Claude, Cursor or another MCP client through the Apify MCP server, and let agents search Bing.

Changelog

• 0.1 update (November 2026): Residential proxy groups fall back to Apify datacenter proxy with a warning. Default output is now flat (page items plus free per-result rows). Pagination follows Bing's own next-page offset (on pages where Bing shows fewer than 10 organic results, page 2 no longer skips results). Pages with fewer than 5 organic results or no result count are flagged in warnings, the run summary and the status message.
• 0.1 (November 2026): First release. Organic results with decoded URLs and sitelinks, text and shopping ads, Copilot AI answer, People also ask, related searches, answer box, 41 markets, mobile, date range, SafeSearch, site restriction, flat output, degraded-page detection with retries, migration-safe progress.

More scrapers by the same developer

• Google Ads Transparency Scraper
• AI Visibility Tracker: ChatGPT, Perplexity, Gemini, Claude
• Substack Scraper
• Telegram Channel Scraper
• ATS Jobs Scraper: Greenhouse, Lever, Ashby & Workday
• Dice Jobs Scraper

Browse all my Actors on my Apify Store profile.