Baidu Search Scraper
Pricing
from $1.99 / 1,000 search results
Scrape organic search results from Baidu, China's leading search engine. Extracts page titles, URLs, snippets, source sites, dates, knowledge cards, and related searches. Supports configurable result limits with proxy support.
userAgent was being passed at the top level of PlaywrightCrawler options, which is no longer valid in Crawlee 3.x. Moved into launchContext.userAgent so the schema validation passes and the actor actually starts.preNavigationHooks to send Accept-Language: zh-CN,zh;q=0.9,en;q=0.8 and Chinese User-Agent to look more like a real Chinese browser. Reduces captcha likelihood.type, resultType, page, url, description (snippet alias), domain, favicon, thumbnail, titleHtml, snippetHtml, emphasis, siteLinks, breadcrumbs, richResultType, isAd, isSponsored, isOfficial, author, publishedAt, publishedAtRaw, relativeTime, rating, ratingCount, price, priceNumeric, currency, searchQuery, query, searchUrl, market, country, language, searchMetadatanormalizeOrganicRecord from _canonical/normalize.js for cross-engine consistencyparseChineseDatedata-tuiguuang attribute, .ec_* classes, "推广" / "广告" text indicators[aria-name="label"] attributeorganic, baike, video, image, official, rich#rs and pushed as separate records with resultType=relatedSearchsiteLinks[]<em> emphasis tags from Baiduemphasis[]parseChineseDate for "X小时前", "X月X日", "昨天", etc.maxPages parameter (default 5)startUrls (array) — supply your own Baidu search URLsincludeAds (boolean, default false)includeRelated (boolean, default true) — push "相关搜索" as recordsmarket (e.g. zh-CN, en-US)maxPages (default 5)overview (key fields) and fullDetails (all 41 fields)query, startUrls, maxItems, maxPages, market, includeAds, includeRelated, proxyConfiguration#page .n, a.n, .page-n a)errors/ directory and inline await after Actor.init()main.js — extraction moved to routes/handlers.jspackage.json no longer runs crawlee install-playwright-browsers (browsers pre-installed in base image)https://www.baidu.com/link?url=...) to actual destination URLs via HEAD requestsource fieldsrc/main.js, src/routes/handlers.js, src/routes.js, src/errors/COPY commands use --chown=myuser to prevent EACCES build errorspostinstall: npx crawlee install-playwright-browsers (browsers pre-installed in base image)playwright kept in dependencies (not devDependencies) for correct runtime import resolutionEACCES: permission denied, open '/home/myuser/package-lock.json' on Apify Cloud (exit code 243)