Baidu Baike Scraper
Pricing
from $1.99 / 1,000 search results
Baidu Baike Scraper
Scrape encyclopedia entries from Baidu Baike (baike.baidu.com), China's largest online encyclopedia. Extracts entry titles, summaries, content sections, infobox data, references, and images. Supports search and direct entry URLs.
Pricing
from $1.99 / 1,000 search results
Rating
0.0
(0)
Developer
Search API
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
15 days ago
Last modified
Categories
Share
Search Baidu Baike and extract rich normalized records from public encyclopedia entries. Version 2 keeps the rendered browser path required by Baidu's security layer while separating reliable search discovery from concurrent entry extraction, reducing the representative three-entry run from roughly 99 seconds to about 31 seconds locally.
Input modes
query: one Baidu Baike search.queries: multiple searches in one run, each capped bymaxItemsPerQuery.entryUrls: directhttps://baike.baidu.com/item/...pages.- Search and direct-entry inputs can be combined. URLs and entries are deduplicated globally.
includeContent,includeImages, andincludeReferencesprovide full-detail or fast summary modes.
maxItems caps the whole run, maxPages applies to each query, and maxConcurrency controls bounded page parallelism.
Output
Each dataset row is one public Baike entry with a stable ID, canonical URL, title and summary, full rendered article text and character count, section titles, structured infobox values, images, references, keywords, OpenGraph metadata, search provenance, language, and scrape metadata when Baidu publishes those fields. Empty optional values are omitted rather than stored as nulls or placeholders.
Proxy and access boundaries
Baidu returns a security-verification page to many ordinary HTTP clients, so this Actor uses a consistent Chromium profile and defaults to authorized Apify Residential routing in the cloud. Direct browser mode is supported and verified locally. GOOGLE_SERP is rejected as incompatible. The Actor detects and fails on CAPTCHA or security-verification pages; it does not solve challenges, bypass authentication, or defeat access controls.
Reliability
The Actor validates status and content type before extraction, bounds retries and timeouts, rotates bad sessions, strips tracking parameters from canonical entry identities, writes the dataset atomically, supports clean empty results, and never stores challenge pages or raw transport payloads.
