Baidu Scholar Scraper

What does Baidu Scholar Scraper do?

Baidu Scholar Scraper is a Baidu Xueshu API alternative that collects public academic search results from Baidu Xueshu. It extracts source-backed paper metadata only; it does not access private accounts, paywalled full text, or authentication-protected content.

Why use Baidu Scholar Scraper?

Use the Actor for literature discovery, citation monitoring, research-metadata enrichment, or reproducible academic-search datasets. Apify adds scheduling, API access, integrations, monitored runs, datasets, and optional proxy rotation without requiring users to maintain a browser scraper.

What data can Baidu Scholar Scraper extract?

Each dataset item represents one Baidu Scholar paper result, including available authors, affiliations, publication details, citations, identifiers, and source links.

• Uses the input limits and filters below to control the crawl.
• Stores source-backed fields defined by the 34-field dataset schema.
• Omits optional fields when the source does not expose a value instead of writing nulls or fabricated placeholders.

The Actor prefers Baidu's public JSON response when available and falls back to rendered result cards. Required fields identify the result and its search context; optional fields are omitted when Baidu does not provide them.

How to scrape Baidu Xueshu

1. Open the Actor input tab.
2. Enter a Chinese or English academic query.
3. Set small maxItems and maxPages values for testing.
4. Enable an authorized Apify Proxy only if direct access is blocked.
5. Start the run and download the dataset as JSON, CSV, Excel, XML, or another supported format.

How much will it cost to scrape Baidu Xueshu?

Cost depends on the Actor's current Apify pricing and the browser runtime used. Small bounded searches are cheapest. Review the current pricing tab before a larger run, limit pages and items, and use proxies only when needed.

Input

Provide input in JSON. Fields marked required must be supplied; source-specific alternatives and constraints are described in the field text.

Field	Type	Required	Default	Description
query	string	Yes	—	Academic search query (Chinese or English)
maxItems	integer	No	20	Maximum number of papers to scrape
maxPages	integer	No	3	Maximum number of pagination pages to follow
maxRequestRetries	integer	No	4	Rotate through fresh browser and proxy identities after temporary blocks or zero-card responses.
proxyConfiguration	object	No	—	Proxy configuration for the scraper
debug	boolean	No	false	Log sanitized selector counts and link targets when no academic cards are recognized.

Example input

{
  "query": "deep learning",
  "maxItems": 10,
  "maxPages": 2,
  "proxyConfiguration": {
    "useApifyProxy": false
  },
  "maxRequestRetries": 4,
  "debug": false
}

Output

The default dataset contains one item per academic paper result. The following are the most useful fields; availability varies by publication.

Field	Type	Description
position	integer	Position
title	string	Paper Title
authors	string	Authors
source	string	Source
citations	integer	Citation Count
year	integer	Year
url	string	URL
scrapedAt	string	Scraped At
type	string	Record Type
searchQuery	string	Search Query
page	integer	Page
titleHtml	string	Paper Title HTML
abstract	string	Abstract
authorList	array	Author List
authorDetails	array	Author Details
affiliations	array	Affiliations

Example dataset item

This compact example is taken from local Actor storage. Long text and nested collections are shortened for documentation only.

{
  "position": 1,
  "title": "Deep Learning",
  "authors": "R. Szeliski",
  "source": "Texts in Computer Science",
  "citations": 0,
  "year": 2022,
  "url": "https://xueshu.baidu.com/ndscholar/browse/detail?paperid=152b0j60vb1v06t0f64q08b0rt373900",
  "scrapedAt": "2026-07-26T07:32:22.528Z",
  "type": "academic",
  "searchQuery": "deep learning",
  "page": 1,
  "titleHtml": "<em>Deep Learning</em>"
}

Related Actors

• Baidu Baike Scraper
• Baidu Images Scraper
• Baidu Maps Scraper

Tips and advanced options

• Start without a proxy and enable an authorized proxy only after a confirmed block.
• Keep maxRequestRetries bounded; repeated challenge pages are treated as failures, never as academic records.
• maxItems is a hard dataset limit across all pages.

FAQ, disclaimer, and support

Why did a run return a block or verification error?

Baidu may challenge automated traffic based on network reputation or region. Try later or use an authorized Apify Proxy group available to your account. The Actor does not solve CAPTCHAs or bypass access controls.

Can I call this Actor through an API?

Yes. Use the Actor's Apify API tab or client libraries with the same JSON input. Use the Issues tab to report reproducible problems.

Our Actors are ethical and do not intentionally extract private user data. They collect only publicly displayed academic metadata. Results can still contain author names or other personal data protected by the GDPR and similar laws. Scrape personal data only with a legitimate reason and consult legal counsel when unsure.