Baijiahao Article Scraper (百家号) - Baidu Articles avatar

Baijiahao Article Scraper (百家号) - Baidu Articles

Pricing

from $4.00 / 1,000 scraped articles

Go to Apify Store
Baijiahao Article Scraper (百家号) - Baidu Articles

Baijiahao Article Scraper (百家号) - Baidu Articles

Scrape Baidu Baijiahao (百家号) articles by URL or ID. Get title, full text, HTML, publish time, images, videos, AI summary and author details such as name, ID, followers, total likes and IP location. No login needed.

Pricing

from $4.00 / 1,000 scraped articles

Rating

0.0

(0)

Developer

Harish Garg

Harish Garg

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Categories

Share

Baijiahao Article Scraper extracts Baidu Baijiahao (百家号) article data from article URLs or IDs. For each article you get the title, full text, HTML, publish time, images, videos, AI summary and author details such as name, ID, followers, total likes and IP location.

No Baidu account, app, login or cookies are needed. Paste article links and click Start. Then download the data as JSON, CSV or Excel, get it through the Baijiahao API that this Actor gives you, run it on a schedule, or ask an AI assistant such as Claude or ChatGPT to get Baijiahao articles for you.

What is Baijiahao Article Scraper?

Baijiahao Article Scraper is an unofficial Baijiahao API and scraper for articles. You give it a list of article links, and it saves one row for each article:

  • 📰 Article: ID, link, title and publish time (Beijing time)
  • 📝 Content: the full text, one line for each paragraph, and the full body as HTML with the images and videos in place
  • 🤖 AI summary: the summary that Baidu writes for some articles (AI导读)
  • 🖼️ Images: the link, width, height and caption of every image in the article
  • 🎬 Videos: the direct MP4 link, cover, length, size and resolution of every video in the article
  • 👤 Author: name, author ID (app_id), author page, avatar, description and verification (for example 北京日报报业集团)
  • 📊 Author reach: followers and the total likes on all of the author's content
  • 📍 IP location: the province and city that Baidu shows for the author (IP属地)

The Actor runs on the Apify platform, so you also get API access, scheduling, integrations, monitoring and data export in many formats.

Why scrape Baijiahao articles?

Baijiahao (百家号) is Baidu's publishing platform. Chinese news media, government offices, companies and millions of independent writers publish on it, and its articles rank high in Baidu search. Use the data for:

  • Media monitoring: collect the full text of the articles that mention your brand, products or competitors.
  • News and policy research: archive the articles of official media accounts, such as 新华社 or 北京日报客户端, with their exact publish times.
  • AI and NLP datasets: get clean Chinese article text for translation, summarization, classification or RAG pipelines.
  • Author research: compare the followers, likes and IP locations of the accounts that write about a topic.
  • Content archiving: keep a copy of articles, with their images and video links, before they change or are deleted.

How to scrape Baijiahao articles

  1. Open an article on baijiahao.baidu.com, or find one in Baidu search, and copy its link.
  2. Paste one or more links into Article URLs.
  3. Click Start and wait for the run to finish. A small list takes less than a minute.
  4. Open the Output tab to see the articles, or export them as JSON, CSV, Excel, XML or HTML.

Input

The Actor has one input field.

FieldWhat it doesExample
Article URLs (articleUrls)Links to Baijiahao articles, or article IDs["https://baijiahao.baidu.com/s?id=1878903244270643422"]

These forms all work:

  • Article links: https://baijiahao.baidu.com/s?id={article ID}
  • Links from Baidu search, with extra parameters: https://baijiahao.baidu.com/s?id={article ID}&wfr=spider&for=pc
  • Baidu app links: https://mbd.baidu.com/newspage/data/landingsuper?id={article ID}
  • Bare article IDs: 1878903244270643422

The Actor saves each article one time, also when two links in the list point to the same article. It skips author pages (author.baidu.com/home?app_id=...), text that is not an article link, articles that do not exist or were deleted, and articles that Baidu sends to the publisher's own website. The run log names each skipped entry.

Input example

{
"articleUrls": [
"https://baijiahao.baidu.com/s?id=1878903244270643422",
"https://baijiahao.baidu.com/s?id=1668627464689061153&wfr=spider&for=pc",
"1879646486175300210"
]
}

Output

You get one row for each article. This row is from a real run (long texts and lists are shortened):

{
"articleId": "1879646486175300210",
"articleUrl": "https://baijiahao.baidu.com/s?id=1879646486175300210",
"title": "央视报道后,丹阳市场监管局对涉案4家镜片企业立案调查",
"publishedAt": "2026-10-21T16:14:52+08:00",
"contentText": "10月18日,总台新闻频道《每周质量报告》栏目播出《看不清的近视“防控”镜片》,……",
"contentHtml": "<p><span class=\"bjh-p\">10月18日,总台新闻频道《每周质量报告》栏目播出……",
"characterCount": 662,
"aiSummary": null,
"coverImageUrl": "https://pics0.baidu.com/feed/2f738bd4b31c8701c416236ba935e23d0608ff7c.jpeg@f_auto?token=06361e788bc918c420e86dee81f39d60",
"imageCount": 3,
"images": [
{
"url": "https://pics0.baidu.com/feed/2f738bd4b31c8701c416236ba935e23d0608ff7c.jpeg@f_auto?token=06361e788bc918c420e86dee81f39d60",
"width": 1242,
"height": 639,
"caption": null
}
],
"videoCount": 1,
"videos": [
{
"url": "https://vd3.bdstatic.com/mda-sjkbqgnkuyszzube/360p/h264/1792570589339081572/mda-sjkbqgnkuyszzube.mp4",
"coverUrl": "https://pic.rmb.bdstatic.com/bjh/news/d072c09c8a76f7437e786a37423739f7.jpeg",
"durationSeconds": 114,
"width": 1920,
"height": 1080,
"size": "44.36M"
}
],
"authorName": "北京日报客户端",
"authorId": "1601149438053974",
"authorUk": "8oo7bbaEf1fq1V7zTuLFLg",
"authorUrl": "https://author.baidu.com/home?app_id=1601149438053974",
"authorAvatarUrl": "https://avatar.bdstatic.com/it/u=1779201848,3750860456&fm=3012&app=3012&autime=1788915347&size=b200,200",
"authorDescription": "爱北京、关注北京、读北京",
"authorVerification": "北京日报报业集团",
"authorFollowers": 5851873,
"authorTotalLikes": 82210165,
"ipProvince": null,
"ipCity": null,
"sourceUrl": "https://baijiahao.baidu.com/s?id=1879646486175300210&wfr=spider&for=pc",
"scrapedAt": "2026-10-23T14:29:58+00:00"
}

The Output tab shows the articles in a table with the cover, title, author, publish time, length, image and video counts, followers, IP province and article link. You can download the dataset as JSON, CSV, Excel, XML, HTML or RSS.

Baijiahao data fields

FieldDescription
articleIdArticle ID
articleUrlLink to the article
titleArticle title
publishedAtPublish time, ISO 8601, Beijing time (+08:00)
contentTextFull article text, one line for each paragraph
contentHtmlFull article body as HTML, with images and videos in place
characterCountLength of contentText in characters
aiSummaryThe summary that Baidu writes with AI (AI导读), or null
coverImageUrlThe first image, or the first video cover
imageCountNumber of images
imagesImages, each with url, width, height and caption
videoCountNumber of videos
videosVideos, each with url (MP4), coverUrl, durationSeconds, width, height and size
authorNameAuthor name
authorIdAuthor ID (app_id)
authorUkThe author's Baidu account key (uk)
authorUrlLink to the author page
authorAvatarUrlAuthor avatar
authorDescriptionThe author's own description, or null
authorVerificationThe verification text that Baidu shows, for example an organization name, or null
authorFollowersAuthor followers (粉丝). Some accounts show 0
authorTotalLikesLikes on all of the author's content (获赞)
ipProvinceThe province that Baidu shows for the author's IP address, or null
ipCityThe city that Baidu shows for the author's IP address, or null
sourceUrlThe link or ID from your input that gave this row
scrapedAtWhen your run collected the row (UTC)

How to use the Baijiahao scraper

You can run the Actor from Apify Console, from the Apify API, from your own JavaScript or Python code, or from an AI assistant. Every example below gets the same data.

Apify Console (no code)

  1. Open the Actor and paste your links into Article URLs on the Input tab.
  2. Click Start. Follow the progress in the Log tab.
  3. Open the Output tab to see the table, or click Export to download the data.
  4. To repeat the same run, click Save as a new task. Add a Schedule to the task to check the same articles every day or week.

Baijiahao API (HTTP)

Run the Actor and get the articles in one request. Replace YOUR_API_TOKEN with your token from Settings → API & Integrations in Apify Console.

curl -X POST "https://api.apify.com/v2/acts/hgservices~baijiahao-article-scraper/run-sync-get-dataset-items" \
-H "Authorization: Bearer YOUR_API_TOKEN" \
-H "Content-Type: application/json" \
-d '{"articleUrls": ["https://baijiahao.baidu.com/s?id=1878903244270643422", "https://baijiahao.baidu.com/s?id=1668627464689061153"]}'

The response is a JSON array with one object for each article. Add ?format=csv or ?format=xlsx to the URL to get CSV or Excel.

This request waits for the run to finish, for up to 5 minutes. For a long list of articles, start the run with POST https://api.apify.com/v2/acts/hgservices~baijiahao-article-scraper/runs. When the run is finished, get the articles from GET https://api.apify.com/v2/datasets/{defaultDatasetId}/items.

Scrape Baijiahao with JavaScript

Install the client with npm install apify-client. Save this code as baijiahao.mjs and run it with node baijiahao.mjs:

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });
const run = await client.actor('hgservices/baijiahao-article-scraper').call({
articleUrls: [
'https://baijiahao.baidu.com/s?id=1878903244270643422',
'https://baijiahao.baidu.com/s?id=1668627464689061153',
],
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
for (const article of items) {
console.log(article.publishedAt, article.authorName, article.title);
}

Scrape Baijiahao with Python

Install the client with pip install apify-client (version 3.0 or later), then run this code:

from apify_client import ApifyClient
client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("hgservices/baijiahao-article-scraper").call(
run_input={
"articleUrls": [
"https://baijiahao.baidu.com/s?id=1878903244270643422",
"https://baijiahao.baidu.com/s?id=1668627464689061153",
],
}
)
if run is None:
raise RuntimeError("The run was not found.")
for article in client.dataset(run.default_dataset_id).iterate_items():
print(article["publishedAt"], article["authorName"], article["title"])
print(article["contentText"][:200])

Claude, ChatGPT and other AI assistants (MCP)

Connect your AI assistant to the Apify MCP server. The assistant can then run this Actor for you and answer from the results. Use this server URL to give the assistant this Actor as a tool:

https://mcp.apify.com?tools=hgservices/baijiahao-article-scraper

Claude (claude.ai and Claude Desktop)

  1. Open Settings → Connectors.
  2. Click Add, then Add custom connector.
  3. Enter a name, for example Apify, and paste the server URL above.
  4. Click Continue, keep the detected settings, and click Add.
  5. Sign in to Apify in the browser window that opens.

On Claude Team and Enterprise plans, an organization owner adds the connector for the organization.

ChatGPT

  1. Open Settings → Apps & Connectors and click Create. If you do not see Create, turn on Developer mode.
  2. Enter a name, for example apify-mcp, and paste the server URL above as the MCP Server URL.
  3. Select OAuth for authentication and click Create.
  4. Sign in to Apify and allow access.
  5. In a new chat, click +, select More, and select your Apify connector.

Claude Code, Cursor, VS Code and Codex

  • Claude Code: run claude mcp add --transport http apify "https://mcp.apify.com?tools=hgservices/baijiahao-article-scraper", then run /mcp and sign in to Apify.
  • Apify CLI: run apify mcp install claude-code --tools hgservices/baijiahao-article-scraper. You can use cursor, vscode or codex in place of claude-code.
  • Other MCP clients: add the server URL as a remote (HTTP) MCP server.

Then ask in plain language, for example:

  • "Get the Baijiahao article https://baijiahao.baidu.com/s?id=1878903244270643422 and summarize it in English."
  • "Scrape these Baijiahao articles and make a table of their authors, publish times and follower counts."
  • "Translate the text of these Baijiahao articles into English."

Integrations

Send the results to Google Sheets, Slack, email, Zapier, Make, n8n, Airbyte or any webhook from the Actor's Integrations tab. For example, add every new article from your monitoring list to a Google Sheet.

Tips for scraping Baijiahao

  • Paste any article link. Web links, links from Baidu search and Baidu app links all work.
  • Find article links with Baidu. Search for a keyword on baidu.com or in Baidu News, and copy the baijiahao.baidu.com/s?id= links from the results.
  • Use the text or the HTML. contentText is ready for reading, translation and AI tools. contentHtml keeps the layout, the images and the videos.
  • Download images and videos soon. The image and video links work without a login, but they can change or stop working after some time. When you download an image, do not send a Referer header from another website.

Limits

  • The Actor needs article links or IDs. It does not search Baidu and does not list all the articles of an author.
  • No like, comment or read counts. The article page does not include these counts. The Actor gives the author's followers and total likes.
  • No comment texts.
  • Some articles are on other websites. For some publishers, Baidu sends the article link to the publisher's own website. The Actor skips these articles and names them in the run log.
  • No image or video files. The Actor saves the link to each file, not the file itself.
  • The IP location is what Baidu shows. It is not a verified address. Many media accounts show no IP location.

中文简介

百家号文章抓取工具:输入百家号文章链接 (baijiahao.baidu.com/s?id=…)、百度 App 链接或文章 ID,即可获取每篇文章的标题、正文 (纯文本与 HTML)、发布时间、图片、视频、AI 导读摘要,以及作者名称、作者 ID (app_id)、粉丝数、获赞总数、认证信息和 IP 属地。无需登录百度账号,可导出 JSON、CSV、Excel,也可通过 API 或 AI 助手调用。

FAQ, disclaimers and support

Do I need a Baidu account or the Baidu app?

No. The Actor reads only what baijiahao.baidu.com shows to any visitor. It never logs in.

Do I need a proxy?

No. You do not need to set up a proxy.

Can I get the articles of one author?

Not with this Actor. It scrapes the articles that you give it. Each row has the author ID and the link to the author page.

The Actor collects only data that is publicly available. Articles, images and videos are protected by copyright, and the data can contain personal data, which laws such as the GDPR and China's PIPL protect. You are responsible for using the data in line with Baidu's terms of service and these laws. Do not republish content that you do not have the rights to.

I found a problem or need a feature

Open an issue on the Issues tab, and we will look into it. Custom solutions for Baijiahao and other Chinese websites are available on request.