Douban Feed Scraper

Douban Feed Scraper

Scrape Douban feed data from the homepage, subject explore pages, or search queries, up to a million items per run. Each item includes author details, title, abstract, image URL, and engagement metrics like response, like, and share counts. Export to CSV, JSON, Excel, or XML.

Douban's community feed and subject discovery pages are rich with trending discussions, reviews, and recommendations, but manually collecting this data is slow and repetitive. This Douban feed scraper reads the public HTML feeds directly, extracting structured data from the homepage, movie/book explore pages, and search results. It returns each feed item in a consistent, flat schema ready for analysis.

Who uses it	What they scrape Douban for
Market researchers	Monitor trending topics and cultural sentiment across Douban's community discussions.
Content marketers	Identify popular books, movies, and media generating buzz for campaign planning.
Data analysts	Build datasets of Douban feed engagement to track content virality over time.
App developers	Integrate real-time Douban feed data into recommendation engines or dashboards.

What it does

This Actor collects Douban feed items by homepage, subject explore URL, or search query, and returns each one as a flat row with author info, content, and engagement counts.

• 🏠 Default homepage feed: Scrape the curated feed from Douban's homepage without any filters.
• 🔍 Search query filtering: Provide a search term to scrape only feed items matching your keyword.
• 🎬 Subject explore pages: Target specific movie or book explore URLs for category-specific trending content.
• 📊 Engagement metrics: Each item returns response count, like count, and share count for popularity analysis.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Douban data

📈 Track trending discussions.

A market researcher scrapes the Douban homepage feed daily to identify which movies and books are generating the most discussion and engagement this week.

🎯 Monitor brand or topic mentions.

A content marketer uses a search query to scrape Douban feed items mentioning a specific film title, tracking sentiment and response volume over its release window.

📚 Build a recommendation dataset.

A data analyst scrapes subject explore pages for books and movies to compile a dataset of trending items with engagement signals for a collaborative filtering model.

🔔 Power a content dashboard.

An app developer schedules regular runs of the Douban feed scraper to feed fresh, trending Douban content into a media discovery dashboard.

Why choose this scraper

	What you get
No API key required	Access public Douban feed data without registration or OAuth.
Flexible targeting	Scrape the homepage, search results, or specific subject explore pages.
Structured output	Every item is returned in a clean, flat schema with consistent field names.
Engagement data included	Get response, like, and share counts for each feed item.
Scalable volume	Paid users can scrape up to 1,000,000 items per run.

How it compares

This actor focuses on the general Douban feed and subject explore pages, while the Douban Movie Scraper targets movie-specific detail pages with ratings and reviews.

Feature	ParseForge	Douban Movie Scraper - Ratings, Reviews & Hot Lists
Homepage feed scraping	Yes	Not listed
Subject explore pages (movies, books)	Yes	Not listed
Search query filtering	Yes	Not listed
Engagement metrics (likes, shares, responses)	Yes	Not listed
Movie ratings and reviews	Not listed	Yes
Cast and crew data	Not listed	Yes

What a Douban record looks like

Every record returns as one flat JSON row. Here is a real one from a run:

{
 "imageUrl": "https://img9.doubanio.com/view/group_topic/large/public/p743622176.jpg",
 "itemId": "1738349545",
 "source": "来自：豆瓣广播",
 "authorName": "9回应\n 211赞\n 3转发",
 "authorUrl": "https://www.douban.com/topic/497380064/?_spm_id=MzU0MDQ0MQ",
 "authorAvatar": "https://img3.doubanio.com/icon/u3540441-63.jpg",
 "title": "旅行碎片",
 "titleUrl": "https://www.douban.com/topic/497380064/?_spm_id=MzU0MDQ0MQ",
 "responseCount": 0,
 "likeCount": 0,
 "forwardCount": 0,
 "scrapedAt": "2026-08-22T19:42:14.806Z"
}

Every value above comes from a real run. A field a record does not have comes back as null.

Configure the run

Drive the Actor from the default homepage, a search query, or a direct subject explore URL, and set a maximum item limit to control the size of your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "maxItems": 10
}

A larger pull:

{
 "maxItems": 200
}

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the Douban Feed Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Douban through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

$claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/douban-feed-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your search query is not too restrictive. Try leaving it empty to scrape the default homepage feed first. Also verify that the target URL is a valid Douban feed or explore page.

Why am I only getting 10 items?

Free Apify users are limited to 10 items as a preview. Upgrade to a paid plan and increase the max items field to scrape more data, up to 1,000,000 items.

The actor runs but some fields are empty.

Not every feed item includes all fields. For example, some items may lack an image or share count. This is normal and reflects the data available on the page at the time of scraping.

Can I scrape a specific Douban group or discussion thread?

This actor is designed for the main feed and subject explore pages. For specific group or discussion thread scraping, you may need a different, more targeted actor.

FAQ

Question	Answer
What data does this Douban feed scraper return?	Each feed item includes the source, author name, author URL, author avatar, title, topic URL, abstract text, image URL, response count, like count, and share count.
Can I scrape Douban feed data without logging in?	Yes. This actor reads the public HTML feeds from Douban, so no account, login, or API key is required.
How do I scrape only specific topics from the Douban feed?	Use the search query input field to filter feed content by a keyword. Leave it empty to scrape the default homepage feed.
What is the maximum number of items I can scrape?	Free users are limited to 10 items as a preview. Paid users can scrape up to 1,000,000 items per run by setting the max items field.
Can I scrape Douban subject explore pages for movies or books?	Yes. Provide a direct subject explore URL as the start URL, such as the movie or book trending pages, to scrape category-specific feeds.
Does this actor handle Douban's anti-bot protections?	The target pages showed no anti-bot challenge markers during probing. The actor reads the initial HTML directly without a browser, making it fast and efficient.
What export formats are supported?	You can export your scraped Douban feed data to CSV, JSON, Excel, or XML formats from the Apify dataset.
Is this the same as the Douban Movie Scraper?	No. This actor focuses on the general Douban feed and subject explore pages. The Douban Movie Scraper targets movie-specific pages with ratings, reviews, and cast details.
Can I schedule this scraper to run automatically?	Yes. Apify supports scheduled runs, so you can set this actor to scrape the Douban feed hourly, daily, or on any custom interval.
Does this scraper work for Douban book feeds?	Yes. You can target the book subject explore page to scrape trending book discussions and recommendations from the Douban feed.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Douban Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

💰 How much does it cost to scrape Douban Feed?

This Actor uses pay-per-result pricing: $0.004 per result collected. You are billed only for the results you receive, so a run that returns nothing costs nothing.