Douban Pro Scraper — Reviews, Discussions & Subject Data
Pricing
from $30.00 / 1,000 review scrapeds
Scrape long-form reviews of movies, books and music, short book and music comments with star ratings, and group discussion titles from Douban (豆瓣), China's reviews and interest community. Plus subject and group search. For Chinese-LLM training corpora, sentiment analysis and NLP. API, no login.
All notable changes to the Douban Scraper Actor.
authorUsername, authorUrl, publishedAt and publishedAtIso null: the mobile list, the only list movies have, shows no author link and no date.authorUrl is now built from the numeric user id in the avatar file the mobile list does show (icon/u1000152-23.jpg -> https://www.douban.com/people/1000152/). On the desktop lists in the test fixtures, every numeric author link (10 of 10) matches its avatar's id. A default avatar (user_normal.jpg) names nobody, so that row keeps authorUrl null. The same applies to book reviews read from the mobile list (listSource: "mobile").fetchFullReviewBody on (the default), the movie body already comes from Douban's review JSON. Where that JSON carries them, the row now also takes authorUsername (user.name), the author's own profile link (user.url) and the date (create_time, Beijing time, into publishedAt / publishedAtIso). Anything missing stays null. The field names are read defensively and have not yet been checked on a live run.python -m pytest tests/test_movie_review_author.py.subject_reviews and subject_comments re-read the same most-popular-first list every run, so the rows at its top — delivered on the first run and listed on every run since — were the first forgotten once a stream passed 20,000 rows, and the next run delivered and charged them again. A row listed again now counts as recent; only the rows Douban has gone longest without listing are forgotten.deltaMode are unchanged (checked offline against the previous commit).group_search modegroup_topic: Douban now answers topic pages with its login wall (4 of 4 measured on 24 Sep 2026, also through Apify). Such runs used to end with only "no billable items"; the status now names the topics Douban did not serve (not charged) and points to group_search, which works without login. The mode's title in the input form says so too.deltaMode itself works and is documented as before.group_search mode. Put a keyword in Search query. The run returns one row for each Douban Group discussion whose title contains that exact keyword, newest first, up to maxResults. Matching is case-insensitive for Latin letters.topicId, title, url (clean topic link, without the tracking parameter), groupId, groupName, groupUrl, replyCount, postedAt (Beijing time, +08:00), keyword, mode, type (group_search_result) and scrapedAt. If the listing does not show a value, the field is null, never a made-up 0.maxResults mentions, when the list ends, after 3 pages in a row without a title mention, when a page repeats topics already read, or at the first page Douban refuses (login wall or anti-bot check). The status says which of these ended the run.subject-search-result event ($0.005), the same event and price as subject_search results. No new events and no price changes.