Douban Scraper - Movies, TV, Books, Ratings & Reviews avatar

Douban Scraper - Movies, TV, Books, Ratings & Reviews

Pricing

$4.00 / 1,000 results

Go to Apify Store
Douban Scraper - Movies, TV, Books, Ratings & Reviews

Douban Scraper - Movies, TV, Books, Ratings & Reviews

Scrape Douban (豆瓣) movies, TV shows, books and music: ratings with star distribution, hot short comments, long reviews with full text, Top 250 and other charts. No login needed.

Pricing

$4.00 / 1,000 results

Rating

0.0

(0)

Developer

CN Data Lab

CN Data Lab

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

9 days ago

Last modified

Share

Get public data from Douban (豆瓣), the main rating and review site for movies, TV shows, books and music in China. Use it to measure how Chinese audiences rate a title, to collect review text for sentiment analysis, or to build datasets.

No Douban account is needed. Field names are in English. Text content stays in the original language.

What you can scrape

ModeInputOutput
Details and ratingsSubject URLs or IDsTitle, original title, year, rating, number of ratings, share of 1 to 5 stars, wish and done counts, genres, countries, directors, actors, authors, publisher, summary
Hot short commentsSubject URLs or IDsComment text, star rating, useful votes, date, author
Long reviewsSubject URLs or IDsTitle, abstract, optional full text, star rating, useful votes, comment count, date, author
ChartsCollection namesRanked lists such as movie_top250, movie_showing, movie_hot_gaia, tv_hot
SearchKeywordsThe top matching movies, TV shows, books and music

Input examples

Ratings of a movie, a book and an album:

{
"mode": "subject",
"queries": [
"https://movie.douban.com/subject/1292052/",
"https://book.douban.com/subject/1084336/",
"music:1401853"
]
}

Long reviews of a book with full text:

{
"mode": "reviews",
"queries": ["book:1084336"],
"maxItems": 100,
"includeFullText": true
}

The Douban Top 250 movies:

{
"mode": "collection",
"queries": ["movie_top250"],
"maxItems": 250
}

Output examples

Subject:

{
"type": "movie",
"id": "1292052",
"url": "https://movie.douban.com/subject/1292052/",
"title": "肖申克的救赎",
"originalTitle": "The Shawshank Redemption",
"year": "1994",
"rating": 9.7,
"ratingCount": 3348990,
"ratingDistribution": [0.0011, 0.001, 0.0136, 0.1302, 0.8541],
"wishCount": 519960,
"doneCount": 5751328,
"shortCommentCount": 667929,
"reviewCount": 14974,
"genres": ["剧情", "犯罪"],
"countries": ["美国"],
"directors": ["弗兰克·德拉邦特"],
"actors": ["蒂姆·罗宾斯", "摩根·弗里曼"]
}

ratingDistribution is the share of 1-star, 2-star, 3-star, 4-star and 5-star ratings.

Short comment:

{
"type": "comment",
"commentId": "32514679",
"subjectId": "1292052",
"text": "恐惧让你沦为囚犯,希望让你重获自由。——《肖申克的救赎》",
"rating": 5,
"usefulCount": 26503,
"createdAt": "2008-02-27 21:43:23",
"authorName": "如小果",
"authorLocation": "北京"
}

Review:

{
"type": "review",
"reviewId": "1000104",
"url": "https://book.douban.com/review/1000104/",
"subjectId": "1084336",
"title": "长大就笨了",
"abstract": "那天我第一次打开《小王子》,就呆了。…",
"rating": 5,
"usefulCount": 5102,
"commentCount": 445,
"createdAt": "2005-04-06 11:51:52",
"authorName": "大头绿豆"
}

Limits you should know

Douban limits what visitors without login can see. The Actor returns what Douban gives to such visitors.

  • Short comments: about the 100 to 200 hottest comments of a subject. Sorting by newest is not available.
  • Long reviews: about the 200 hottest reviews of a subject.
  • Search: only the top matches (1 to 10 subjects per keyword). For some keywords Douban returns matches without rating data. Use the details mode on the result URLs to get ratings.
  • Times are in China Standard Time (UTC+8), as Douban shows them.

Pricing

Pay per result. Each subject, comment, review or chart row in the dataset is one result. You do not pay for failed queries.

FAQ

How do I find the ID of a subject? It is the number in the URL. For https://movie.douban.com/subject/1292052/ the ID is 1292052. Bare IDs are read as movie or TV. For books and music use the URL, or book:ID and music:ID.

Is it legal to scrape Douban? The Actor collects only data that is publicly visible without login. Results can contain personal data such as user names. Make sure that your use follows the law that applies to you.

Something does not work or you need another field? Open an issue on the Issues tab.