Douyin Scraper avatar
Douyin Scraper
Under maintenance

Pricing

$35.00/month + usage

Go to Store
Douyin Scraper

Douyin Scraper

Under maintenance
natanielsantos/douyin-scraper

Developed by

Nataniel Santos

Maintained by Community

This powerful tool enables you to extract data from Douyin, the Chinese version of TikTok. Use it to scrape post data, like URLs, numbers of followers, hearts, video, music-related data and more. Download Douyin data as a HTML, JSON, CSV, Excel, or XML doc.

0.0 (0)

Pricing

$35.00/month + usage

11

Monthly users

35

Runs succeeded

92%

Last modified

2 days ago

CO

Almost all Requests Failing (2)

Closed
cognovi opened this issue
10 months ago

Thank you for investigating the issue you closed yesterday, but unfortunately we are still experiencing the same error. We did a test run for which we can now provide more details.

To verify the actor's performance, we conducted crawls using the term "Cooking" in English, Simplified Chinese, and Traditional Chinese. For each run, the maximum items were set to 6000 ("maxItemsPerUrl": 6000).

Here are the results:

Simplified Chinese (zh_CN)

  • Results: 25
  • Requests Handled: 2 of 407
  • Usage: $0.507
  • Started: 2024-05-31 05:36
  • Duration: 30m 57s
  • Run ID: RiqwzDGcS6yDFyY4h

Traditional Chinese (zh_TW)

  • Results: 38
  • Requests Handled: 3 of 416
  • Usage: $0.486
  • Started: 2024-05-31 06:35
  • Duration: 32m 22s
  • Run ID: qKK5lEhezOYCGil4s

English

  • Results: 9
  • Requests Handled: 1 of 403
  • Usage: $0.211
  • Started: 2024-05-31 05:02
  • Duration: 22m 46s
  • Run ID: 34OglrUcSpNWhb7CV (Aborted)

We are seeing many of these in the logs:

12024-05-31T10:02:46.945Z INFO  [Status message]: Scraped 25/6000 posts from the search term '烹饪'
22024-05-31T10:03:03.651Z Could not scrape https://www.douyin.com/search/%E7%83%B9%E9%A5%AA
32024-05-31T10:03:03.653Z ERROR:  Couldn't get search results
42024-05-31T10:03:03.937Z INFO  [Status message]: Scraped 25/6000 posts from the search term '烹饪'
52024-05-31T10:03:18.864Z Could not scrape https://www.douyin.com/search/%E7%83%B9%E9%A5%AA
62024-05-31T10:03:18.867Z ERROR:  Couldn't get search results

Any solution you can offer will be great... [trimmed]

natanielsantos avatar

Thanks for the detailed information, it helped a lot. I managed to fix this issue, but unfortunately I found out that due to Douyin API limitations you can scrape approximately 1050 posts per search term. Also, I added more filter options to the actor's input so you can get more videos from the same keyword. If you have more questions or problems, let me know.

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

3 days

Price

$35.00