3 days trial then $35.00/month - No credit card required now

Douyin Scraper

natanielsantos/douyin-scraper

3 days trial then $35.00/month - No credit card required now

This powerful tool enables you to extract data from Douyin, the Chinese version of TikTok. Use it to scrape post data, like URLs, numbers of followers, hearts, video, music-related data and more. Download Douyin data as a HTML, JSON, CSV, Excel, or XML doc.

Back to issues Create new issue

Almost all Requests Failing (2)

Closed

cognovi opened this issue

Thank you for investigating the issue you closed yesterday, but unfortunately we are still experiencing the same error. We did a test run for which we can now provide more details.

To verify the actor's performance, we conducted crawls using the term "Cooking" in English, Simplified Chinese, and Traditional Chinese. For each run, the maximum items were set to 6000 ("maxItemsPerUrl": 6000).

Here are the results:

Simplified Chinese (zh_CN)

Results: 25
Requests Handled: 2 of 407
Usage: $0.507
Started: 2024-05-31 05:36
Duration: 30m 57s
Run ID: RiqwzDGcS6yDFyY4h

Traditional Chinese (zh_TW)

Results: 38
Requests Handled: 3 of 416
Usage: $0.486
Started: 2024-05-31 06:35
Duration: 32m 22s
Run ID: qKK5lEhezOYCGil4s

English

Results: 9
Requests Handled: 1 of 403
Usage: $0.211
Started: 2024-05-31 05:02
Duration: 22m 46s
Run ID: 34OglrUcSpNWhb7CV (Aborted)

We are seeing many of these in the logs:

12024-05-31T10:02:46.945Z INFO  [Status message]: Scraped 25/6000 posts from the search term '烹饪'
22024-05-31T10:03:03.651Z Could not scrape https://www.douyin.com/search/%E7%83%B9%E9%A5%AA
32024-05-31T10:03:03.653Z ERROR:  Couldn't get search results
42024-05-31T10:03:03.937Z INFO  [Status message]: Scraped 25/6000 posts from the search term '烹饪'
52024-05-31T10:03:18.864Z Could not scrape https://www.douyin.com/search/%E7%83%B9%E9%A5%AA
62024-05-31T10:03:18.867Z ERROR:  Couldn't get search results

Any solution you can offer will be great... [trimmed]

Nataniel Santos (natanielsantos)

Thanks for the detailed information, it helped a lot. I managed to fix this issue, but unfortunately I found out that due to Douyin API limitations you can scrape approximately 1050 posts per search term. Also, I added more filter options to the actor's input so you can get more videos from the same keyword. If you have more questions or problems, let me know.

Add comment

Developer

Nataniel Santos

Actor Metrics

17 monthly users
7 stars
>99% runs succeeded
1.3 days response time
Created in Nov 2023
Modified 22 days ago

Categories

Social media

Automation

Videos

Douyin Search Scraper

kuaima/douyin-search

This scraper can help you to get search data from https://www.douyin.com/ 抖音 which is Chinese Version of tiktok.

kuai ma

Douyin Email Scraper

scraper-mind/douyin-email-scraper

The Douyin Email Scraper efficiently extracts email addresses from Douyin profiles and videos using targeted keywords. Ideal for influencer marketing and brand outreach, it offers fast, accurate results at 50% lower costs than competitors.

Scraper Mind

Douyin User Post Scraper

apibox/douyin-user-post-scraper

Douyin User Post Scraper

ApiBox

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59.3k

505

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15k

191

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

17k

200

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

24.5k

173

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

9.6k

202

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.2k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

6.8k