Pay $5.00 for 1,000 videos
Tiktok Profile Scraper
Pay $5.00 for 1,000 videos
Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.
8 minute delay for each non-existing Tiktok ID
Closed
Input a few dozen TT profile IDs. Getting 0 results after 5 minutes, with a lot of "Failed to wait for the script" errors in the log. Using the latest 0.0.33 build.
contented_walnut
It does eventually return results -- i eventually got 28 results in 46 minutes (!)
It seems the issue is there's a 50-60 second timeout for profiles that don't have any content. And then it retries 8 times. This is 8 minutes of wall clock time before it moves on to the next request. This slows down the crawler very significantly if you have user IDs that have been renamed or no longer exist or have typos, etc.
Can we have a setting to not retry, and a bug fix for not having a 60 second timeout for pages that don't exist?
Hi, thanks for reaching out, we will look into it and let you know what can be done.
Hi,
We released an update and the issue should now be resolved
Clockworks- 243 monthly users
- 99.7% runs succeeded
- 4.2 days response time
- Created in Mar 2023
- Modified 3 days ago
