4 days trial then $45.00/month - No credit card required now
TikTok Scraper
4 days trial then $45.00/month - No credit card required now
Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.
Runs keep crashing (frequently).
Closed
Hi,
Hope all is going well.
I am attempting to run a few different scrapes, however, every few minutes, multiple runs crash/stop scraping.
This is the error I keep getting for each crash thus far:
The provided post URL is not a valid TikTok post URL: https://www.tiktok.com?is_from_webapp=1&sender_device=pc&web_id=6923405258253274374
The provided post URL is not a valid TikTok post URL: https://www.tiktok.com?is_from_webapp=1&sender_device=pc&web_id=7223888741620993326
The provided post URL is not a valid TikTok post URL: https://www.tiktok.com?is_from_webapp=1&sender_device=pc&web_id=6981532620819533061
This issue is somewhat scraper-breaking since I am unable to leave the scrapes unattended for longer than 5-10 minutes. Usually, I leave them for hours without an issue. Hopefully there's a solution to this.
(Maybe make it so if the scraper encounters a scenario or error-message like this, automatically execute a skip-entry function and continue scrape operation without aborting run?)
Thank you
ler.ai
Luckily, I was able to create a Python script from scratch that automatically checks my Runs.txt (list of current Run IDs) for their status, then auto-resurrects any that aren't currently "RUNNING" or "FINISHED" every 60s. So, I've effectively solved this on my own end. However, others may not be able to seamlessly solve this in 15 minutes like this
Sviatozar Petrenko (svpetrenko)
Hi, thanks for submitting the issue. In the newest build this shouldn't be happening anymore. In case you encounter it again, please reopen the issue
Clockworks- 534 monthly users
- 99.9% runs succeeded
- 3.8 days response time
- Created in Sep 2021
- Modified about 19 hours ago
