TikTok Scraper avatar
TikTok Scraper

Pricing

Pay per event

Go to Store
TikTok Scraper

TikTok Scraper

Developed by

Clockworks

Clockworks

Maintained by Apify

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

4.5 (22)

Pricing

Pay per event

261

Total users

30.5k

Monthly users

5.8k

Runs succeeded

>99%

Issue response

2.7 days

Last modified

2 hours ago

MC

Crawling doesn't go all the way through the profile.

Open

mustard_couch opened this issue
3 months ago

PlaywrightCrawler: Reclaiming failed request back to the list or queue. Failed to parse TikTok response: Unexpected end of JSON input --- https://www.tiktok.com/@partidul_aur_oficial 2025-02-21T19:03:26.776Z at makeWebApiCall (file:///home/myuser/dist/src/tools/api/web/make-web-api-call.js:102:23) {"id":"IN9RAGdv7Zqi2sp","url":"https://www.tiktok.com/@partidul_aur_oficial","retryCount":1} 2025-02-21T19:03:33.068Z INFO [Status message]: Scraped 0/1 profiles 2025-02-21T19:03:43.068Z INFO [Status message]: Scraped 0/1 profiles 2025-02-21T19:03:44.092Z INFO [PROFILE_CONTINUATION] Scraped 30 videos --- https://www.tiktok.com/@partidul_aur_oficial (videos tab) 2025-02-21T19:03:50.607Z INFO [PROFILE_CONTINUATION] Scraped 30 videos --- https://www.tiktok.com/@partidul_aur_oficial (videos tab) 2025-02-21T19:03:53.069Z INFO [Status message]: Scraped 0/2 profiles 2025-02-21T19:04:01.470Z INFO [PROFILE_CONTINUATION] Scraped 30 videos --- https://www.tiktok.com/@partidul_aur_oficial (videos tab) 2025-02-21T19:04:03.069Z INFO [Status message]: Scraped 0/2 profiles 2025-02-21T19:04:06.757Z INFO [PROFILE_CONTINUATION] Scraped 30 videos --- https://www.tiktok.com/@partidul_aur_oficial (videos tab) 2025-02-21T19:04:08.634Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Failed to parse TikTok response: Unexpected end of JSON input --- https://www.tiktok.com/@partidul_aur_oficial 2025-02-21T19:04:08.636Z at makeWebApiCall (file:///home/myuser/dist/src/tools/api/web/make-web-api-call.js:102:23) {"id":"zpVfvG2lqXtVzOo","url":"https://www.tiktok.com/@partidul_aur_oficial","retryCount":1} 2025-02-21T19:04:13.069Z INFO [Status message]: Scraped 0/2 profiles 2025-02-21T19:04:13.206Z INFO [PROFILE_CONTINUATION] Scraped 30 videos --- https://www.tiktok.com/@partidul_aur_oficial (videos tab) 2025-02-21T19:04:14.558Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Received corrupted response from TikTok, retrying 2025-02-21T19:04:14.560Z at parseVideoResults (file:///home/myuser/dist/src/parsers/video-parsers.js:59:19) {"id":"0fMSBqphNXVe6SJ","url":"https://www.tiktok.com/@partidul_aur_oficial","retryCount":1} 2025-02-21T19:04:23.069Z INFO [Status message]: Scraped 0/2 profiles 2025-02-21T19:04:23.189Z INFO PlaywrightCrawler:Statistics: PlaywrightCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":6497,"requestsFinishedPerMinute":6,"requestsFailedPerMinute":0,"requestTotalDurationMillis":38981,"requestsTotal":6,"crawlerRuntimeMillis":60418,"retryHistogram":[4,2]} 2025-02-21T19:04:23.920Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Received corrupted response from TikTok, retrying 2025-02-21T19:04:23.922Z at parseVideoResults (file:///home/myuser/dist/src/parsers/video-parsers.js:59:19) {"id":"0fMSBqphNXVe6SJ","url":"https://www.tiktok.com/@partidul_aur_oficial","retryCount":2} 2025-02-21T19:04:30.667Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Received corrupted response from TikTok, retrying 2025-02-21T19:04:30.669Z at parseVideoResults (file:///home/myuser/dist/src/parsers/video-parsers.js:59:19) {"id":"0fMSBqphNXVe6SJ","url":"https://www.tiktok.com/@partidul_aur_oficial","retryCount":3} 2025-02-21T19:04:33.070Z INFO [Status message]: Scraped 0/2 profiles 2025-02-21T19:04:33.211Z INFO PlaywrightCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.019},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2025-02-21T19:04:35.520Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Received corrupted response from TikTok, retrying

lukas.prusa avatar

Hi, thanks for opening this issue!

Interesting, this is most likely caused by your free user account that only has a few datacenter proxies to use, so they are quickly getting blocked. We have ways to get around that limitation though, so we will implement that into the scraper :)

Just note that you will have to use the TikTok Data Extractor Actor instead. That one is on a Pay Per Result model, and as such, we can cover the "shared" proxy costs ourselves.

Btw, I've done some of the testing on your profile, please don't delete this run as we will be using that for our debugging. I've reset your credits usage back :)

I will keep you updated here, thanks!