TikTok Data Extractor avatar
TikTok Data Extractor
Try for free

Pay $4.00 for 1,000 results

View all Actors
TikTok Data Extractor

TikTok Data Extractor

clockworks/free-tiktok-scraper
Try for free

Pay $4.00 for 1,000 results

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Do you want to learn more about this Actor?

Get a demo
PU

Reliability - Crawler getting random number of posts from account

Closed

pauldepraz opened this issue
2 months ago

Hi Clockworks, I stumbled upon a couple of runs where the crawler spit out random number of outputs for the same input, reading the logs, I believe it "loses" some posts when the crawler fails to fetch them from the profile page. Please fix this issue, it is quite important that the crawler is reliable. The account I had most trouble with is @realspicydaniela, she has 244 posts. Here I provide two examples of failed runs with different output: https://console.apify.com/organization/z3aDiMBSwh6XaHEt3/actors/runs/AvBzhiUgZJ5I9Uphr https://console.apify.com/organization/z3aDiMBSwh6XaHEt3/actors/runs/puKdQ7zRJjsDP1jJW

Thanks.

svpetrenko avatar

Hi, thanks for the issue! There have been some changes on TikTok's side recently, so we're now working on fixing our actors in accordance to that. I'll notify when it's done

svpetrenko avatar

Hi again! In the last couple of days we've rolled out some fixes that might've helped the situation. I've tested it by batch-running @realspicydaniela scrape 100 times testing for the correct output item count, and it all passed. Could you please verify if it's working as expected now?

PU

pauldepraz

2 months ago

Hi Sviatozar, that's awesome, thanks for that! I will give it a go later today and let you know.

svpetrenko avatar

I'll close for now, but feel free to reopen if you re-encounter it

Developer
Maintained by Apify
Actor metrics
  • 1.4k monthly users
  • 109 stars
  • 99.0% runs succeeded
  • 2 days response time
  • Created in Feb 2022
  • Modified 4 days ago