TikTok Comments Scraper avatar

TikTok Comments Scraper

Try for free

Pay $1.00 for 1,000 comments

Go to Store
TikTok Comments Scraper

TikTok Comments Scraper

clockworks/tiktok-comments-scraper
Try for free

Pay $1.00 for 1,000 comments

Extract TikTok comments. Just add a TikTok URL and get TikTok video and profile data: comments, URLs, numbers of shares, followers, hashtags, hearts, video, and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
BU

Crawler doesn't scrape all the comments

Open

build_up opened this issue
5 months ago

On July 4 and 5 we scraped multiple videos with the settings max 1000 comments, and 100 max replies to comments. The input videos were ones in this dataset id: TlthA0fqcOP9i0Peg

About 1/2 of the videos were not able to get all the comments under a video, as compared to the commentCount field in returned from a previous run of your Tiktok Scraper.

This affected videos with many comments more than ones with few comments, but not exclusively. The majority of affected videos only returned +- 30 comments though they had 70 - 1000+ comments, however a video with 144 comments returned all 144 comments and some videos with <10 comments returned 1 or 2 comments.

We repeated the scrape for the ~ 2500/6000 comments that had a comments count difference of > 5, and 80% of them had within 5 comments count compared to the first scrape. the other 20% either had up to 75 more comments, or up to 125 less comments than the first scrape.

I'm guessing Tiktok found a different way to identify scrapers, but you'll probably know better what this data points to.

svpetrenko avatar

Hi, thanks for submitting the issue. We track this issue internally and are working on it. I'll update you further when it's fixed

AA

anna_an

5 months ago

I've experienced this issue as well (in organisational account). When scraping two video links not all the comments were present for one video, but more were scraped when using it as the only input. The missing comments were of interest as they contained links, and were also at the bottom of the comments section with no likes. They were top-level comments, not replies, and there were well under the search limit of 500 comments (128 on the video).

svpetrenko avatar

Hi again everyone, thanks for your patience! To give you an update, recently we've rolled out a small change that might've increased collected comment count by up to 100-150 comments (if there are a lot of them), but we still can't collect more than around 600 comments consistently and can't get around fluctuations in the number of collected comments, even if there are less than 100 comments for a video.

I'll keep this issue open and we will continue to work on it

SK

sakareka4

9 days ago

Hi, i am not gonna talk about maximum comment count. But i want to know how this tools work ? is it scrap N's first comments or randomly scrap N number of comment from the video ?

Thanks

svpetrenko avatar

Hi! This tool works exactly as if you navigated to some posts' page (in the web version of TikTok) as a non-logged-in user and started scrolling comments down (and in parallel expanding "View X replies" buttons of encountered top-level comments). So the order of comments is as TikTok's web version presents, which is up to its internal algorithms

Developer
Maintained by Apify

Actor Metrics

  • 537 monthly users

  • 71 stars

  • >99% runs succeeded

  • 3.3 hours response time

  • Created in Feb 2023

  • Modified 4 days ago