TikTok Comments Scraper
Pay $1.00 for 1,000 comments
TikTok Comments Scraper
Pay $1.00 for 1,000 comments
Extract TikTok comments. Just add a TikTok URL and get TikTok video and profile data: comments, URLs, numbers of shares, followers, hashtags, hearts, video, and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.
Crawler doesn't scrape all the comments
On July 4 and 5 we scraped multiple videos with the settings max 1000 comments, and 100 max replies to comments. The input videos were ones in this dataset id: TlthA0fqcOP9i0Peg
About 1/2 of the videos were not able to get all the comments under a video, as compared to the commentCount field in returned from a previous run of your Tiktok Scraper.
This affected videos with many comments more than ones with few comments, but not exclusively. The majority of affected videos only returned +- 30 comments though they had 70 - 1000+ comments, however a video with 144 comments returned all 144 comments and some videos with <10 comments returned 1 or 2 comments.
We repeated the scrape for the ~ 2500/6000 comments that had a comments count difference of > 5, and 80% of them had within 5 comments count compared to the first scrape. the other 20% either had up to 75 more comments, or up to 125 less comments than the first scrape.
I'm guessing Tiktok found a different way to identify scrapers, but you'll probably know better what this data points to.
Sviatozar Petrenko (svpetrenko)
Hi, thanks for submitting the issue. We track this issue internally and are working on it. I'll update you further when it's fixed
anna_an
I've experienced this issue as well (in organisational account). When scraping two video links not all the comments were present for one video, but more were scraped when using it as the only input. The missing comments were of interest as they contained links, and were also at the bottom of the comments section with no likes. They were top-level comments, not replies, and there were well under the search limit of 500 comments (128 on the video).
Sviatozar Petrenko (svpetrenko)
Hi again everyone, thanks for your patience! To give you an update, recently we've rolled out a small change that might've increased collected comment count by up to 100-150 comments (if there are a lot of them), but we still can't collect more than around 600 comments consistently and can't get around fluctuations in the number of collected comments, even if there are less than 100 comments for a video.
I'll keep this issue open and we will continue to work on it
sakareka4
Hi, i am not gonna talk about maximum comment count. But i want to know how this tools work ? is it scrap N's first comments or randomly scrap N number of comment from the video ?
Thanks
Sviatozar Petrenko (svpetrenko)
Hi! This tool works exactly as if you navigated to some posts' page (in the web version of TikTok) as a non-logged-in user and started scrolling comments down (and in parallel expanding "View X replies" buttons of encountered top-level comments). So the order of comments is as TikTok's web version presents, which is up to its internal algorithms
workrita131
Hi, i want to scrap the newest comments on a video and get a notification about it when a new comment appears on a video. is that possible to be done?
Hello workrita131. Unfortunately, as already stated by my colleague, we are not able to ensure the scrape of all the comments from a video. This would be the first step to create an alert like the one you are asking.
We are constantly trying to improve our scraper so we will keep looking for new ways to get all the data you need. Thank you for your patience.
ClockworksActor Metrics
677 monthly users
-
103 bookmarks
>99% runs succeeded
1.9 days response time
Created in Feb 2023
Modified 4 hours ago
