TikTok Scraper avatar

TikTok Scraper

Try for free

4 days trial then $45.00/month - No credit card required now

View all Actors
TikTok Scraper

TikTok Scraper

clockworks/tiktok-scraper
Try for free

4 days trial then $45.00/month - No credit card required now

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
MR

downloadAddr and originalDownloadAddr not working

Closed

mariahh227 opened this issue
3 months ago

I notice that no matter the run, the downloadAddr and originalDownloadAddr do not provide the Tiktok video

lukas.prusa avatar

Hi, thanks for opening this issue!

Yes, this is the expected functionality. That is because TikTok is updating these links very quickly as a form of blocking. That is why we've implemented a video downloader straight into this tool. Simply enable the shouldDownloadVideos input option and the videos will get downloaded by the scraper :)

Try it out and let me know how it works, thanks!

MR

mariahh227

3 months ago

Yes, but this makes the usage go up a lot more? You're saying the downloadAddr won't be getting fixed anytime soon?

lukas.prusa avatar

Yes, that makes the usage go up, because it's downloading the videos.

And well, there is nothing to fix, the downloadAddr is scraped straight from TikTok, that is just how it functions. The link is only available for a short time after scrape, so you could download it quickly as the items are coming into the dataset. But that is essentially what the scraper is doing...

Let me know if this helps, thanks!

MR

mariahh227

3 months ago

Yes, but for me the downloadAddr doesn't work at all. Even if I try to scrape 2 profiles for example, and right when the run finishes, I try to visit the downloadAddr, it still doesn't work.

lukas.prusa avatar

Right, looking at it again, downloading the videos from the URL requires specific cookies to be set in the request. Basically those that you get from visiting the video detail page. Like ttwid, tt_csrf_token etc.

svpetrenko avatar

To add to the above, if you'd like to see a predictable pricing for the scrapes, you could also use TikTok Data Extractor actor here https://console.apify.com/actors/OtzYfK1ndEGdwWFKQ/input, it has a fixed price per 1000 results regardless of download options

MR

mariahh227

3 months ago

Even if I visit the webVideoUrl first and get the ttwid, tt_csrf_token, etc, I still can't access the downloadAddr right after the run finishes. The video player is just greyed out and doesn't play. Am I not understanding something?

lukas.prusa avatar

Okay, looking into this further, the cookies have to be from the same request as for which the video download URL was generated for. This essentially means that the raw download URL we output is useless...

I will discuss it with our team, but I guess we might as well remove it, when it's practically useless.

SH

shristib

2 months ago

I downloaded the results 6 months ago and now the Apify downloadaddr and TikTok downloadaddr do not work. I cannot rerun the searches as that will change my results. How should I access those TikTok videos for the analysis?

MR

mariahh227

2 months ago

I feel like it used to work before though so I'm not sure if it's a very new thing. Perhaps I am remembering it wrong.

lukas.prusa avatar

I'm not sure too, but either way, if it did change, it was done so by TikTok and there is unfortunately nothing we can do about that.

@Shristi, if you want to redownload the videos, then you can use the IDs of the videos and put them into the scraper directly, without running a new search.

SH

shristib

2 months ago

@Lukas, How can I do that? What column (for IDs) should I use? Do I need to rent the actor just to redownload the videos. I appreciate your help.

lukas.prusa avatar

Simply input the video URLs you want to scrape into the postURLs (Video URLs) input field. So to make the video URLs, simply replace the IDs instead of YOUR_VIDEO_ID to make a valid TikTok URL - https://www.tiktok.com/@/video/YOUR_VIDEO_ID

Yes, you will need to have the Actor rented to use it, or you can simply use our Pay Per Result version of this scraper here - TikTok Data Extractor. The pricing there is very simple, just 4$/1000 results.

I hope this helps, thanks!

SH

shristib

2 months ago

@Lukas, I appreciate your reply.

Attached is the data I scraped from TikTok scraper. I do not see a TikTok link here in the dataset that can be inputed into the TikTok Data Extractor. Can you direct me which colomn to use? Should I pay for the TikTok Data Extractor before the search or after? Let me know.

lukas.prusa avatar

Simply take the id field of the output and create the valid video TikTok URLs with them. Then input them into the postURLs input field. Also, don't forget to turn on the shouldDownloadVideos option.

You pay for the results as they come. E.g., if you scrape 100 videos, you will pay $0.4, which will be taken from your account usage.

SH

shristib

2 months ago

When I inputted authorMeta/id [ID] into the Video URL in the TikTok Data Extractor, this error was shown -- "This value does not match pattern ".*tiktok.com/".

What do you think I should do? Which TikTok URL should I input into the TikTok Data Extractor to retrieve the videos?

I appreciate your reply and your patience while helping me with this.

lukas.prusa avatar

Right, as said, you have to create the TikTok video URLs from the IDs, like this: https://www.tiktok.com/@/video/YOUR_VIDEO_ID

e.g., ID - 7387319491610414368 -> https://www.tiktok.com/@/video/7387319491610414368

Developer
Maintained by Apify

Actor Metrics

  • 1.1k monthly users

  • 96 stars

  • >99% runs succeeded

  • 3 days response time

  • Created in Sep 2021

  • Modified 14 hours ago