Super Tiktok Scraper 20x Efficiency with user videos + hashtags avatar
Super Tiktok Scraper 20x Efficiency with user videos + hashtags
Try for free

2 hours trial then $40.00/month - No credit card required now

View all Actors
Super Tiktok Scraper 20x Efficiency with user videos + hashtags

Super Tiktok Scraper 20x Efficiency with user videos + hashtags

newpo/super-tiktok-scraper
Try for free

2 hours trial then $40.00/month - No credit card required now

Scrapes Tiktok. 20x lower operation cost. $0.5 for 10,000 results. This one supports getting videos from user.

LK

Scrapping issue

Open

laKostas opened this issue
7 months ago

This is the log I get:

2023-11-25T21:44:49.154Z ACTOR: Pulling Docker image of build nUOwSN9ZfEccgrvQ4 from repository. 2023-11-25T21:45:17.043Z ACTOR: Creating Docker container. 2023-11-25T21:45:17.147Z ACTOR: Starting Docker container. 2023-11-25T21:45:18.059Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2023-11-25T21:45:18.061Z Executing main command 2023-11-25T21:45:19.440Z INFO System info {"apifyVersion":"3.1.2","apifyClientVersion":"2.6.2","crawleeVersion":"3.2.2","osType":"Linux","nodeVersion":"v16.19.0"} 2023-11-25T21:45:19.713Z url: [ 2023-11-25T21:45:19.718Z { 2023-11-25T21:45:19.720Z url: 'https://www.tiktok.com/@abookishdemon?lang=en', 2023-11-25T21:45:19.721Z label: 'page' 2023-11-25T21:45:19.721Z } 2023-11-25T21:45:19.722Z ] 2023-11-25T21:45:20.407Z INFO PuppeteerCrawler: Starting the crawl 2023-11-25T21:45:27.672Z INFO PuppeteerCrawler: Coffee Demon ☕️ (@abookishdemon) | TikTok {"url":"https://www.tiktok.com/@abookishdemon?lang=en"} 2023-11-25T21:45:27.862Z INFO PuppeteerCrawler: got items: 35 2023-11-25T21:46:20.407Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60603,"retryHistogram":[]} 2023-11-25T21:46:20.411Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2023-11-25T21:46:27.849Z ERROR PuppeteerCrawler: timeout: https://www.tiktok.com/@abookishdemon?lang=en 2023-11-25T21:46:27.850Z ERROR PuppeteerCrawler: There are supposed to be more videos but we haven't received any data for 1 min. Most likely this IP or browser has been flagged. Will retry in a bit. 2023-11-25T21:46:27.851Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. timeout 2023-11-25T21:46:27.852Z at Timeout._onTimeout (file:///home/myuser/src/routes.js:198:13) {"id":"DmYgDZG8mzDxVi5","url":"https://www.tiktok.com/@abookishdemon?lang=en","retryCount":1} 2023-11-25T21:46:33.692Z INFO PuppeteerCrawler: Coffee Demon ☕️ (@abookishdemon) | TikTok {"url":"https://www.tiktok.com/@abookishdemon?lang=en"} 2023-11-25T21:46:34.598Z INFO PuppeteerCrawler: got items: 35 2023-11-25T21:47:20.538Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":120604,"retryHistogram":[]} 2023-11-25T21:47:20.546Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2023-11-25T21:47:34.598Z ERROR PuppeteerCrawler: timeout: https://www.tiktok.com/@abookishdemon?lang=en 2023-11-25T21:47:34.600Z ERROR PuppeteerCrawler: There are supposed to be more videos but we haven't received any data for 1 min. Most likely this IP or browser has been flagged. Will retry in a bit. 2023-11-25T21:47:34.601Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. timeout 2023-11-25T21:47:34.601Z at Timeout._onTimeout (file:///home/myuser/src/routes.js:198:13) {"id":"DmYgDZG8mzDxVi5","url":"https://www.tiktok.com/@abookishdemon?lang=en","retryCount":2} 2023-11-25T21:47:39.482Z INFO PuppeteerCrawler: Coffee Demon ☕️ (@abookishdemon) | TikTok {"url":"https://www.tiktok.com/@abookishdemon?lang=en"} 2023-11-25T21:47:39.655Z INFO PuppeteerCrawler: got items: 35 2023-11-25T21:48:20.407Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":180603,"retryHistogram":[]} 2023-11-25T21:48:20.415Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2023-11-25T21:48:39.656Z ERROR PuppeteerCrawler: timeout: https://www.tiktok.com/@abookishdemon?lang=en 2023-11-25T21:48:39.657Z ERROR PuppeteerCrawler: There are supposed to be more videos but we haven't received any data for 1 min. Most likely this IP or browser has been flagged. Will retry in a bit. 2023-11-25T21:48:39.657Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. timeout 2023-11-25T21:48:39.658Z at Timeout._onTimeout (file:///home/myuser/src/routes.js:198:13) {"id":"DmYgDZG8mzDxVi5","url":"https://www.tiktok.com/@abookishdemon?lang=en","retryCount":3} 2023-11-25T21:48:55.983Z INFO PuppeteerCrawler: Coffee Demon ☕️ (@abookishdemon) | TikTok {"url":"https://www.tiktok.com/@abookishdemon?lang=en"} 2023-11-25T21:48:56.211Z INFO PuppeteerCrawler: got items: 35 2023-11-25T21:48:58.299Z INFO PuppeteerCrawler: user-videos 2023-11-25T21:49:00.877Z INFO PuppeteerCrawler: added 35 results to dataset 2023-11-25T21:49:00.879Z INFO PuppeteerCrawler: count: 70 2023-11-25T21:49:00.881Z INFO PuppeteerCrawler: cursor: 1679943454000 2023-11-25T21:49:00.884Z INFO PuppeteerCrawler: scraped 70 results, exiting 2023-11-25T21:49:00.945Z INFO PuppeteerCrawler: All requests from the queue have been processed, the crawler will shut down. 2023-11-25T21:49:01.345Z INFO PuppeteerCrawler: Crawl finished. Final request statistics: {"requestsFinished":1,"requestsFailed":0,"retryHistogram":[null,null,null,1],"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":17824,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":17824,"requestsTotal":1,"crawlerRuntimeMillis":221541} 2023-11-25T21:49:01.346Z INFO Actor finished successfully (exit code 0)

Developer
Maintained by Community
Actor metrics
  • 19 monthly users
  • 2 stars
  • 100.0% runs succeeded
  • Created in Mar 2023
  • Modified 5 months ago