Reddit Scraper avatar

Reddit Scraper

Try for free

1 day trial then $45.00/month - No credit card required now

Go to Store
Reddit Scraper

Reddit Scraper

trudax/reddit-scraper
Try for free

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

MS

Runs started to fail randomly

Closed

mykola_scrapes opened this issue
4 months ago

Here is the error that happends:

TypeError [ERR_INVALID_URL]: Invalid URL at new NodeError (node:internal/errors:372:5) at URL.onParseError (node:internal/url:553:9) at new URL (node:internal/url:629:5) at getNormalUrl (file:///home/myuser/src/tools.js:470:21) at PuppeteerCrawler.failedRequestHandler (file:///home/myuser/src/main.js:277:30) at /home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:994:78 at PuppeteerCrawler._tagUserHandlerError (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:981:26) at PuppeteerCrawler._handleFailedRequestHandler (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:994:24) at PuppeteerCrawler._requestFunctionErrorHandler (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:977:20) at runMicrotasks () { input: '/user/GoBlissOfficial/comments/1dt9mz0/fitness_coach_your_personalized_fitness_coach_the/', code: 'ERR_INVALID_URL' }

trudax avatar

Hi, I have released a fix for it in the lastest version. Please try it out.

Developer
Maintained by Community

Actor Metrics

  • 317 monthly users

  • 60 stars

  • >99% runs succeeded

  • 12 hours response time

  • Created in Feb 2022

  • Modified 21 days ago

Categories