Reddit Scraper avatar

Reddit Scraper

Try for free

1 day trial then $45.00/month - No credit card required now

View all Actors
Reddit Scraper

Reddit Scraper

trudax/reddit-scraper
Try for free

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

BO

Not going through every source

Open

boothdev opened this issue
5 days ago

We have roughly 13 start urls that we try to gather the last 24 hours of posts and comments but keep coming up with it not going through all of them. It seems to only do 2 or 3 of the 13 and its not always the same ones. Not sure what we need to adjust.

trudax avatar

Can you share the run ID so I can take a look?

BO

boothdev

5 days ago

doFyFa9azXK8YXZkG

trudax avatar

If you are trying to get the new posts and their comments for those start URLs and you don't need the subreddit information, I suggest using the URL with the category for new posts directly on the start URL. Ex https://www.reddit.com/r/LocalLLaMA/new/. Without it it will get articles from the hot category. The input field for new only works when searching directly on the input of the actor.

Developer
Maintained by Community

Actor Metrics

  • 324 monthly users

  • 58 stars

  • >99% runs succeeded

  • 1.3 days response time

  • Created in Feb 2022

  • Modified 11 days ago

Categories