Reddit Scraper
1 day trial then $45.00/month - No credit card required now
Reddit Scraper
1 day trial then $45.00/month - No credit card required now
Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
We have roughly 13 start urls that we try to gather the last 24 hours of posts and comments but keep coming up with it not going through all of them. It seems to only do 2 or 3 of the 13 and its not always the same ones. Not sure what we need to adjust.
Can you share the run ID so I can take a look?
doFyFa9azXK8YXZkG
If you are trying to get the new posts and their comments for those start URLs and you don't need the subreddit information, I suggest using the URL with the category for new posts directly on the start URL. Ex https://www.reddit.com/r/LocalLLaMA/new/
. Without it it will get articles from the hot category. The input field for new only works when searching directly on the input of the actor.
Actor Metrics
324 monthly users
-
58 stars
>99% runs succeeded
1.3 days response time
Created in Feb 2022
Modified 11 days ago