Reddit Scraper Lite avatar

Reddit Scraper Lite

Try for free

Pay $4.00 for 1,000 results

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

trudax/reddit-scraper-lite
Try for free

Pay $4.00 for 1,000 results

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

RH

Length of Historical data by Subreddit

Closed

arham.choudhury opened this issue
a month ago

Hello, I did three runs of Reddit Scraper Lite on 2024-12-17 from 3 different subreddits. I got varying lengths of historical data from each run. I am trying to understand why the history data is different.

r/AppleArcade: I was able to access about 6 months of posts and comments r/iosgaming: I only see past 2 weeks of posts and comments r/Gaming: I only see 1 days worth of posts and comments.

Why is the length of history data different? Do the rate limits differ by subreddit? Thanks ​

trudax avatar

The scraper can only get what is available on the website. Reddit has a policy of keeping around 1000 posts for each subreddit. You should be seeing around that number of posts.

Developer
Maintained by Community

Actor Metrics

  • 378 monthly users

  • 68 stars

  • 78% runs succeeded

  • 12 hours response time

  • Created in Jun 2020

  • Modified a month ago