Reddit Scraper Lite avatar
Reddit Scraper Lite

Pricing

Pay per event

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

Developed by

Gustavo Rudiger

Gustavo Rudiger

Maintained by Community

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (3)

Pricing

Pay per event

178

Total users

6.9K

Monthly users

873

Runs succeeded

82%

Issues response

9.8 hours

Last modified

14 hours ago

RH

Length of Historical data by Subreddit

Closed

arham.choudhury opened this issue
6 months ago

Hello, I did three runs of Reddit Scraper Lite on 2024-12-17 from 3 different subreddits. I got varying lengths of historical data from each run. I am trying to understand why the history data is different.

r/AppleArcade: I was able to access about 6 months of posts and comments r/iosgaming: I only see past 2 weeks of posts and comments r/Gaming: I only see 1 days worth of posts and comments.

Why is the length of history data different? Do the rate limits differ by subreddit? Thanks ​

trudax avatar

The scraper can only get what is available on the website. Reddit has a policy of keeping around 1000 posts for each subreddit. You should be seeing around that number of posts.