Reddit Scraper Lite avatar
Reddit Scraper Lite

Pricing

Pay per event

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

Developed by

Gustavo Rudiger

Gustavo Rudiger

Maintained by Community

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (3)

Pricing

Pay per event

207

Total users

7.8K

Monthly users

1K

Runs succeeded

91%

Issues response

3.8 days

Last modified

7 days ago

AC

Length of Historical data by Subreddit

Closed

arham.choudhury opened this issue
7 months ago

Hello, I did three runs of Reddit Scraper Lite on 2024-12-17 from 3 different subreddits. I got varying lengths of historical data from each run. I am trying to understand why the history data is different.

r/AppleArcade: I was able to access about 6 months of posts and comments r/iosgaming: I only see past 2 weeks of posts and comments r/Gaming: I only see 1 days worth of posts and comments.

Why is the length of history data different? Do the rate limits differ by subreddit? Thanks ​

trudax avatar

The scraper can only get what is available on the website. Reddit has a policy of keeping around 1000 posts for each subreddit. You should be seeing around that number of posts.