Reddit Scraper Lite avatar
Reddit Scraper Lite

Pricing

Pay per event

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

Developed by

Gustavo Rudiger

Gustavo Rudiger

Maintained by Community

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (3)

Pricing

Pay per event

199

Total users

7.6K

Monthly users

953

Runs succeeded

91%

Issues response

2.5 days

Last modified

3 hours ago

VY

Only getting 1000 posts

Closed

viridian_yclept opened this issue
a year ago

I changed the input parameters as seen in the screenshot. But, I can't get more than 1000 rows of data for a community with many posts.

trudax avatar

Can you share the run ID?

VY

viridian_yclept

a year ago

EGhbCwFpdJba3xLem

trudax avatar

I don't see anything wrong with the actor according to the logs. Try to use the New category to get more posts. You can use this as the start URL: https://www.reddit.com/r/CanadaPolitics/new/

VY

viridian_yclept

a year ago

That approach scrapes even less number of posts.

trudax avatar

Some subreddits don't have a long history of posts available. Can you see older posts directly on the website that you cannot get on the actor run?