Reddit Scraper avatar
Reddit Scraper
Try for free

1 day trial then $45.00/month - No credit card required now

View all Actors
Reddit Scraper

Reddit Scraper

trudax/reddit-scraper
Try for free

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

MS

Can't limit number of posts

Closed

mykola_scrapes opened this issue
a month ago

I'd like to limit number of posts scraped, for example scrape 5 posts, but when I set maxPostCount to 5 - I get more posts scraped.

Is this expected behaviour and if yes - is there other way for me to specifically limit posts number?

trudax avatar

maxItems is set to 1000 in your input

trudax avatar

Do you want to scrape just 5 posts and all comments from them?

MS

mykola_scrapes

a month ago

Yes, just 5 posts and comments from them

trudax avatar

I am working on a fix

MS

mykola_scrapes

a month ago

Additional info: maxPostCount works as expected when using this as a startUrl: https://www.reddit.com/search/?q=pension+consolidation

trudax avatar

Sorry for the delay. It should be working now.

Developer
Maintained by Community
Actor metrics
  • 366 monthly users
  • 37 stars
  • 99.9% runs succeeded
  • 1.2 days response time
  • Created in Feb 2022
  • Modified 9 days ago
Categories