Reddit Scraper avatar

Reddit Scraper

Try for free

1 day trial then $45.00/month - No credit card required now

View all Actors
Reddit Scraper

Reddit Scraper

trudax/reddit-scraper
Try for free

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

MS

Can't limit number of posts

Closed

mykola_scrapes opened this issue
4 months ago

I'd like to limit number of posts scraped, for example scrape 5 posts, but when I set maxPostCount to 5 - I get more posts scraped.

Is this expected behaviour and if yes - is there other way for me to specifically limit posts number?

trudax avatar

maxItems is set to 1000 in your input

trudax avatar

Do you want to scrape just 5 posts and all comments from them?

MS

mykola_scrapes

4 months ago

Yes, just 5 posts and comments from them

trudax avatar

I am working on a fix

MS

mykola_scrapes

4 months ago

Additional info: maxPostCount works as expected when using this as a startUrl: https://www.reddit.com/search/?q=pension+consolidation

trudax avatar

Sorry for the delay. It should be working now.

Developer
Maintained by Community

Actor Metrics

  • 324 monthly users

  • 58 stars

  • >99% runs succeeded

  • 1.3 days response time

  • Created in Feb 2022

  • Modified 11 days ago

Categories