Reddit Scraper Lite avatar

Reddit Scraper Lite

Try for free

Pay $4.00 for 1,000 results

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

trudax/reddit-scraper-lite
Try for free

Pay $4.00 for 1,000 results

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

AM

Why am I getting some community results even though I set searchCommunities: false

Closed

artistic_mirror opened this issue
3 months ago

Here's my input: { "startUrls": [ { "url": "https://www.reddit.com/r/seduction" } ], "searchPosts": true, "searchComments": false, "searchCommunities": false, "searchUsers": false, "includeNSFW": false, "maxItems": 5, "maxPostCount": 5, "maxComments": 0, "maxCommunitiesCount": 2, "maxUserCount": 2, "scrollTimeout": 40, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] }, "debugMode": false, "sort": "new", "time": "week", "skipComments": false, "skipUserPosts": false }

trudax avatar

The searchCommunities only affects search, since you are using a start URL it will not work. I have added a new parameter called "Skip community" on the lastest version that you can set to true to get what you want.

Developer
Maintained by Community

Actor Metrics

  • 316 monthly users

  • 57 stars

  • 62% runs succeeded

  • 13 hours response time

  • Created in Jun 2020

  • Modified 11 hours ago