Reddit Scraper Lite avatar
Reddit Scraper Lite

Pricing

Pay per event

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

Developed by

Gustavo Rudiger

Gustavo Rudiger

Maintained by Community

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (3)

Pricing

Pay per event

155

Total users

6.4k

Monthly users

805

Runs succeeded

71%

Issues response

17 hours

Last modified

a month ago

JT

Cannot figure out how to scrape keyword data within a subreddit

Closed

japan_temperature opened this issue
a year ago

I am trying to scrape data from a subreddit with a keyword, and I cannot figure out how to do it. If I use a start URL for the subreddit, it ignores the search term, if i use a start URL for the subreddit with the search, it doesn't pull body text, and if i put the subreddit in the search term, it fully ignores it. I understand this is probably something I'm doing wrong, but any help at all would be very appreciated.

trudax avatar

Start URLs and search are independent. If you choose to use search it will ignore the start URLs. Using the subreddit URL will get all the posts on that subreddit. If you are trying to filter the results inside a subreddit you can do a search inside Reddit and when you see the results correspond to what you want, you copy that URL into the Start URLs of the scraper.

trudax avatar

Actually, the search will not be ignored but both searches will occur independently.