Pay $4.00 for 1,000 results
Reddit Scraper Lite
Pay $4.00 for 1,000 results
Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
Cannot figure out how to scrape keyword data within a subreddit
Closed
I am trying to scrape data from a subreddit with a keyword, and I cannot figure out how to do it. If I use a start URL for the subreddit, it ignores the search term, if i use a start URL for the subreddit with the search, it doesn't pull body text, and if i put the subreddit in the search term, it fully ignores it. I understand this is probably something I'm doing wrong, but any help at all would be very appreciated.
Start URLs and search are independent. If you choose to use search it will ignore the start URLs. Using the subreddit URL will get all the posts on that subreddit. If you are trying to filter the results inside a subreddit you can do a search inside Reddit and when you see the results correspond to what you want, you copy that URL into the Start URLs of the scraper.
Actually, the search will not be ignored but both searches will occur independently.
Gustavo Rudiger- 133 monthly users
- 99.8% runs succeeded
- 0.51 days response time
- Created in Jun 2020
- Modified about 4 hours ago
