Pay $4.00 for 1,000 results
Reddit Scraper Lite
Pay $4.00 for 1,000 results
Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
Scraping outside of the URL?
Closed
I dont think this reddit scraper is working right.
- here's the URLs i wanted to scrape https://console.apify.com/actors/oAuCIx3ItNrs2okjQ/runs/02ZQthreq4q3wymAB#output
- Here's what I tried https://chat.openai.com/share/5fbfa1ba-3fa3-413c-8814-5ae4385694ea
- The problem is that a) its getting really expensive and I don't know how to turn it off and b) it's scraping things outside of the URL inputs I set.
chinolex
Following up here, thanks! Let me know if there is anything I can help with.
If you use a search URL it will go to each page of the results until no result is found or it reaches the limit specified on the input. Do you have an example of something that scraped outside of the scope you wanted?
Also, you can abort a run using Apify's user interface, which will stop the current run.
chinolex
I entered Specific sub Reddit URL’s with a search, specific, sub, Reddit, and a site search of Solar. Can you take a look at my URLs?
One of your search terms is just solar, so it is returning any post or comment with that term in it.
chinolex
Got it. What about the subreddit + solar? Does it scrape all the posts in the subreddit with that? Not sure if that works
If you are using the subreddit + solar search as a startUrl it will work since it's pagination the results of that URL.
chinolex
It will work… great!
Gustavo Rudiger- 133 monthly users
- 99.8% runs succeeded
- 0.51 days response time
- Created in Jun 2020
- Modified about 6 hours ago
