Reddit Scraper Lite avatar
Reddit Scraper Lite

Pricing

Pay per event

Go to Store
Reddit Scraper Lite

Reddit Scraper Lite

Developed by

Gustavo Rudiger

Maintained by Community

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

5.0 (2)

Pricing

Pay per event

130

Monthly users

649

Runs succeeded

76%

Response time

2.5 days

Last modified

a day ago

CH

Scraping outside of the URL?

Closed

chinolex opened this issue
a year ago

I dont think this reddit scraper is working right.

  1. here's the URLs i wanted to scrape https://console.apify.com/actors/oAuCIx3ItNrs2okjQ/runs/02ZQthreq4q3wymAB#output
  2. Here's what I tried https://chat.openai.com/share/5fbfa1ba-3fa3-413c-8814-5ae4385694ea
  3. The problem is that a) its getting really expensive and I don't know how to turn it off and b) it's scraping things outside of the URL inputs I set.
CH

chinolex

a year ago

Following up here, thanks! Let me know if there is anything I can help with.

trudax avatar

If you use a search URL it will go to each page of the results until no result is found or it reaches the limit specified on the input. Do you have an example of something that scraped outside of the scope you wanted?

trudax avatar

Also, you can abort a run using Apify's user interface, which will stop the current run.

CH

chinolex

a year ago

I entered Specific sub Reddit URL’s with a search, specific, sub, Reddit, and a site search of Solar. Can you take a look at my URLs?

trudax avatar

One of your search terms is just solar, so it is returning any post or comment with that term in it.

CH

chinolex

a year ago

Got it. What about the subreddit + solar? Does it scrape all the posts in the subreddit with that? Not sure if that works

trudax avatar

If you are using the subreddit + solar search as a startUrl it will work since it's pagination the results of that URL.

CH

chinolex

a year ago

It will work… great!

Pricing

Pricing model

Pay per event 

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Actor start per 1 GB

$0.02

Flat fee for starting an Actor run for each 1 GB of memory.

Result stored

$0.004

Cost per result stored.