Pricing

$45.00/month + usage

Go to Store

Reddit Scraper

Try for free

Developed by

Gustavo Rudiger

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (2)

Pricing

$45.00/month + usage

120

Total users

7.1K

Monthly users

464

Runs succeeded

>99%

Issues response

2.4 days

Last modified

15 days ago

Social media

Back to issues Create new issue

won't collect beyond a certain limit

Closed

lemon_normalcy opened this issue

I've tried two different runs now of trying to collect a significant portion of a subreddit's activity (2+ years), but the scraper stops after about 50,000 lines of data

runs: https://li2vbaesoevb.runs.apify.net and https://cargcpdn5cbn.runs.apify.net

one further detail or question - it'd be great to pick up where a previous run stopped. is there some way to use the previous pagination marker to start collecting where it left off?

Gustavo Rudiger (trudax)

can you share the run ID?

lemon_normalcy

I think they're both in the original post aren't they? Those 2 links?

Gustavo Rudiger (trudax)

I don't think so, there is no usefull information when I click on those links. Ff you go to the run you should be able to see a share button on the right upper side that will provide you with the correct link.

lemon_normalcy

Sorry about that. Here you go:

https://console.apify.com/view/runs/dP9XSbh7cxCArL5c8 (first run)

https://console.apify.com/view/runs/GkjTkfGQ9cNnN9JpF (second run)

lemon_normalcy

what do you think?

Gustavo Rudiger (trudax)

I will try to replicate the run here but at first glance, I don't see anything wrong besides some blocked request, but that is expected.

lemon_normalcy

okay - what about picking up a new run where the old one left off though? currently there isn't an option to do that.

lemon_normalcy

what do you think?

Gustavo Rudiger (trudax)

I have got the same results, seems like it is returning everything that it can.

lemon_normalcy

right - but my question is why we can't start the scraping at somewhere other than the beginning of the subreddit?

Gustavo Rudiger (trudax)

You can, you just need to know the last URL used for paginating.

lemon_normalcy

Okay. How do I implement that within this actor then?

Gustavo Rudiger (trudax)

I will add a change to log the last page so you can copy from the logs and use it.

lemon_normalcy

okay - where do I paste in the last URL used?

lemon_normalcy

hello?

Gustavo Rudiger (trudax)

the last usedr url is on the logs

Add comment

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

7.2K

3.9

Reddit Posts Scraper

vulnv/reddit-posts-scraper

Unlimited Reddit web scraper to crawl posts, comments and subreddits without login.

VulnV

5.0

Reddit scraper

curious_coder/reddit-scraper

Scrape reddit posts and comments from reddit search and communities

Curious Coder

249

(New) Reddit Scraper Pro - Fast, Affordable, Supported

harshmaur/reddit-scraper-pro

Reddit Scraper Pro is a powerful, user-friendly tool for extracting data from Reddit without API limitations. Offers scraping of posts, users, comments, and communities, advanced search capabilities, and multiple export options. Perfect for brand monitoring, trend tracking, and competitor research.

Harsh Maur

410

5.0

Reddit API Scraper

comchat/reddit-api-scraper

Reddit Scraper is a powerful tool that allows you to extract data from Reddit such as posts by keyword. With Reddit Scraper, you can easily gather valuable information from Reddit without the need to log in. You can easily use this Reddit scraper as an alternative API.

Comchat

926

1.0

Reddit Scraper For Posts & Comments

creative_tablecloth/reddit-scraper-for-posts

Access Reddit data freely without authentication. Quickly extract detailed information from Reddit posts and comments, both efficiently and cost-effectively. (approx $0.015 for 1,000 results)

Jinny Kim

229

Reddit Posts Search Scraper

easyapi/reddit-posts-search-scraper

Extract Reddit posts from search results with rich metadata, including media content, engagement metrics, and community information. Perfect for content research, trend analysis, and social media monitoring across Reddit communities.

EasyApi

5.0

Reddit Scraper

epctex/reddit-scraper

Tap into the wealth of Reddit's data with our Reddit Scraper. Extract valuable insights from posts, subreddits, comments, and user data effortlessly. Simplify analysis and gain valuable insights from the diverse Reddit community with our user-friendly and efficient tool.

epctex

888

Reddit Comments Scraper

easyapi/reddit-comments-scraper

Extract Reddit comments with their complete thread structure, including nested replies, user information, and engagement metrics. Perfect for analyzing discussions, sentiment analysis, and tracking community engagement on Reddit posts.

EasyApi

Reddit Scraper (9$/month)

maged120/reddit-scraper

Fastest, the most affordable, and stable, doesn't need any login or auth, scrapes data (detailed posts, comments with votes, media, links, and replies) from Reddit based on a provided subreddit, username, specific link, or the homepage, with an optional limit on the number of posts retrieved.