Reddit Posts & Comments Scraper - Subreddits & Search
Pricing
from $0.90 / 1,000 post scrapes
Reddit scraper for subreddit feeds, keyword search, user submissions and full comment threads. Returns score, upvote ratio, comment count, flair, awards and media URLs per post, with nested comment trees. No login, no API key, no rate-limit quota.
Subreddits to read, one per line. Accepts a bare name (programming), the r/ shorthand (r/programming), or a full URL. Reddit serves at most about 1,000 posts per subreddit feed, so to go deeper use a narrower sort or timeframe rather than a bigger limit.
Keyword searches to run, one per line. Reddit's own search operators work here, including quoted phrases, OR, and flair:"name". Leave Search inside subreddits empty to search all of Reddit.
Restrict every search keyword to these subreddits, one per line. Accepts a bare name, the r/ shorthand, or a full URL. Reddit cannot restrict one search to several subreddits at once, so each keyword and subreddit pair is run as its own search. Ignored when Search keywords is empty. If you fill this in and none of the names can be read, the searches are NOT run against all of Reddit instead - you get a bad-input row per unreadable name, because widening a scoped search silently would return the wrong data at full price.
Users whose submitted posts you want, one per line. Accepts spez, u/spez or a profile URL. Returns posts only; a user's comments are not part of this listing.
Any mix of Reddit URLs: subreddit pages, user profiles, search result pages with a ?q= term, and individual post permalinks (including redd.it short links). A post URL always returns its comment thread, because Reddit serves a post and its comments in a single response.
How Reddit should rank the feed. Reddit supports a different set per source type and silently ignores the rest, so an unsupported choice is swapped for the closest one and reported in the log: subreddits accept hot, new, top, rising and controversial; users accept hot, new, top and controversial; searches accept relevance, hot, top, new and most comments.
The window Top and Controversial rank over, and the window every search is limited to. Ignored by Hot, New and Rising, which have no time window.
Keep only text posts, only outbound links, only images, or only videos. Image also keeps multi-image galleries. Filtered posts are never written and never charged.
Skip posts scoring below this. Reddit fuzzes scores slightly to frustrate vote manipulation, so treat a threshold as approximate. Negative values are allowed.
Skip posts with fewer comments than this. Useful when you want discussion rather than reach, and it cuts the cost of a comments run sharply.
Drop the moderator posts pinned to the top of a subreddit. They appear on every page of a feed and are almost never the data you want.
Keep posts Reddit marks over-18. Turn this off to drop them.
Fetch the comment thread for every post that passes the filters. This costs one extra request per post, so a run with comments takes far longer than the same run without them: budget roughly one post per second per worker instead of a hundred. Use Minimum comment count to spend that time only where there is a discussion to read.
Upper bound on comment rows per post, counted depth-first so a parent always comes before its replies. 500 is Reddit's ceiling, not ours: its comments endpoint returns at most 500 nodes per request, so a larger number here could never be reached. Reddit also withholds the tail of a very large thread behind 'load more' stubs; when that happens the post row is marked commentsTruncated true rather than pretending the thread was complete.
How Reddit should order the comment tree. Best is Reddit's own default ranking.
Output cap per subreddit, search or user. Reddit stops paginating a single listing at about 1,000 posts however many pages are requested, so 1,000 is the ceiling here too.
Hard cap across every source, so a long list of subreddits cannot run away with the bill. Reached first, it stops the run and every remaining source gets a summary row saying so.
Work cap: pages read per source, at 100 posts a page. Ten pages covers the whole reachable feed. The extra headroom is for a shifting listing that repeats posts across pages, which Hot constantly does, since repeats are discarded and do not count toward the post cap.
How many requests may be in flight at once, across the whole run rather than per source.
Minimum gap between the start of one request and the next, applied globally rather than per worker, so this really is the run's request rate. Raise it if the log reports HTTP 429.
Leave this alone unless you know otherwise. Reddit refuses plain datacenter and residential IPs alike on these endpoints - measured, both returned a byte-identical HTTP 403 - so the Actor defaults to the Apify Unblocker group, which is the only one that gets through. Unblocker bills per request rather than per gigabyte, and one request carries up to 100 posts.
{ "useApifyProxy": true, "apifyProxyGroups": [ "UNBLOCKER" ]}