Reddit Subreddit & Search Scraper (Posts, Scores)
Pricing
from $0.84 / 1,000 posts
Reddit Subreddit & Search Scraper (Posts, Scores)
Collect public Reddit subreddit posts and search results when available. Rows include title, author, time and link. Scores, comment counts and flair depend on the source; search may be blocked by Reddit.
Pricing
from $0.84 / 1,000 posts
Rating
0.0
(0)
Developer
Murat Uzun
Maintained by CommunityActor stats
0
Bookmarked
3
Total users
2
Monthly active users
21 hours ago
Last modified
Categories
Features
Share
What is Reddit Subreddit & Search Scraper?
Reddit is closing public access. Reddit announced that it shuts down its RSS feeds on November 13, 2026 and its public API by March 2027 (heise, checked November 16, 2026). This Actor reads the public subreddit feed, which still answered on November 16, 2026. When Reddit refuses every request of a run, the run now fails with
zeroResultReason: "REDDIT_ACCESS_CLOSED"so your schedule or webhook alerts you, and you are not charged for any post.
For researchers and community analysts who need Reddit posts as structured data. Pricing is USD 0.00005 per run start, plus USD 0.00084–0.0014 per accepted dataset post, depending on your Apify tier (native pricing snapshot: 13 November 2026, 12:28 UTC). A run with no saved posts can still incur the start fee.
Reddit Subreddit & Search Scraper collects posts from subreddit listings (hot, new, top, rising, controversial), with a public feed fallback, and attempts Reddit-wide search through the search feed. Each saved post becomes one dataset row. Fields depend on what Reddit serves: listing rows can include score, comment count, upvote ratio and flair; all four are null in public feed rows. Search HTTP 403 is reported as SEARCH_BLOCKED; there is no search fallback. No Reddit login and no API key are needed.
Why use Reddit Subreddit & Search Scraper?
- Score and comment count when Reddit serves them in subreddit listing cards; these fields are
nullin the public feed fallback. - Reddit-wide keyword search when Reddit serves its search feed; HTTP 403 produces
SEARCH_BLOCKEDwith no search fallback. - Post charges apply to accepted dataset posts, plus a USD 0.00005 run-start fee. Zero-result or failed attempts with no accepted posts incur no post charge, but the start fee can still apply.
- Runs through Apify Residential proxies, because Reddit blocks datacenter IPs.
How to use Reddit Subreddit & Search Scraper
- Enter one or more subreddits (
webscrapingorr/webscraping) and/or search queries. - Choose the sort and, for Top or Controversial, the timeframe.
- Set the maximum posts per subreddit and run it.
- Download the dataset as JSON, CSV, Excel or HTML, or read it through the API.
Example input
{"subreddits": ["programming"],"sort": "top","timeframe": "week","maxPostsPerSubreddit": 30,"searchQueries": []}
Example output
A real row from a run on 2026-10-23 (subreddit programming, sort Top, timeframe week):
{"source": "subreddit","query": "programming","postId": "t3_1xbl8y1","title": "Eight Bits of Trust; eMudhra's CA keys cracked in milliseconds","subreddit": "programming","author": "Dear-Economics-315","score": 899,"commentCount": 151,"upvoteRatio": 0.9827956989247312,"createdAt": "2026-10-21T12:01:54.307Z","postType": "link","domain": "scotthelme.co.uk","flair": null,"url": "https://www.reddit.com/r/programming/comments/1xbl8y1/eight_bits_of_trust_emudhras_ca_keys_cracked_in/","snippet": null,"language": "en","listing": "top/week","position": 1}
When the search feed is available, search rows have source: "search", the search text in query, and via: "feed". Score, comment count, upvote ratio, flair and language are null. A snippet is included when available; post type and domain are derived from the feed link when possible, otherwise null. If search returns HTTP 403, the query produces no rows and is reported as SEARCH_BLOCKED in OUTPUT.errors; no alternate search source is tried.
Data table
| Field | Subreddit listing rows | Subreddit feed rows | Search feed rows |
|---|---|---|---|
postId, title, author, url, createdAt, subreddit | Parsed from listing cards when available | Parsed from the feed when available | Parsed from the feed when available |
score, commentCount, upvoteRatio, flair | Value when available, otherwise null | null | null |
postType, domain | Value when available, otherwise null | Derived from the feed link when possible, otherwise null | Derived from the feed link when possible, otherwise null |
language | Value when available, otherwise null | null | null |
snippet (start of the post text) | null | Text when available, otherwise null | Text when available, otherwise null |
listing | sort (for example hot, top/week) | sort (for example hot, top/week) | search |
via | listing | feed | feed |
When Reddit blocks the listing
Since 13 Nov 2026 Reddit often blocks its post listing (HTTP 403) for automated clients, also through residential proxies, and shows a JavaScript check on the subreddit page. This Actor does not try to get around that check. It switches to Reddit's public subreddit feed instead: fields are parsed from the feed when available, with post type and domain derived from its links. The feed has no score, comment count, upvote ratio or flair, so those stay null and the row says via: "feed". The listing is still tried first, so score and comment count can be populated when Reddit serves listing cards containing those values again.
Errors and the OUTPUT record
Every run writes an OUTPUT record: posts, jobs, failedJobs, errors (each with job, errorCode, error), viaFeed (rows from the feed), feedMissingFields and a reason when nothing was saved. A run that saves nothing still succeeds and says why in its status message, except when Reddit refused every request (BLOCKED, SEARCH_BLOCKED or FETCH_FAILED for all jobs): then the run fails with zeroResultReason: "REDDIT_ACCESS_CLOSED". A failed job with no accepted posts incurs no post charge; posts accepted before a later failure remain billable. The run-start fee can still apply.
errorCode | Meaning | What to do |
|---|---|---|
BLOCKED | Reddit blocked both the listing and the feed (HTTP 403) | Run again later; keep the RESIDENTIAL proxy group |
SEARCH_BLOCKED | Reddit blocks its search feed for automated clients (HTTP 403) | Use subreddit listings, or run again later |
NOT_FOUND | The subreddit does not exist (HTTP 404) | Check the name |
NO_POSTS | The subreddit has no posts (empty, private or banned) | Check the name or try another sort |
FETCH_FAILED | Network error or another HTTP status | Run again |
REDDIT_ACCESS_CLOSED (OUTPUT.zeroResultReason) | Reddit refused every request of the run; the run fails | Reddit is closing its feeds; check the notice at the top |
Input parameters
- Subreddits: subreddit names or subreddit URLs.
- Search queries: Reddit-wide search terms. Each query can return up to 25 posts when the search feed is available. HTTP 403 yields
SEARCH_BLOCKEDand no rows for that query; there is no search fallback. - Subreddit sort: hot, new, top, rising or controversial.
- Timeframe: used for Top and Controversial, and for search when the search sort is Top.
- Search sort: relevance, new, top or most comments.
- Max posts per subreddit: 1 to 1000. Reddit returns about 24 posts per page. A listing can end before the maximum.
- Proxy configuration: keep the RESIDENTIAL group.
- Max concurrency: how many subreddits or searches run at the same time.
Pricing
Source: native Actor pricing snapshot supplied for this maintenance review, 13 November 2026, 12:28 UTC. Prices below are in USD; check the Actor pricing page before running for subsequent changes.
The apify-actor-start event costs 0.00005 per run, in addition to the price per accepted dataset post:
| Apify tier | USD per accepted post | USD for 1,000 accepted posts, excluding start fee |
|---|---|---|
| FREE | 0.0014 | 1.40 |
| BRONZE | 0.00112 | 1.12 |
| SILVER | 0.00098 | 0.98 |
| GOLD / PLATINUM / DIAMOND | 0.00084 | 0.84 |
Zero or failed results with no accepted posts have no post charge; the start fee can still apply. For example, 10 accepted posts on FREE total USD 0.01405 in these event charges, including one run start.
The Actor uses Apify's charging manager to calculate a post allowance and checks it before saving rows. This is not a verified hard spending guarantee: concurrent workers check a shared count that is updated after an asynchronous save. Treat maxTotalChargeUsd as a platform run setting, not an input field or a promise that this code cannot exceed a budget.
Reddit Subreddit & Search Scraper vs. the Reddit API
The official Reddit API needs an application and OAuth. This Actor reads the public pages that Reddit serves to visitors, so it needs no account. It does not provide comment bodies, post bodies, user profiles or private or quarantined communities.
Using Reddit Subreddit & Search Scraper with AI agents and MCP
These examples request the same small input: at most 3 posts from webscraping, with search disabled and one worker. They show how to use the Actor; they were not executed against the live service in this maintenance review. Running them starts a billable run. An Apify API token is required for the API examples; no Reddit login is needed.
JavaScript (Node.js with built-in fetch)
const input = {subreddits: ['webscraping'], searchQueries: [], sort: 'hot',timeframe: 'week', maxPostsPerSubreddit: 3, maxConcurrency: 1,};const response = await fetch('https://api.apify.com/v2/acts/webdatatools~reddit-scraper/run-sync-get-dataset-items',{method: 'POST',headers: {Authorization: `Bearer ${process.env.APIFY_TOKEN}`,'Content-Type': 'application/json',},body: JSON.stringify(input),},);if (!response.ok) throw new Error(`Apify HTTP ${response.status}`);const rows = await response.json();for (const row of rows) console.log(row.postId, row.title, row.via, row.score);
Python (standard library)
import jsonimport osfrom urllib.request import Request, urlopenactor_input = {"subreddits": ["webscraping"], "searchQueries": [], "sort": "hot","timeframe": "week", "maxPostsPerSubreddit": 3, "maxConcurrency": 1,}request = Request("https://api.apify.com/v2/acts/webdatatools~reddit-scraper/run-sync-get-dataset-items",data=json.dumps(actor_input).encode(),headers={"Authorization": "Bearer " + os.environ["APIFY_TOKEN"],"Content-Type": "application/json",},method="POST",)with urlopen(request, timeout=330) as response:rows = json.load(response)for row in rows:print(row["postId"], row["title"], row["via"], row["score"])
CLI (curl)
With your Apify token already set in APIFY_TOKEN:
curl --fail-with-body --request POST \'https://api.apify.com/v2/acts/webdatatools~reddit-scraper/run-sync-get-dataset-items' \--header "Authorization: Bearer $APIFY_TOKEN" \--header 'Content-Type: application/json' \--data '{"subreddits":["webscraping"],"searchQueries":[],"sort":"hot","timeframe":"week","maxPostsPerSubreddit":3,"maxConcurrency":1}'
These synchronous API calls return dataset rows. An empty array alone does not explain why no posts were saved: inspect the run's OUTPUT key-value record and status in Apify Console. A client timeout does not prove the run stopped; inspect its status before retrying to avoid starting another billable run.
MCP
In a client connected to the Apify MCP server, use this request:
Run
webdatatools/reddit-scraperwith{"subreddits":["webscraping"],"searchQueries":[],"sort":"hot","timeframe":"week","maxPostsPerSubreddit":3,"maxConcurrency":1}. Return the dataset rows withpostId,title,url,viaandscore, and read the run'sOUTPUTrecord for errors. Keep missing scores as null. Do not retry automatically.
Tool availability depends on the connected MCP client's configuration. The same start and post charges apply. Feed rows have via: "feed" and score: null; listing scores are populated only when available.
FAQ
What does a small run cost? For the listed event prices, add USD 0.00005 per run start to the accepted post count multiplied by your tier's post rate. Three accepted posts on FREE cost USD 0.00425 in event charges. These are examples, not a guarantee that three posts will be available.
Are empty or failed runs free?
No post charge applies when no posts are accepted, but the start fee can still apply. A failure after some posts were accepted does not make those posts free. Check OUTPUT.posts, OUTPUT.errors and the run's actual charges.
Does maxTotalChargeUsd guarantee the final bill? The source checks a calculated post allowance, but its concurrent save logic does not establish a strict total-cost guarantee. Set a small post limit and inspect actual run charges; see Pricing for the limitation.
Why do some runs return fewer posts than I asked for? Reddit ends a listing after a limited number of posts for some sorts and communities. The Actor stops when Reddit returns no new posts.
Why is score empty for search results?
Reddit's search feed does not include score, comment count, upvote ratio or flair, so all four are null. Subreddit listing cards may provide them, but the public subreddit feed fallback does not. If the search feed returns HTTP 403, the query produces no rows and reports SEARCH_BLOCKED; there is no search fallback.
Why is score empty for some subreddit rows?
Rows with via: "feed" have null score, comment count, upvote ratio and flair: the Actor used the public feed after the listing was blocked or returned no post cards. A listing row can also have null values when the card omits them. See "When Reddit blocks the listing" above.
Does it collect comments? No. Comment pages were not reachable through the residential route during testing (2026-10-23), so comments are not included.
Does it work from a datacenter IP? No. Reddit returned HTTP 403 for direct datacenter requests. Keep the RESIDENTIAL proxy group.
Support and feedback
If you find a problem, open an issue in the Actor's Issues tab. After using the Actor, you are welcome to leave an honest review of your experience; no reward or positive rating is requested.