# Reddit Scraper - Posts, Comments, Subreddits & User Profiles (`convertfleetdotonline/reddit-scraper`) Actor Scrape Reddit posts, comments, subreddit communities, and user profiles by keyword or URL. Supports NSFW filter, sort, and time-range options. Powered by the Apify API for reliable, scalable Reddit data extraction. - **URL**: https://apify.com/convertfleetdotonline/reddit-scraper.md - **Developed by:** [Hasnain Nisar](https://apify.com/convertfleetdotonline) (community) - **Categories:** Social media, Lead generation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing $0.80 / 1,000 item scrapeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Reddit Scraper - Posts, Comments, Subreddits & Users (No API Key) **Scrape Reddit at scale without an API key, OAuth, or developer account.** Pull posts, comments, subreddit communities, and user profiles by keyword or URL — with NSFW filtering, sort order, and time-range controls. ### What this Reddit Scraper does The actor uses Reddit's public JSON API (the same one that powers `old.reddit.com` and is freely accessible) and supports four search dimensions in one run: - **Posts** — keyword search across all of Reddit or restricted to a subreddit - **Comments** — keyword search inside Reddit comment bodies - **Communities (subreddits)** — find subreddits matching a keyword - **URLs** — pass any Reddit URL (subreddit, single post, user profile) and the actor routes it correctly You also get optional **comment scraping per post**, NSFW filtering, sort by new/hot/top/relevance/comments, and time-range filters (hour/day/week/month/year/all). ### Why use this Reddit Scraper? - **No Reddit API key required** — bypass OAuth and the new pricing tier - **No rate-limit headaches** — the actor handles 429 backoff automatically - **One-shot multi-mode** — search posts + comments + communities in a single run - **URL-aware** — paste subreddit / post / user URLs and let the actor route - **NSFW toggle** — opt in or out cleanly - **Comment expansion** — pull top-level comments per post in the same run ### Use cases - **Brand monitoring** — track every mention of your brand or product - **Sentiment analysis** — feed Reddit comments into your AI/ML pipeline - **Audience research** — find which subreddits your audience hangs out in - **Trend tracking** — surface trending posts in your niche - **Influencer discovery** — find prolific posters in target subreddits - **Content ideation** — see what's getting upvoted in your category - **Lead generation** — spot people asking for the product you sell - **Academic research** — public-domain data for social science studies ### Input Search by keyword: ```json { "keywords": ["bitcoin", "ethereum"], "searchPosts": true, "searchComments": false, "searchCommunities": true, "communityFilter": "", "sortBy": "new", "timeRange": "week", "includeNsfw": false, "maxPosts": 100, "maxCommunities": 10 } ```` Scrape a specific subreddit: ```json { "urls": ["https://www.reddit.com/r/programming"], "scrapeComments": true, "maxPosts": 50, "maxCommentsPerPost": 20 } ``` Scrape a specific post + its comments: ```json { "urls": ["https://www.reddit.com/r/programming/comments/abc123/"], "scrapeComments": true } ``` ### Output Each post: ```json { "type": "post", "id": "abc123", "title": "Title of the post", "body": "Self-text (empty for link posts)", "subreddit": "programming", "author": "username", "ups": 4521, "num_comments": 234, "created_utc": 1735689600, "url": "https://www.reddit.com/r/programming/comments/abc123/title/", "is_nsfw": false, "score": 4521, "link_flair": "Discussion" } ``` Each comment has `type: "comment"`. Each community has `type: "community"` with `num_comments` repurposed as `subscribers`. ### How it works The actor uses Reddit's public JSON API (`reddit.com/...json` endpoints) — the same machine-readable surface Reddit has supported since 2009. No login, no OAuth, no developer account. Built-in 429 retry-after handling keeps runs reliable. ### Cost & speed A 100-post keyword search completes in 5–10 seconds. With comment expansion (10 posts × 10 comments each) it takes 20–30 seconds. Memory usage stays under 256 MB. ### Related actors - **Twitter / X Scraper** — bulk tweet scraping - **TikTok Scraper** — TikTok by hashtag, profile, search - **LinkedIn Profile Scraper** — bulk LinkedIn profile extraction - **YouTube Channel Scraper** — bulk YouTube video metadata ### FAQ **Q: Do I need a Reddit account?** No. **Q: Will Reddit ban me?** No — the actor uses public JSON endpoints with realistic browser headers and respects `Retry-After` on 429 responses. **Q: Can I scrape entire subreddits historically?** The Reddit listing API caps at ~1,000 posts per sort order. For deeper history, run the actor multiple times with different `sortBy` values (new, top, hot) to capture different slices. **Q: How accurate is the comment scrape?** Top-level comments only — Reddit returns these in the post's `.json` endpoint. Nested replies are not currently expanded. **Q: Is this legal?** Reddit's public JSON endpoints are explicitly accessible to anyone. Always comply with Reddit's User Agreement and your local data-protection laws when storing personal data. # Actor input Schema ## `keywords` (type: `array`): Search terms to query Reddit for. Leave empty if scraping by URL only. ## `urls` (type: `array`): Direct Reddit URLs - subreddits (/r/), single posts (/comments/), or user profiles (/user/). ## `searchPosts` (type: `boolean`): Include posts in keyword searches. ## `searchComments` (type: `boolean`): Include comments in keyword searches. ## `searchCommunities` (type: `boolean`): Include subreddit communities in keyword searches. ## `communityFilter` (type: `string`): Optional - restrict keyword searches to a single subreddit (without /r/). ## `sortBy` (type: `string`): Reddit sort order applied to keyword searches. ## `timeRange` (type: `string`): Time window for keyword searches (only applies to certain sort orders). ## `scrapeComments` (type: `boolean`): If true, also pull top-level comments for each post returned. ## `includeNsfw` (type: `boolean`): Include results flagged as NSFW (over\_18). ## `maxPosts` (type: `integer`): Maximum number of posts to return per query/URL. ## `maxComments` (type: `integer`): Maximum number of comments to return when scraping comment search. ## `maxCommentsPerPost` (type: `integer`): When 'Scrape comments per post' is on, the max comments returned per post. ## `maxCommunities` (type: `integer`): Maximum number of subreddit communities to return per community search. ## `proxyConfiguration` (type: `object`): Routes Reddit requests through Apify Proxy. Reddit blocks datacenter IPs — residential proxy is required. ## Actor input object example ```json { "keywords": [ "bitcoin" ], "urls": [], "searchPosts": true, "searchComments": false, "searchCommunities": false, "communityFilter": "", "sortBy": "new", "timeRange": "all", "scrapeComments": false, "includeNsfw": false, "maxPosts": 25, "maxComments": 10, "maxCommentsPerPost": 10, "maxCommunities": 5, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "keywords": [ "bitcoin" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("convertfleetdotonline/reddit-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "keywords": ["bitcoin"], "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("convertfleetdotonline/reddit-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "keywords": [ "bitcoin" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call convertfleetdotonline/reddit-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=convertfleetdotonline/reddit-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Reddit Scraper - Posts, Comments, Subreddits & User Profiles", "description": "Scrape Reddit posts, comments, subreddit communities, and user profiles by keyword or URL. Supports NSFW filter, sort, and time-range options. Powered by the Apify API for reliable, scalable Reddit data extraction.", "version": "0.1", "x-build-id": "NRV2AXVkXSg9TaFOP" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/convertfleetdotonline~reddit-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-convertfleetdotonline-reddit-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/convertfleetdotonline~reddit-scraper/runs": { "post": { "operationId": "runs-sync-convertfleetdotonline-reddit-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/convertfleetdotonline~reddit-scraper/run-sync": { "post": { "operationId": "run-sync-convertfleetdotonline-reddit-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "keywords": { "title": "Keywords / search terms", "type": "array", "description": "Search terms to query Reddit for. Leave empty if scraping by URL only.", "default": [], "items": { "type": "string" } }, "urls": { "title": "Reddit URLs", "type": "array", "description": "Direct Reddit URLs - subreddits (/r/), single posts (/comments/), or user profiles (/user/).", "default": [], "items": { "type": "string" } }, "searchPosts": { "title": "Search posts", "type": "boolean", "description": "Include posts in keyword searches.", "default": true }, "searchComments": { "title": "Search comments", "type": "boolean", "description": "Include comments in keyword searches.", "default": false }, "searchCommunities": { "title": "Search communities", "type": "boolean", "description": "Include subreddit communities in keyword searches.", "default": false }, "communityFilter": { "title": "Restrict to subreddit", "type": "string", "description": "Optional - restrict keyword searches to a single subreddit (without /r/).", "default": "" }, "sortBy": { "title": "Sort by", "enum": [ "new", "hot", "top", "relevance", "comments" ], "type": "string", "description": "Reddit sort order applied to keyword searches.", "default": "new" }, "timeRange": { "title": "Time range", "enum": [ "all", "year", "month", "week", "day", "hour" ], "type": "string", "description": "Time window for keyword searches (only applies to certain sort orders).", "default": "all" }, "scrapeComments": { "title": "Scrape comments per post", "type": "boolean", "description": "If true, also pull top-level comments for each post returned.", "default": false }, "includeNsfw": { "title": "Include NSFW", "type": "boolean", "description": "Include results flagged as NSFW (over_18).", "default": false }, "maxPosts": { "title": "Max posts", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of posts to return per query/URL.", "default": 25 }, "maxComments": { "title": "Max comments", "minimum": 0, "maximum": 200, "type": "integer", "description": "Maximum number of comments to return when scraping comment search.", "default": 10 }, "maxCommentsPerPost": { "title": "Max comments per post", "minimum": 0, "maximum": 100, "type": "integer", "description": "When 'Scrape comments per post' is on, the max comments returned per post.", "default": 10 }, "maxCommunities": { "title": "Max communities", "minimum": 1, "maximum": 25, "type": "integer", "description": "Maximum number of subreddit communities to return per community search.", "default": 5 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Routes Reddit requests through Apify Proxy. Reddit blocks datacenter IPs — residential proxy is required.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```