# Reddit Post & Subreddit Scraper (`scrapeai/reddit-advanced-scraper`) Actor Collect structured Reddit data including posts, comments, author details, scores, awards, and timestamps using Reddit JSON endpoints. - **URL**: https://apify.com/scrapeai/reddit-advanced-scraper.md - **Developed by:** [ScrapeAI](https://apify.com/scrapeai) (community) - **Categories:** Social media, Developer tools, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $10.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Reddit Post & Subreddit Scraper Collect structured Reddit data including posts, comment threads, author details, scores, and metadata from subreddits or post URLs using Reddit JSON endpoints. ### Features - **Advanced keyword discovery** — scrape Reddit content using targeted search terms and topics - **Direct page extraction** — crawl individual Reddit URLs for detailed post and comment data - **Adjustable output volume** — customize scrape limits for optimized data collection - **Apify cloud compatible** — designed for automated runs, proxy management, and webhook workflows ### Use Cases - Creator and influencer research — analyze audience interaction, reach, and social performance - Content trend detection — uncover trending topics and viral discussions in real time - Brand reputation monitoring — track mentions, feedback, and public perception across platforms - Competitor content analysis — compare posting frequency, engagement, and content effectiveness ### Input ```json { "mode": "subreddit", "subreddit": "technology", "maxItems": 5 } ```` #### Sample Output ```json { "id": "t3_1tp2vck", "title": "Demis Hassabis on his rush to ‘solve all disease’ and Isomorphic’s new $2.1 billion", "url": "https://fortune.com/2026/05/27/spacexs-ipo-filing-is-full-of-surprises/", "permalink": "https://www.reddit.com/r/technology/comments/1tp2vck/demis_hassabis_on_his_rush_to_solve_all_disease/", "subreddit": "technology", "subredditId": "t5_2qh16", "subredditType": "public", "subredditSubscribers": 20306497, "author": "Logical_Welder3467", "authorFullname": "t2_14l1ppgci2", "authorFlair": null, "authorPremium": false, "score": 0, "upvoteRatio": 0.5, "numComments": 1, "createdAt": "2026-05-27T11:35:02.000Z", "editedAt": null, "selfText": null, "postType": "link", "isVideo": false, "isSelf": false, "isGallery": null, "isOC": false, "thumbnail": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=140&height=70&auto=webp&s=d87b1af1c6ffa21600403c065db19c95dfc947f3", "flair": "Artificial Intelligence", "flairBackgroundColor": null, "domain": "fortune.com", "nsfw": false, "spoiler": false, "locked": false, "pinned": false, "stickied": false, "archived": false, "distinguished": null, "suggestedSort": null, "numCrossposts": 0, "postHint": "link", "isCrossPost": false, "crosspostFrom": null, "awardsCount": 0, "gilded": 0, "gildings": null, "awards": [], "topAwardedType": null, "contentCategories": null, "contestMode": false, "hideScore": true, "isMeta": false, "allowLiveComments": false, "quarantine": false, "removedByCategory": null, "modNote": null, "discussionType": null, "urlOverride": "https://fortune.com/2026/05/27/spacexs-ipo-filing-is-full-of-surprises/", "authorPatreonFlair": false, "authorFlairTextColor": null, "flairTextColor": "dark", "previewImages": { "source": { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?auto=webp&s=8ab3765d1c49ebe3b8fc0d55a5bbe496adf65e4b", "width": 1200, "height": 600 }, "resolutions": [ { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=108&crop=smart&auto=webp&s=82184b1625d99fd519b621e8cac97d3a0d25f308", "width": 108, "height": 54 }, { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=216&crop=smart&auto=webp&s=789ada1def1fb7ea9359f715b5174a6f196d4ad3", "width": 216, "height": 108 }, { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=320&crop=smart&auto=webp&s=b4e57e444c0a2c668b2ef6bf7211a84f87160dec", "width": 320, "height": 160 }, { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=640&crop=smart&auto=webp&s=13aa51cc18debf2875f3bf50a482af169cc821ab", "width": 640, "height": 320 }, { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=960&crop=smart&auto=webp&s=dd429339bb687c2a5072ebe3c6bda81a799df925", "width": 960, "height": 480 }, { "url": "https://external-preview.redd.it/7u82BsSEa__82PAT6aM55KObX3OWQe6qfOLLH9YK4DQ.jpeg?width=1080&crop=smart&auto=webp&s=77ebfd2970dd488dda59a748951d199f71622d75", "width": 1080, "height": 540 } ] }, "videoData": null, "mediaEmbed": null, "crosspostOriginal": null, "galleryImages": null, "scrapedAt": "2026-05-27T11:34:19.605Z" } ``` # Actor input Schema ## `mode` (type: `string`): Select what to scrape: subreddit posts, keyword search, specific post URLs, user profiles, or subreddit users. ## `subreddit` (type: `string`): Subreddit name (without r/). For modes: subreddit, search (restrict), subredditUsers. ## `searchQuery` (type: `string`): Keyword or phrase to search Reddit for. Used when mode is 'search'. ## `sortBy` (type: `string`): Sort order for subreddit/search modes. Subreddit: new/hot/top/rising/controversial. Search: relevance/new/hot/top/comments. ## `topTime` (type: `string`): Time period when sortBy is 'top' or 'controversial'. ## `startUrls` (type: `array`): List of Reddit post URLs to scrape directly. Used when mode is 'postUrl'. ## `usernames` (type: `array`): List of Reddit usernames (or profile URLs) to scrape. Used when mode is 'profile'. ## `maxItems` (type: `integer`): Maximum posts/profiles/users to scrape. ## `includeComments` (type: `boolean`): Fetch top 20 comments with nested replies for each post (deepScraping must be enabled). ## `deepScraping` (type: `boolean`): Open each post in a parallel browser tab for full data: selfText, images, video, gallery, awards, crosspost data. ## `includeRecentPosts` (type: `boolean`): Fetch each user's recent submitted posts. Used when mode is 'profile'. ## `includeRecentComments` (type: `boolean`): Fetch each user's recent comments. Used when mode is 'profile'. ## `includeCommentAuthors` (type: `boolean`): Also extract comment authors from each post. Used when mode is 'subredditUsers'. ## `fetchProfileDetails` (type: `boolean`): Enrich each discovered user with full profile data. Used when mode is 'subredditUsers'. ## `headless` (type: `boolean`): Run the browser in headless mode (recommended for production). ## `proxyConfiguration` (type: `object`): Proxy settings to avoid IP blocking. Recommended: Apify Residential proxy. ## Actor input object example ```json { "mode": "subreddit", "subreddit": "javascript", "searchQuery": "nodejs tutorial", "sortBy": "new", "topTime": "week", "startUrls": [ "https://www.reddit.com/r/javascript/comments/1t9jt9w/bluejs_compile_javascript_to_12mb_native_binaries/" ], "usernames": [ "spez", "GallowBoob" ], "maxItems": 50, "includeComments": false, "deepScraping": true, "includeRecentPosts": false, "includeRecentComments": false, "includeCommentAuthors": true, "fetchProfileDetails": false, "headless": true, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "subreddit": "javascript", "searchQuery": "nodejs tutorial", "startUrls": [ "https://www.reddit.com/r/javascript/comments/1t9jt9w/bluejs_compile_javascript_to_12mb_native_binaries/" ], "usernames": [ "spez", "GallowBoob" ], "maxItems": 50, "includeComments": false, "deepScraping": true, "includeRecentPosts": false, "includeRecentComments": false, "includeCommentAuthors": true, "fetchProfileDetails": false, "headless": true }; // Run the Actor and wait for it to finish const run = await client.actor("scrapeai/reddit-advanced-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "subreddit": "javascript", "searchQuery": "nodejs tutorial", "startUrls": ["https://www.reddit.com/r/javascript/comments/1t9jt9w/bluejs_compile_javascript_to_12mb_native_binaries/"], "usernames": [ "spez", "GallowBoob", ], "maxItems": 50, "includeComments": False, "deepScraping": True, "includeRecentPosts": False, "includeRecentComments": False, "includeCommentAuthors": True, "fetchProfileDetails": False, "headless": True, } # Run the Actor and wait for it to finish run = client.actor("scrapeai/reddit-advanced-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "subreddit": "javascript", "searchQuery": "nodejs tutorial", "startUrls": [ "https://www.reddit.com/r/javascript/comments/1t9jt9w/bluejs_compile_javascript_to_12mb_native_binaries/" ], "usernames": [ "spez", "GallowBoob" ], "maxItems": 50, "includeComments": false, "deepScraping": true, "includeRecentPosts": false, "includeRecentComments": false, "includeCommentAuthors": true, "fetchProfileDetails": false, "headless": true }' | apify call scrapeai/reddit-advanced-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scrapeai/reddit-advanced-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Reddit Post & Subreddit Scraper", "description": "Collect structured Reddit data including posts, comments, author details, scores, awards, and timestamps using Reddit JSON endpoints.", "version": "1.0", "x-build-id": "obc2zc8ReqDeHV5Wp" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scrapeai~reddit-advanced-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scrapeai-reddit-advanced-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scrapeai~reddit-advanced-scraper/runs": { "post": { "operationId": "runs-sync-scrapeai-reddit-advanced-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scrapeai~reddit-advanced-scraper/run-sync": { "post": { "operationId": "run-sync-scrapeai-reddit-advanced-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Scraping Mode", "enum": [ "subreddit", "search", "postUrl", "profile", "subredditUsers" ], "type": "string", "description": "Select what to scrape: subreddit posts, keyword search, specific post URLs, user profiles, or subreddit users.", "default": "subreddit" }, "subreddit": { "title": "Subreddit Name", "type": "string", "description": "Subreddit name (without r/). For modes: subreddit, search (restrict), subredditUsers." }, "searchQuery": { "title": "Search Query", "type": "string", "description": "Keyword or phrase to search Reddit for. Used when mode is 'search'." }, "sortBy": { "title": "Sort By", "enum": [ "new", "hot", "top", "rising", "controversial", "relevance", "comments" ], "type": "string", "description": "Sort order for subreddit/search modes. Subreddit: new/hot/top/rising/controversial. Search: relevance/new/hot/top/comments.", "default": "new" }, "topTime": { "title": "Top / Controversial Time Filter", "enum": [ "hour", "day", "week", "month", "year", "all" ], "type": "string", "description": "Time period when sortBy is 'top' or 'controversial'.", "default": "week" }, "startUrls": { "title": "Post URLs", "type": "array", "description": "List of Reddit post URLs to scrape directly. Used when mode is 'postUrl'.", "items": { "type": "string" } }, "usernames": { "title": "Reddit Usernames", "type": "array", "description": "List of Reddit usernames (or profile URLs) to scrape. Used when mode is 'profile'.", "items": { "type": "string" } }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum posts/profiles/users to scrape.", "default": 50 }, "includeComments": { "title": "Include Comments", "type": "boolean", "description": "Fetch top 20 comments with nested replies for each post (deepScraping must be enabled).", "default": false }, "deepScraping": { "title": "Deep Scraping", "type": "boolean", "description": "Open each post in a parallel browser tab for full data: selfText, images, video, gallery, awards, crosspost data.", "default": true }, "includeRecentPosts": { "title": "Include Recent Posts (Profile mode)", "type": "boolean", "description": "Fetch each user's recent submitted posts. Used when mode is 'profile'.", "default": false }, "includeRecentComments": { "title": "Include Recent Comments (Profile mode)", "type": "boolean", "description": "Fetch each user's recent comments. Used when mode is 'profile'.", "default": false }, "includeCommentAuthors": { "title": "Include Comment Authors (subredditUsers mode)", "type": "boolean", "description": "Also extract comment authors from each post. Used when mode is 'subredditUsers'.", "default": true }, "fetchProfileDetails": { "title": "Fetch Profile Details (subredditUsers mode)", "type": "boolean", "description": "Enrich each discovered user with full profile data. Used when mode is 'subredditUsers'.", "default": false }, "headless": { "title": "Headless Mode", "type": "boolean", "description": "Run the browser in headless mode (recommended for production).", "default": true }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Proxy settings to avoid IP blocking. Recommended: Apify Residential proxy.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```