Reddit Scraper — Posts, Comments, Subreddits, Search & Profiles (No API Key)

Scrape Reddit posts, nested comments, entire subreddits, keyword search results, and user profiles — no API keys, no login, and no rate limits.

Built for AI agents, developers, and data teams: extracts clean, structured JSON with 180+ fields across 4 shapes and works out of the box with Claude, ChatGPT/Codex, Cursor, and n8n via MCP and REST APIs.

---

🌟 What does Reddit Scraper do?

Reddit Scraper extracts posts, complete comment threads, user profiles, and community data directly from Reddit without needing API keys, developer accounts, or OAuth authorization. Simply provide keywords, subreddits, or direct URLs, and get structured data in JSON, CSV, or Excel format.

• ✅ No API Keys or Accounts Required: Bypass Reddit's 600 requests/10min API limits — no Reddit login, no OAuth setup, and no app approvals.
• 🗂️ Full Subreddit Scraping: Deep-scrape entire subreddits far beyond the standard recent post limits.
• 💬 Complete Comment Threads: Collect every comment on a post with full nested reply hierarchies and depth tracking.
• 📊 180+ Rich Structured Fields: 75 post fields, 41 comment fields, 38 community fields, and 29 user profile fields — including video URLs, gallery assets, awards, and engagement rates.
• 🔍 Advanced Search & Scoping: Search keywords across all of Reddit or restrict to specific subreddits (withinCommunity), with custom sort (new, hot, top, relevance) and time windows (hour, day, week, month, year, all).
• 📅 Precise Date & Flair Filters: Extract content from specific date ranges (postedAfter/postedBefore, commentedAfter/commentedBefore) and filter by flairs (onlyWithFlair).
• 🔄 Export Anywhere: JSON, CSV, Excel, XML, HTML · Integrates directly with n8n, Zapier, Make, and Model Context Protocol (MCP).

---

🤖 Built for AI Agents & MCP

Reddit Scraper is MCP-native: connect it as a tool to Claude Desktop, ChatGPT/Codex, Cursor, or your custom LLM pipeline to pull real-time Reddit discussions on demand:

{
  "mcpServers": {
    "reddit": {
      "command": "npx",
      "args": ["mcp-remote", "https://mcp.apify.com/?tools=knowten/reddit-scraper"]
    }
  }
}

Just ask your AI assistant:

• "Find what Reddit is saying about [Product] this week"
• "Pull the top 100 posts and comments from r/SaaS from the past month"
• "Extract all comments from this thread and summarize user sentiment"

---

🚀 Three Ways to Scrape Reddit

Mode	Input Parameter	Best For
🔎 Search Keywords	searchTerms	Find posts, comments, or communities by topic across Reddit — or inside one subreddit with withinCommunity. Supports sort and time filters.
🔗 Direct URLs	startUrls	Scrape a specific post, comment permalink, user profile, subreddit listing, or search results page.
🗂️ Full Subreddit Scrape	subredditUrls	Deep-scrape entire communities (hundreds or thousands of posts) beyond the standard recent feed.

---

⚙️ Input Configuration & Options

1. Keyword Search

{
  "searchTerms": ["artificial intelligence", "machine learning"],
  "withinCommunity": "r/technology",
  "searchPosts": true,
  "searchComments": false,
  "searchCommunities": false,
  "searchSort": "hot",
  "searchTime": "month",
  "maxPostsCount": 100,
  "includeNSFW": false
}

2. Direct URLs with Comment Extraction

{
  "startUrls": [
    { "url": "https://www.reddit.com/r/generativeAI/comments/1l64st7/have_we_reached_a_point_where_aigenerated_video/" }
  ],
  "crawlCommentsPerPost": true,
  "maxCommentsPerPost": 100
}

3. Deep Subreddit Scraping with Date Window

{
  "subredditUrls": ["r/buildapc", "r/SaaS"],
  "postedAfter": "2025-01-01",
  "postedBefore": "2025-12-31",
  "maxPostsCount": 500,
  "crawlCommentsPerPost": true,
  "maxCommentsPerPost": 25
}

4. User Profile Scraping

{
  "startUrls": [
    { "url": "https://www.reddit.com/user/spez" }
  ],
  "maxPostsCount": 20,
  "maxCommentsCount": 50
}

---

📊 Output Schema Contract (180+ Fields)

Every item in the dataset is a clean JSON object with a dataType discriminator:

dataType	Fields	Description
post	75	Full Reddit submission with media assets, metrics, flair, author info, and engagement rates
comment	41	Nested comment with hierarchy, depth (0 = top level), score, parent IDs, and permalinks
community	38	Subreddit settings, description, rules list, member count, icons, and banner images
user_profile	29	User profile details, karma breakdown, snoovatar, bio, and account age

Example Post Output (dataType: "post")

{
  "dataType": "post",
  "id": "t3_1abc123",
  "parsedId": "1abc123",
  "title": "What's the best tech stack for web scrapers in 2026?",
  "body": "Looking to build large-scale data extraction pipelines...",
  "bodyHtml": "<p>Looking to build large-scale data extraction pipelines...</p>",
  "authorName": "curious_dev",
  "authorId": "t2_xyz789",
  "parsedAuthorId": "xyz789",
  "communityName": "r/programming",
  "parsedCommunityName": "programming",
  "communityId": "t5_2qh55",
  "parsedCommunityId": "2qh55",
  "score": 1542,
  "upVotes": 1542,
  "upvoteRatio": 0.97,
  "commentsCount": 387,
  "postUrl": "https://www.reddit.com/r/programming/comments/1abc123/",
  "contentUrl": "https://www.reddit.com/r/programming/comments/1abc123/",
  "postType": "text",
  "flair": "Discussion",
  "domain": "self.programming",
  "subredditSubscribers": 4250000,
  "over18": false,
  "isSelf": true,
  "isVideo": false,
  "isGallery": false,
  "mediaType": "text",
  "hasMedia": false,
  "galleryCount": 0,
  "galleryImages": [],
  "mediaAssets": [],
  "videoUrl": null,
  "ageHours": 14.5,
  "scorePerHour": 106.34,
  "commentsPerHour": 26.68,
  "engagementTotal": 1929,
  "commentToScoreRatio": 0.25,
  "isHighEngagement": true,
  "titleLength": 48,
  "bodyLength": 142,
  "wordCount": 27,
  "createdAt": "2026-08-25T14:32:00.000Z",
  "crawledAt": "2026-08-26T13:00:00.000Z",
  "searchTerm": "web scrapers"
}

Example Comment Output (dataType: "comment")

{
  "dataType": "comment",
  "id": "t1_c123456",
  "parsedId": "c123456",
  "postId": "t3_1abc123",
  "parsedPostId": "1abc123",
  "parentId": "t3_1abc123",
  "parsedParentId": "1abc123",
  "parentKind": "post",
  "depth": 0,
  "body": "Node.js with Apify SDK and direct JSON endpoints is unbeatable for speed.",
  "bodyHtml": "<p>Node.js with Apify SDK and direct JSON endpoints is unbeatable for speed.</p>",
  "authorName": "senior_engineer",
  "authorId": "t2_auth456",
  "communityName": "r/programming",
  "subredditName": "programming",
  "postTitle": "What's the best tech stack for web scrapers in 2026?",
  "postUrl": "https://www.reddit.com/r/programming/comments/1abc123/",
  "score": 234,
  "commentUpVotes": 234,
  "url": "https://www.reddit.com/r/programming/comments/1abc123/comment/c123456/",
  "ageHours": 12.1,
  "scorePerHour": 19.33,
  "commentCreatedAt": "2026-08-25T16:50:00.000Z",
  "crawledAt": "2026-08-26T13:00:00.000Z"
}

---

📈 Use Cases

• 🔍 Brand & Reputation Monitoring: Track brand mentions, customer sentiment, and complaints across thousands of subreddits in real-time.
• 📊 Market Research & Consumer Insights: Analyze pain points, feature requests, and authentic product reviews in niche communities.
• 🎯 Lead Generation: Identify high-intent discussions ("recommend an alternative to X", "looking for software that does Y").
• 🤖 AI & ML Training Data: Extract millions of posts and conversation trees for NLP datasets, sentiment models, and RAG pipelines.
• 🏆 Competitive Intelligence: Monitor competitor launches, pricing discussions, and comparison threads in r/SaaS, r/Entrepreneur, and industry subreddits.

---

📋 Run Summary & Reports

Every run generates two dedicated records in your default Key-Value store:

• RUN-SUMMARY (JSON): Machine-readable summary containing execution duration, items delivered, requests finished, skipped targets, and input warnings.
• RUN-MAP.html: A visual HTML dashboard detailing the run's breakdown and stats.

---

🔌 Integration with n8n, Make & Zapier

Easily automate workflows by calling the actor synchronously or asynchronously:

n8n HTTP Request Node Configuration:

• Method: POST
• URL: https://api.apify.com/v2/acts/knowten~reddit-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN
• Body:

{
  "searchTerms": ["SaaS"],
  "searchPosts": true,
  "maxPostsCount": 50
}

---

❓ FAQ

Do I need a Reddit account or API keys?

No. The scraper extracts publicly accessible Reddit data directly without requiring OAuth, developer apps, or login credentials.

What are the scraping limits?

There are no artificial rate limits. You can scrape thousands or millions of items, governed only by your Apify compute resources and configured caps (maxPostsCount, maxCommentsPerPost, etc.).

Can I export results to Excel or CSV?

Yes. All results in the dataset can be exported immediately to JSON, CSV, Excel (XLSX), XML, or HTML directly from the Apify console or REST API.

How do nested comments work?

When crawlCommentsPerPost is enabled, the actor recursively traverses the entire comment tree for each post, tagging each comment with its parent post ID, immediate parent ID, and nesting depth (0 = top-level, 1 = first reply, etc.).

---

📄 License

ISC