Reddit Scraper - Posts, Comments, Subreddits & Trending Discussions

Scrape Reddit posts, comments, and subreddit data. Search across all of Reddit, extract full discussion threads, track trending topics, and monitor specific subreddits. Sort by hot, new, top, or rising with time filters. Essential for market research, content ideation, sentiment analysis, and lead generation.

Features

• Subreddit Scraping - Extract posts from any public subreddit
• Reddit Search - Search across all of Reddit for specific topics
• Comment Extraction - Full comment threads with author and score data
• Flexible Sorting - Hot, New, Top, Rising with time filters
• Upvote Filtering - Only get posts above a minimum score threshold
• User Profile Scraping - Get posts from specific Reddit users
• Direct Post Scraping - Extract data from specific post URLs
• Time Range Filtering - Hour, day, week, month, year, all time
• Upvote Ratio - Community approval percentage per post
• Anti-Detection - Residential proxies for reliable access
• No Login Required - Works with public Reddit data
• Demo Mode - Test with sample data before going live

Who Should Use This Actor?

Market Researchers

Discover what people are saying about your industry, products, or brand. Reddit discussions provide unfiltered, honest consumer opinions.

Content Creators & Bloggers

Find trending topics, frequently asked questions, and content gaps. Reddit threads are a gold mine for content ideas.

Product Managers

Monitor product feedback, feature requests, and bug reports discussed on Reddit. Understand how users perceive your product vs. competitors.

SEO Professionals

Research topics for content creation. Reddit's "People Also Ask" style discussions reveal what users search for and discuss.

Sales & Lead Generation Teams

Find people actively asking for product recommendations. Reddit threads like "What's the best CRM?" are high-intent lead signals.

Startup Founders

Validate ideas by monitoring relevant subreddits. Understand customer pain points and competitor sentiment from real user discussions.

Quick Start

Demo Mode (Free Test)

{
  "demoMode": true
}

Scrape a Subreddit

{
  "scrapeType": "subreddit",
  "subreddits": ["marketing", "entrepreneur", "startups"],
  "sortBy": "hot",
  "maxPostsPerSubreddit": 25,
  "includeComments": false,
  "demoMode": false
}

Search All of Reddit

{
  "scrapeType": "search",
  "searchQuery": "best CRM software",
  "sortBy": "relevance",
  "timeFilter": "month",
  "maxResults": 50,
  "demoMode": false
}

Posts with Comments

{
  "scrapeType": "subreddit",
  "subreddits": ["AskReddit"],
  "includeComments": true,
  "maxCommentsPerPost": 20,
  "minUpvotes": 100,
  "demoMode": false
}

Scrape Specific Posts

{
  "scrapeType": "post",
  "postUrls": [
    "https://www.reddit.com/r/startups/comments/abc123/best_tools_for_saas/",
    "https://www.reddit.com/r/marketing/comments/def456/what_crm_do_you_use/"
  ],
  "includeComments": true,
  "maxCommentsPerPost": 50,
  "demoMode": false
}

Input Parameters

Parameter	Type	Default	Description
scrapeType	string	subreddit	Type: subreddit, search, post, user
subreddits	array	-	Subreddit names to scrape (without r/)
searchQuery	string	-	Search term for Reddit search
postUrls	array	-	Direct Reddit post URLs to scrape
usernames	array	-	Reddit usernames to get posts from
sortBy	string	hot	Sort: hot, new, top, rising, relevance
timeFilter	string	week	Time: hour, day, week, month, year, all
includeComments	boolean	false	Extract comments (costs more)
maxCommentsPerPost	number	20	Max comments per post
minUpvotes	number	-	Minimum upvotes threshold
maxResults	number	50	Maximum total posts
maxPostsPerSubreddit	number	25	Posts per subreddit
proxyConfiguration	object	Residential	Proxy settings
demoMode	boolean	true	Return sample data for testing
webhookUrl	string	-	Webhook URL for results delivery

Output Format

{
  "postId": "1abc123",
  "title": "What's the best CRM for small businesses?",
  "url": "https://www.reddit.com/r/smallbusiness/comments/1abc123",
  "subreddit": "smallbusiness",
  "author": "startup_guy",
  "score": 342,
  "upvoteRatio": 0.95,
  "commentCount": 156,
  "text": "I'm looking for recommendations for a CRM that works well for a team of 10...",
  "contentType": "text",
  "flair": "Question",
  "isStickied": false,
  "awards": 2,
  "createdAt": "2025-12-15T10:30:00.000Z",
  "comments": [
    {
      "commentId": "c123",
      "author": "helpful_user",
      "text": "I recommend HubSpot for starting out. Free tier is solid...",
      "score": 89,
      "depth": 0,
      "createdAt": "2025-12-15T11:00:00.000Z",
      "replies": [
        {
          "commentId": "c456",
          "author": "another_user",
          "text": "Agreed, HubSpot free is great for small teams.",
          "score": 23,
          "depth": 1,
          "createdAt": "2025-12-15T11:30:00.000Z"
        }
      ]
    }
  ],
  "scrapedAt": "2026-01-28T10:30:00.000Z"
}

Pricing (Pay-Per-Event)

Event	Description	Price
post_scraped	Per post scraped	$0.005
comments_scraped	Per post with comments	$0.01
search_performed	Per search query executed	$0.02

Example costs:

• 100 posts without comments: 100 x $0.005 = $0.50
• 100 posts with comments: (100 x $0.005) + (100 x $0.01) = $1.50
• 5 searches + 250 posts: (5 x $0.02) + (250 x $0.005) = $1.35
• Demo mode: $0.00

Common Scenarios

Scenario 1: Product Feedback Monitoring

{
  "scrapeType": "search",
  "searchQuery": "YourProductName",
  "sortBy": "relevance",
  "timeFilter": "month",
  "includeComments": true,
  "maxCommentsPerPost": 30,
  "maxResults": 50,
  "demoMode": false
}

Schedule weekly to track what users say about your product.

Scenario 2: Content Research & Ideation

{
  "scrapeType": "subreddit",
  "subreddits": ["marketing", "SEO", "PPC", "socialmedia"],
  "sortBy": "top",
  "timeFilter": "week",
  "maxPostsPerSubreddit": 25,
  "minUpvotes": 50,
  "demoMode": false
}

Find top-performing discussions for blog topic inspiration.

Scenario 3: Lead Generation (Recommendation Threads)

{
  "scrapeType": "search",
  "searchQuery": "best CRM software recommendation",
  "sortBy": "relevance",
  "timeFilter": "month",
  "includeComments": true,
  "maxResults": 30,
  "demoMode": false
}

Find people actively seeking product recommendations.

Scenario 4: Competitor Sentiment Analysis

{
  "scrapeType": "search",
  "searchQuery": "CompetitorName review",
  "sortBy": "relevance",
  "timeFilter": "year",
  "includeComments": true,
  "maxResults": 100,
  "demoMode": false
}

Webhook & Automation Integration

Webhook Configuration

{
  "scrapeType": "search",
  "searchQuery": "your brand name",
  "webhookUrl": "https://your-endpoint.com/webhook"
}

Zapier / Make.com / n8n

1. Create a webhook trigger in your automation platform
2. Copy the webhook URL to webhookUrl
3. Route results to Google Sheets, Slack, Airtable, etc.

Popular automations:

• Brand mentions -> Slack alert (reputation monitoring)
• High-upvote posts -> Google Sheets (content research database)
• Product mentions -> CRM (lead qualification)
• Trending topics -> Email digest (weekly industry report)

Apify Scheduled Runs

Schedule daily or weekly runs for continuous Reddit monitoring.

Official API Alternatives

Reddit API

Reddit offers an official API:

• Pros: Official, real-time, structured data, full comment trees
• Cons: Rate limits (100 requests/minute for OAuth), requires app registration
• Best for: Building Reddit integrations and bots

Alternative Reddit Data Sources

• Pushshift - Historical Reddit data (free, but limited availability)
• Reddit Search - Built-in search (limited filtering)
• Google site:reddit.com - Google index of Reddit (cached data)

This Scraper's Advantages

1. No API registration - No Reddit app required
2. Simple configuration - Just provide subreddits or search terms
3. Upvote filtering - Quality threshold filtering
4. Nested comments - Full reply thread structure
5. Cross-subreddit search - Search all of Reddit at once
6. Pay-per-result pricing

FAQ

Q: Do I need a Reddit account?

A: No. This scraper uses public Reddit data. No login required.

Q: How do I enter subreddit names?

A: Enter names without "r/" (e.g., marketing not r/marketing).

Q: Can I scrape private or quarantined subreddits?

A: No. Only public subreddits are accessible. Private and quarantined subreddits cannot be scraped.

Q: Why does Reddit search seem imprecise?

A: Reddit's search is known to be inconsistent. Use specific search terms, time filters, and minUpvotes to improve result quality.

Q: Can I get the full comment tree?

A: The scraper extracts top-level comments with nested replies up to maxCommentsPerPost. Very deep threads may be truncated.

Common Problems & Solutions

"No results" or empty data

• Enter subreddit names WITHOUT "r/" (e.g., marketing not r/marketing)
• Verify the subreddit exists at reddit.com/r/subredditname
• Private and quarantined subreddits cannot be scraped

"Search returns irrelevant results"

• Use more specific search terms
• Use timeFilter to limit to recent posts
• Add minUpvotes to filter out low-quality posts

"Comments not appearing"

• Set includeComments: true (defaults to false)
• Specify maxCommentsPerPost for desired comment depth

"Demo data showing"

• Set demoMode: false - no account required

---

Built by John Rippy | Actor Arsenal