🔴 Reddit Scraper - Posts, Comments & Subreddit Data

Scrape Reddit posts, comments, and subreddit data. Search across Reddit, extract discussions, track trending topics, and monitor specific communities.

Features

✅ Subreddit Scraping - Extract posts from any public subreddit ✅ Reddit Search - Search across all of Reddit for specific topics ✅ Comment Extraction - Get full comment threads with author data ✅ Flexible Sorting - Hot, New, Top, Rising with time filters ✅ Upvote Filtering - Only get posts above a threshold ✅ Demo Mode - Test with sample data before real scraping ✅ Webhook Support - Send results to Zapier, Make, n8n ✅ Residential Proxies - Reliable scraping with Apify proxies

Use Cases

📊 Market Research - Find what people are saying about your industry 💡 Content Ideas - Discover trending topics and questions 🔍 Competitor Analysis - Monitor discussions about competitors 📈 Trend Tracking - Follow emerging topics in your niche 💬 Sentiment Analysis - Understand community opinions 🎯 Lead Generation - Find people asking for recommendations

How It Works

┌─────────────────────────────────────────────────┐
│              Reddit Scraper                      │
├─────────────────────────────────────────────────┤
│                                                  │
│  Subreddits ─────┐                              │
│                  ├──► Fetch Posts ──► Filter    │
│  Search Query ───┘         │          │         │
│                            ▼          ▼         │
│                     Parse Post Data             │
│                            │                    │
│                            ▼                    │
│                  ┌──────────────────┐           │
│                  │ Extract Comments │ (optional)│
│                  └──────────────────┘           │
│                            │                    │
│                            ▼                    │
│                 Dataset + Webhook               │
│                                                 │
└─────────────────────────────────────────────────┘

Input Schema

Parameter	Type	Required	Default	Description
demoMode	boolean	No	false	Run with sample data for testing
subreddits	string[]	No	[]	Subreddits to scrape (without r/ prefix)
searchQuery	string	No	-	Search term across Reddit
sortBy	string	No	"hot"	Sort: hot, new, top, rising
timeFilter	string	No	"week"	For 'top': hour, day, week, month, year, all
maxPosts	integer	No	25	Max posts per subreddit/search (1-100)
includeComments	boolean	No	false	Extract comments from posts
maxCommentsPerPost	integer	No	10	Max comments per post (1-100)
minUpvotes	integer	No	0	Minimum upvotes filter
webhookUrl	string	No	-	URL to POST results when complete
proxyConfiguration	object	No	Residential	Apify proxy settings

Output Schema

Each post in the dataset includes:

Field	Type	Description
id	string	Reddit post ID
title	string	Post title
author	string	Author username
subreddit	string	Subreddit name
url	string	External link (if link post)
permalink	string	Reddit URL for post
selftext	string	Post body (if text post)
score	number	Net upvotes
upvoteRatio	number	Upvote percentage (0-1)
numComments	number	Total comment count
createdUtc	string	Post timestamp (ISO 8601)
isNsfw	boolean	NSFW flag
isSpoiler	boolean	Spoiler flag
flair	string	Post flair text
thumbnail	string	Thumbnail URL
mediaUrl	string	Direct media URL
comments	array	Comment objects (if includeComments=true)
scrapedAt	string	Scrape timestamp

Comment Schema

Field	Type	Description
id	string	Comment ID
author	string	Comment author
body	string	Comment text
score	number	Comment upvotes
createdUtc	string	Comment timestamp
depth	number	Reply depth (0 = top level)

Example Inputs

Scrape Subreddits (Hot Posts)

{
  "subreddits": ["SEO", "marketing", "smallbusiness"],
  "sortBy": "hot",
  "maxPosts": 25
}

Search Reddit

{
  "searchQuery": "best CRM for small business",
  "sortBy": "top",
  "timeFilter": "month",
  "maxPosts": 50
}

With Comments

{
  "subreddits": ["LocalSEO"],
  "sortBy": "top",
  "timeFilter": "week",
  "maxPosts": 10,
  "includeComments": true,
  "maxCommentsPerPost": 20
}

High-Quality Posts Only

{
  "subreddits": ["entrepreneur", "startups"],
  "sortBy": "top",
  "timeFilter": "month",
  "maxPosts": 25,
  "minUpvotes": 100
}

Quick Test

{
  "demoMode": true
}

With Webhook

{
  "subreddits": ["webdev"],
  "maxPosts": 20,
  "webhookUrl": "https://hooks.zapier.com/hooks/catch/123456/abcdef/"
}

Example Output

Post Without Comments

{
  "id": "1abc123",
  "title": "What SEO tools do you use daily?",
  "author": "seomarketer99",
  "subreddit": "SEO",
  "url": "https://reddit.com/r/SEO/comments/1abc123",
  "permalink": "/r/SEO/comments/1abc123/what_seo_tools_do_you_use_daily/",
  "selftext": "I'm looking to streamline my workflow. Currently using Ahrefs and Screaming Frog...",
  "score": 142,
  "upvoteRatio": 0.94,
  "numComments": 87,
  "createdUtc": "2024-12-20T14:30:00Z",
  "isNsfw": false,
  "isSpoiler": false,
  "flair": "Discussion",
  "scrapedAt": "2024-12-24T10:00:00Z"
}

Post With Comments

{
  "id": "1abc123",
  "title": "What SEO tools do you use daily?",
  "author": "seomarketer99",
  "subreddit": "SEO",
  "score": 142,
  "numComments": 87,
  "comments": [
    {
      "id": "c1",
      "author": "agencyowner",
      "body": "Ahrefs is non-negotiable. Also love Surfer SEO for content optimization.",
      "score": 45,
      "createdUtc": "2024-12-20T15:00:00Z",
      "depth": 0
    },
    {
      "id": "c2",
      "author": "freelancerseo",
      "body": "Have you tried Semrush? I switched from Ahrefs and prefer it now.",
      "score": 23,
      "createdUtc": "2024-12-20T15:30:00Z",
      "depth": 1
    }
  ],
  "scrapedAt": "2024-12-24T10:00:00Z"
}

Pricing

Pay-per-event model:

Event	Cost	Description
post_scraped	$0.005	Each post scraped
comments_scraped	$0.01	Each post with comments extracted
search_performed	$0.02	Each search query executed

Example costs:

• 100 posts without comments = $0.50
• 100 posts with comments = $0.50 + $1.00 = $1.50
• 5 searches = $0.10

Popular Subreddits by Category

Business & Marketing

• SEO, marketing, smallbusiness, entrepreneur, startups
• socialmedia, PPC, content_marketing, digital_marketing

Tech & Development

• webdev, javascript, programming, web_design, SaaS

Local Business

• LocalSEO, realestate, restaurantowners, HomeImprovement

E-commerce

• ecommerce, dropship, FulfillmentByAmazon, Etsy

Best Practices

1. Start with demo mode - Test before using real scraping
2. Use specific subreddits - More targeted = better results
3. Time filters for top - "week" or "month" for quality content
4. Be mindful of rate limits - Don't scrape too aggressively
5. Comments add value - Enable for discussion threads
6. Filter by upvotes - Quality over quantity

Integrations

Zapier/Make/n8n

Add your webhook URL to receive data when scraping completes:

{
  "webhookUrl": "https://hooks.zapier.com/hooks/catch/..."
}

Content Pipeline

Combine with SEO News Aggregator for comprehensive content research.

Sentiment Analysis

Export data to AI tools for sentiment scoring and topic analysis.

---

Built by John Rippy | johnrippy.link