Reddit Subreddit Scraper – Export Top Posts & Comments

Extract top posts from any Reddit subreddit. Export JSON/CSV for social listening, trend analysis, and research.

Features

• Scrapes posts from any public subreddit
• Collects title, author, upvotes, comments, URL, timestamp, flair, domain
• Filter by time range (hour/day/week/month/year/all)
• Sort by hot, new, top, or rising
• Configurable post limit (1-100)
• Playwright + async Actor implementation

Input

• subreddit (required): Subreddit name without r/, e.g., python, machinelearning
• timeRange (default: "day"): hour, day, week, month, year, all
• maxPosts (default: 25): 1-100
• sortBy (default: "top"): hot, new, top, rising
• userAgent (optional): Custom User-Agent
• timeoutSec (default: 30): Per-page timeout

Output

Each dataset item:

{
  "title": "Amazing Python library for data science",
  "author": "pythondev123",
  "subreddit": "python",
  "url": "https://github.com/example/library",
  "permalink": "https://reddit.com/r/python/comments/abc123/...",
  "upvotes": 1250,
  "upvoteRatio": null,
  "commentCount": 87,
  "flair": "News",
  "timestamp": "2025-12-31T10:00:00Z",
  "domain": "github.com",
  "isSelfPost": false,
  "isNSFW": false
}

Use Cases

• Social listening - Monitor brand mentions and discussions
• Trend analysis - Track viral content and emerging topics
• Content research - Discover popular posts for content ideas
• Competitive intelligence - Track competitor mentions
• Sentiment analysis - Analyze community reactions

Local Testing

1. pip install -r requirements.txt
2. python -m playwright install chromium
3. Create storage/key_value_stores/default/INPUT.json:

{
  "subreddit": "python",
  "timeRange": "day",
  "maxPosts": 10
}

4. python apify_actor.py
5. Check output in storage/datasets/default/

Deployment

See DEPLOY.md for Apify deployment steps.

Notes

• Uses old.reddit.com for stable HTML structure
• Respects Reddit's public data access
• No authentication required for public subreddits
• Rate limiting handled by timeouts