📄 Reddit Post Scraper

🆓 100% FREE | 💬 Full Comment Threads | 🔒 No API Key Required

A detailed scraper for collecting information about specific Reddit posts and their comments with support for hierarchical reply structure.

---

✨ Why Choose This Scraper?

• ✅ Completely Free - No hidden costs or subscriptions
• ✅ No Reddit API Key Needed - Works out of the box
• ✅ Full Comment Trees - Preserves reply hierarchy
• ✅ Residential Proxies Included - Avoid rate limits
• ✅ Rich Media Support - Images, videos, and links

---

🚀 Key Features

• Complete Post Information: Title, author, text, media, statistics
• Comment Hierarchy: Preserves reply structure and nested comments
• Flexible Sorting: Various comment sorting methods
• Limits: Control the number of comments to collect
• Metadata: Upvotes, timestamps, authors

📋 Input Parameters

{
  "startUrls": [
    "https://www.reddit.com/r/Python/comments/15t8eq0/guido_van_rossum_on_why_python_uses_0based/"
  ],
  "maxComments": 100,
  "skipComments": false,
  "sort": "confidence",
  "includeNSFW": true,
  "debugMode": false
}

Parameters:

• startUrls (array, required): List of post URLs to scrape
• maxComments (integer): Maximum number of comments to collect
• skipComments (boolean): Skip comment collection (post only)
• sort (string): Comment sorting - confidence, new, top, old, qa
• includeNSFW (boolean): Process NSFW content
• debugMode (boolean): Detailed logging

📤 Output Data

Post Structure:

{
  "dataType": "post",
  "id": "t3_15t8eq0",
  "url": "https://www.reddit.com/r/Python/comments/...",
  "title": "Post title",
  "subreddit": "Python",
  "author": "username",
  "body": "Post text content",
  "body_html": "<div>HTML content</div>",
  "media": {
    "type": "image",
    "url": "https://..."
  },
  "stats": {
    "upvotes": 1234,
    "upvote_ratio": 0.95,
    "comments_total": 56,
    "comments_scraped": 50
  },
  "created_utc": "1234567890",
  "scrapedAt": "2025-01-20T10:30:00.000Z",
  "comments": [...]
}

Comment Structure:

{
  "dataType": "comment",
  "id": "t1_abc123",
  "author": "username",
  "body": "Comment text",
  "upvotes": "42",
  "created_utc": "1234567890",
  "scrapedAt": "2025-01-20T10:30:00.000Z",
  "replies": [...]
}

💡 Usage Examples

Collect post with top 100 comments

{
  "startUrls": ["https://www.reddit.com/r/AskReddit/comments/xyz/..."],
  "maxComments": 100,
  "sort": "top"
}

Post information only (no comments)

{
  "startUrls": ["https://www.reddit.com/r/news/comments/..."],
  "skipComments": true
}

New comments with limit

{
  "startUrls": ["https://www.reddit.com/r/technology/comments/..."],
  "maxComments": 50,
  "sort": "new"
}

⚙️ Technical Details

• Memory: 256 MB (optimized for efficiency)
• Proxy: Residential (automatic, included free)
• Timeout: 3600 seconds
• Source: old.reddit.com
• Structure: Hierarchical comment tree

📝 Notes

• Comments preserve full hierarchy (replies)
• Support for various media types (images, videos, links)
• Automatic handling of deleted comments
• All timestamps in UTC format

---

🎯 Perfect For

• 💬 Sentiment analysis and opinion mining
• 📊 Discussion thread analysis
• 🔬 Social research and studies
• 🤖 Training chatbots and AI models
• 📰 Content moderation and monitoring

---

💬 Questions or Issues? Feel free to reach out or check the documentation!