Reddit Scraper Pro

Slug: fatihtahta/reddit-scraper

Overview

Go beyond simple search—scrape posts, full comment threads with a configurable limit, subreddits, and user pages with a single Apify actor. Whether you provide search queries or a list of direct URLs, the scraper returns clean, structured JSON that is ready for downstream processing.

Key Capabilities

• Dual input modes: Switch between search queries and direct URLs without code changes.
• Comment harvesting: Toggle scrapeComments to capture deep conversation trees up to your configured limit.
• NSFW inclusion: Respect Reddit flags while optionally collecting over-18 content.
• Typed output: Distinct post and comment item types with predictable fields for analytics.
• Operational resilience: Automatic retries, adaptive timeouts, and TypeScript-based concurrency for production runs.

Configuration

Field	Type	Default	Notes
queries	string[]	–	Search terms to look up on Reddit. Ignored when urls are provided.
urls	string[]	–	Specific Reddit URLs to scrape. Takes priority over queries.
scrapeComments	boolean	false	Set to true to extract comments for each post.
maxComments	number	100	Maximum comments saved per post when scrapeComments is true.
maxPosts	number	100	Limit on posts stored for each query or URL.
includeNsfw	boolean	false	Include results tagged as NSFW.
sort	"relevance" | "hot" | "top" | "new" | "comments"	relevance	Ordering for search results.
timeframe	"hour" | "day" | "week" | "month" | "year" | "all"	all	Time range filter for search results when sort is relevance, top, or comments.

Usage Examples

Sample Input

{
  "includeNsfw": false,
  "queries": [
    "Cheesecake",
    "Swimming Pool"
  ],
  "scrapeComments": true,
  "sort": "hot",
  "timeframe": "year",
  "urls": [
    "https://www.reddit.com/r/socialmedia/"
  ]
}

Sample Output

Post record (kind: "post")

{
  "kind": "post",
  "query": "Cheesecake",
  "id": "1oiwt3p",
  "title": "My first cheesecake :)",
  "body": "Turned out a bit short but thats ok cause it tasted amazing. ",
  "author": "No_Opportunity_1502",
  "score": 27,
  "upvote_ratio": 0.97,
  "num_comments": 1,
  "subreddit": "Baking",
  "created_utc": "2025-10-29T05:59:38.000Z",
  "url": "https://www.reddit.com/r/Baking/comments/1oiwt3p/my_first_cheesecake/",
  "flair": "No-Recipe Provided",
  "over_18": false,
  "is_self": false,
  "spoiler": false,
  "locked": false,
  "is_video": false,
  "domain": "old.reddit.com",
  "thumbnail": "https://b.thumbs.redditmedia.com/oIOAf9jpp5jUSRjEljGBBvN4EOtH6dJo7sujoeG3Wug.jpg",
  "url_overridden_by_dest": "https://www.reddit.com/gallery/1oiwt3p",
  "media": null,
  "gallery_data": {
    "items": [
      { "media_id": "iniej0usqzxf1", "id": 782212827 },
      { "media_id": "qi29mztsqzxf1", "id": 782212828 },
      { "media_id": "fehlpdvsqzxf1", "id": 782212829 }
    ]
  }
}

Comment record (kind: "comment")

{
  "kind": "comment",
  "query": "https://www.reddit.com/r/technology/...",
  "id": "k5z1x2y",
  "postId": "t3_1d95j4g",
  "parentId": "t3_1d95j4g",
  "body": "Great analysis, but I think you're underestimating the impact of quantum computing on these timelines.",
  "author": "future_thinker",
  "score": 142,
  "created_utc": "2025-08-05T19:15:22.000Z",
  "url": "https://www.reddit.com/r/technology/comments/1d95j4g/the_state_of_ai_in_2025_a_comprehensive_report/k5z1x2y/"
}

Pricing

The actor costs $1.50 per 1,000 saved items (posts or comments). Infrastructure and residential proxy expenses are included, and you only pay for successful results.

Example: scraping 10,000 posts and 25,000 comments equals 35,000 saved items, which costs (35,000 / 1,000) * $1.50 = $52.50.

Operational Tips

• Save costs: Enable scrapeComments only when you need discussion data.
• Targeted scraping: Prefer URL mode for precise subreddit or post harvesting without extra search overhead.

Ethics & Compliance

The scraper collects only publicly available Reddit data and avoids private information. Ensure you have a legitimate reason to process any personal data returned in the results.

Support

Need help or a custom workflow? Open an issue via the Apify Console Issues tab and we will assist you promptly.

Happy scrapings!
Fatih