Reddit Deep Scraper — Posts, Comments, Search & AI Answers

The only Reddit scraper on Apify with TLS fingerprinting and Reddit AI Answers. While other scrapers use basic HTTP clients and break constantly, this one mimics a real real browser browser — making it virtually undetectable by Reddit's anti-bot systems.

No Reddit API key. No login. No rate limit headaches. Just data.

---

Why This Scraper Beats Every Other Option

Feature	Other Scrapers	This Scraper
Anti-detection	Basic HTTP (gets blocked)	TLS fingerprinting (real browser)
Reddit AI Answers	Not available	Built-in
Comment extraction	Limited or none	Full nested comment trees
Subreddit discovery	Not available	Keyword-based subreddit finder
When Reddit blocks you	Fails	Auto-fallback to old.reddit.com + PullPush
Rate limiting	Crashes	Exponential backoff + smart retry
Speed	Sequential	Parallel fetching (up to 20 threads)

---

6 Powerful Actions in 1 Actor

1. Scrape Subreddit

Extract posts from any subreddit with full metadata — title, body, author, upvotes, media URLs, timestamps. Optionally fetch complete comment trees with parallel workers.

{
    "action": "scrape_subreddit",
    "subreddit": "technology",
    "sort": "top",
    "timeFilter": "week",
    "limit": 100,
    "includeComments": true
}

2. Search Posts

Keyword search across all of Reddit or within a specific subreddit. Find every post mentioning your brand, product, or topic.

{
    "action": "search_posts",
    "query": "best CRM software",
    "sort": "relevance",
    "limit": 100
}

3. Search Comments

Find comments matching your keywords. Extracts comment IDs from Reddit's HTML search, then fetches full comment details via bulk API.

{
    "action": "search_comments",
    "query": "your brand name",
    "subreddit": "technology"
}

4. Find Subreddits by Keyword

Discover the most relevant subreddits for any topic. Returns a ranked list with mention counts, sample post titles, and activity dates. Perfect for finding where your audience hangs out.

{
    "action": "search_subreddits",
    "query": "machine learning",
    "limit": 50
}

5. Fetch Single Post

Get any Reddit post by URL with full content — title, body, author, upvotes, timestamp. Use it to enrich existing datasets or verify specific posts.

{
    "action": "fetch_post",
    "postUrl": "https://www.reddit.com/r/technology/comments/abc123/post_title/"
}

6. Reddit AI Answers (Exclusive)

Query Reddit's built-in AI answer engine. Returns markdown-formatted answers with follow-up questions and source posts/subreddits. No other scraper on Apify has this.

{
    "action": "reddit_answers",
    "query": "What are the best tools for web scraping in 2026?"
}

---

What You Get Back

Post data

{
    "post_id": "1abc123",
    "permalink": "/r/technology/comments/1abc123/title/",
    "subreddit_name": "technology",
    "author_name": "user123",
    "title": "Example post title",
    "body": "Full post body text...",
    "media": ["https://i.redd.it/image.jpg"],
    "num_comments": 42,
    "num_upvotes": 1500,
    "post_timestamp": "2026-04-01T12:00:00Z",
    "comments": [
        {
            "author_name": "commenter1",
            "body": "This is a top-level comment",
            "media": [],
            "parent_id": "t3_1abc123"
        },
        {
            "author_name": "replier2",
            "body": "This is a nested reply",
            "media": [],
            "parent_id": "t1_abc456"
        }
    ]
}

Reddit AI Answer data

{
    "markdown": "## Full AI-generated answer in markdown...",
    "follow_ups": ["Related question 1", "Related question 2"],
    "source_posts": ["post_id_1", "post_id_2"],
    "source_subreddits": ["subreddit1", "subreddit2"],
    "queries_remaining": 29
}

---

Use Cases

Market Research — Monitor brand mentions, product discussions, and industry trends across thousands of subreddits.

Sentiment Analysis — Collect posts and comments for NLP/AI processing. AI-ready JSON output plugs directly into your pipeline.

SEO & Content Marketing — Reddit dominates Google search results. Find which threads rank for your keywords and what people are saying.

Lead Generation — Find people actively asking questions your product solves. Target them with relevant content.

Competitor Intelligence — Track what users say about your competitors. Identify pain points you can solve.

AI Training Data — Bulk export Reddit discussions for fine-tuning LLMs, training classifiers, or building datasets.

Academic Research — Structured data collection from Reddit for social science, NLP, and computational studies.

---

How It Works Under the Hood

1. TLS Fingerprinting — Every request uses a real browser fingerprint. Reddit sees a real browser, not a bot.

2. 8 Rotating User-Agents — Real browser user-agent strings from Windows, Mac, and Linux.

3. Smart Fallback Chain — If www.reddit.com blocks you, automatically tries old.reddit.com, then PullPush API as disaster recovery.

4. Exponential Backoff — Hit a rate limit? The scraper backs off with jitter and retries automatically. No manual intervention needed.

5. Parallel Comment Fetching — Configurable worker pool (1-20 threads) fetches comments concurrently with random jitter to avoid detection.

---

Pricing

What you scrape	Cost
Posts (without comments)	$2 / 1,000 posts
Posts (with full comment trees)	$5 / 1,000 posts
Search results	$2 / 1,000 results
Subreddits found	$2 / 1,000 subreddits
Single post fetch	$5 / 1,000 fetches
Reddit AI Answers	$10 / 1,000 queries

You only pay for results delivered. No monthly subscription. No minimum.

---

Tips for Best Results

• Use residential proxies for reliable scraping — select "Residential" in the proxy configuration
• Start with a small limit (10-50) to test, then scale up
• Set includeComments: false for faster, cheaper runs when you only need post metadata
• Use sort: "top" with timeFilter: "week" to get the most popular recent content
• For AI Answers, ask natural questions like you would on Google