Reddit Scraper

Reddit is one of the most valuable sources of unfiltered human opinion on the internet. This scraper gives you programmatic access to it, posts, threads, profiles, and communities returned as structured JSON you can use immediately.

---

Overview

Point it at a Reddit URL or give it a search term and it returns everything: the content, the metadata, the engagement numbers, and the relationships between items. Every result type has its own clean schema so downstream processing stays simple.

Supported content: posts, comment threads, subreddit listings, user profiles, and community pages.

---

Before You Start

There are two ways to feed the scraper:

• URL mode — paste one or more Reddit URLs directly. Works for subreddits, individual posts, user profiles, and search result pages.
• Search mode — give it a keyword and it queries Reddit's search. Scope it to a specific subreddit with searchSubreddit if needed.

Pick one per run. Using both together is not supported.

---

Setup Steps

Step 1 — Source. Decide whether you're targeting specific URLs or searching by keyword. Add URLs to the url array or set searchTerm.

Step 2 — Type. Set scrapeType to match what you want back. If you're pointing at a post URL and want the replies, use comments. If you want the posts in a subreddit feed, use listing.

Step 3 — Limits. Each content type has an independent max. Tune them to avoid over-fetching — defaults are generous at 1000 each.

Step 4 — Collect. Run it. Output lands in your dataset as a flat JSON array, one object per item.

---

Input Parameters

Parameter	Type	Description	Default
url	array	Reddit URLs to scrape	—
searchTerm	string	Keyword to search Reddit	""
searchSort	string	relevance, hot, top, new, comments	relevance
searchTime	string	all, hour, day, week, month, year	all
searchSubreddit	string	Restrict search to one subreddit (omit r/)	""
scrapeType	string	post, listing, comments, user, community	post
maxPosts	integer	Cap on posts returned	1000
maxComments	integer	Cap on comments returned	1000
maxListingPosts	integer	Cap on posts from a listing	1000
maxCommunities	integer	Cap on communities returned	1000
maxUsers	integer	Cap on user profiles returned	1000

---

URL Formats

Target	Example
Subreddit feed	https://www.reddit.com/r/startups/
Post with comments	https://www.reddit.com/r/startups/comments/abc123/post_title/
User profile	https://www.reddit.com/user/some_username
Search page	https://www.reddit.com/search/?q=product+market+fit
Search filtered by type	https://www.reddit.com/search/?q=marketing&type=sr%2Cuser

---

Example Inputs

Monitor a niche community for posts:

{
    "url": ["https://www.reddit.com/r/indiehackers/"],
    "scrapeType": "listing",
    "maxListingPosts": 300
}

Find top discussions around a topic:

{
    "searchTerm": "churn reduction strategies",
    "searchSort": "top",
    "searchTime": "month",
    "scrapeType": "post",
    "maxPosts": 150
}

Scrape every reply in a high-value thread:

{
    "url": ["https://www.reddit.com/r/marketing/comments/1e2abc3/what_actually_moved_the_needle_for_you/"],
    "scrapeType": "comments",
    "maxComments": 1000
}

Pull profiles from a user list:

{
    "url": [
        "https://www.reddit.com/user/founderA",
        "https://www.reddit.com/user/founderB"
    ],
    "scrapeType": "user",
    "maxUsers": 50
}

---

Sample Output

[
    {
        "contentType": "post",
        "id": "1e2abc3",
        "parseId": "1e2abc3",
        "createdAt": "2024-09-14T09:11:00.000Z",
        "scrapedAt": "2025-11-06T20:39:27.038Z",
        "communityName": "marketing",
        "author": "growth_tinkerer",
        "title": "What actually moved the needle for you?",
        "body": "We tried a dozen growth channels. Only two worked. Curious what others found...",
        "upvotes": 2341,
        "noOfcomments": 518,
        "url": "https://www.reddit.com/r/marketing/comments/1e2abc3/what_actually_moved_the_needle_for_you/",
        "thumbnailUrl": null,
        "isVideo": false,
        "isAd": false,
        "isPinned": false,
        "isOver18": false
    },
    {
        "contentType": "comments",
        "id": "mk73px1",
        "parseId": "mk73px1",
        "createdAt": "2024-09-14T10:28:00.000Z",
        "scrapedAt": "2025-11-06T20:46:20.020Z",
        "communityName": "marketing",
        "author": "retention_nerd",
        "body": "Cold email to warm audience segments. 4x reply rate vs. cold. Nothing else came close.",
        "upvotes": 487,
        "noOfcomments": 0,
        "noOfreplies": 12,
        "url": "https://www.reddit.com/r/marketing/comments/1e2abc3/.../mk73px1/",
        "isVideo": false,
        "isAd": false,
        "isPinned": false,
        "isOver18": false,
        "depth": 0,
        "parentId": "1e2abc3",
        "postUrl": "https://www.reddit.com/r/marketing/comments/1e2abc3/what_actually_moved_the_needle_for_you/"
    },
    {
        "id": "marketing",
        "name": "t5_2sb6r",
        "title": "r/marketing",
        "headerImage": "https://styles.redditmedia.com/...",
        "description": "For marketers, growth practitioners, and anyone building an audience.",
        "over18": false,
        "createdAt": "2008-06-03T12:00:00.000Z",
        "scrapedAt": "2025-11-06T21:00:17.080Z",
        "numberOfMembers": 1820400,
        "url": "https://www.reddit.com/r/marketing/",
        "dataType": "community"
    },
    {
        "id": "z7t4q9r",
        "url": "https://www.reddit.com/user/growth_tinkerer/",
        "username": "growth_tinkerer",
        "userIcon": "https://styles.redditmedia.com/...",
        "postKarma": 3870,
        "commentKarma": 1240,
        "over18": false,
        "createdAt": "2021-05-18T08:44:00.000Z",
        "scrapedAt": "2025-11-06T20:39:27.038Z",
        "dataType": "user"
    }
]

---

Interrupted Runs

If a run is cut short — timeout, error, or manual stop — you can restart it without losing progress. Completed URLs are recorded automatically. On restart, those are skipped and the scraper resumes from the next unfinished item.

---

What People Use This For

Prospecting — surface people actively discussing problems in your space. A well-chosen subreddit and keyword combination can surface warmer leads than most paid channels.

Competitive intelligence — track how users talk about competing products, what they praise, what they complain about, and what they're looking for instead.

Voice of customer research — collect real language from real users to sharpen your messaging, positioning, and product thinking.

NLP and data science — build training sets, run sentiment analysis, model topics, or study social dynamics on large discussion datasets.

Ongoing monitoring — schedule repeat runs on the same queries to catch emerging trends, new complaints, or spikes in community interest before they peak.

---

We are here to help

Open a ticket on the Issues tab or email at mr.braveleads@gmail.com.