👽 Reddit Scraper — Posts, Comments, Users & Search (AI-Ready)

Extract Reddit posts, comments, user history and search results as clean, structured data — in Markdown, HTML or plain text with word and token counts on every item. No Reddit API key, no app registration and no OAuth: point it at a subreddit, a post URL, a username or a search query and get back full threads with scores, awards, flair, images and nested comment hierarchies intact. Export to JSON/CSV/Excel, run on a schedule, call via API, or connect to Make, Zapier or n8n.

🤖 What is the Reddit Scraper?

It turns any Reddit page into a structured dataset. Choose one of four modes — subreddit, single post + comments, user posts or a Reddit search — add optional filters for sort order, time range, date and result caps, then Run. The Actor reads Reddit's public JSON endpoints (no browser needed), paginates automatically, and can expand Reddit's "load more comments" and "continue this thread" stubs so the scraped comment count matches the post's real num_comments. Every post and comment is normalised into a flat, predictable record — perfect for AI training data, market research, sentiment analysis and content ideas.

What data does it extract?

• Post title, body and content in markdown, html or text (whichever you pick)
• Scores & engagement — score, upvote_ratio, num_comments, total awards
• Author & subreddit (with subreddit ID) and the post permalink + url
• Nested comment threads with full hierarchy, depth, scores and timestamps
• User post history across any public account
• Images & media — image URLs with width/height, plus thumbnails
• Post type & flags — self/video, NSFW, spoiler, stickied, locked, post hint, domain
• Flair (link_flair_text) and timestamps (created_utc)
• AI-ready stats — word_count and estimated token_count for every post and comment

⬇️ Input

Run it four ways — pick a mode and fill in the matching field:

Field	Description
mode	subreddit, post, user, or search
subreddit	Subreddit to scrape, e.g. python or r/python (subreddit mode)
postUrl	Full URL of a Reddit post (post mode)
username	Reddit username to pull posts from (user mode)
searchQuery	Search term to find posts (search mode)
searchSubreddit	Optionally limit a search to one subreddit
sort	hot, new, top, rising, controversial, or relevance (search)
timeFilter	hour, day, week, month, year, all (for top/controversial)
maxPosts	Max posts to scrape, 0 = unlimited (up to 10,000)
maxComments	Max comments per post, 0 = unlimited
includeComments	Also scrape comments for each post in subreddit mode
expandMoreComments	Resolve "load more" / "continue thread" stubs (on by default)
sinceDate	Only posts after this date (YYYY-MM-DD)
outputFormat	markdown (best for AI), html, or text
includeImages	Extract image URLs from posts
delaySeconds	Delay between requests to respect rate limits

Example input

{
  "mode": "subreddit",
  "subreddit": "ArtificialInteligence",
  "sort": "top",
  "timeFilter": "week",
  "maxPosts": 100,
  "includeComments": true,
  "maxComments": 200,
  "outputFormat": "markdown",
  "includeImages": true
}

⬆️ Output

Every post and comment is one clean record (view as a table, or export JSON / CSV / Excel).

A post looks like this:

{
  "id": "abc123",
  "title": "How I built an AI agent that scrapes Reddit",
  "url": "https://www.reddit.com/r/ArtificialInteligence/comments/abc123/how_i_built_an_ai_agent/",
  "permalink": "/r/ArtificialInteligence/comments/abc123/how_i_built_an_ai_agent/",
  "selftext": "Here's my complete guide to building a scraping agent...",
  "selftext_markdown": "Here's my complete guide to building a **scraping agent**...",
  "author": "ai_developer",
  "subreddit": "ArtificialInteligence",
  "subreddit_id": "t5_2qh0y",
  "score": 1250,
  "upvote_ratio": 0.97,
  "num_comments": 89,
  "is_self": true,
  "is_video": false,
  "post_hint": "self",
  "domain": "self.ArtificialInteligence",
  "thumbnail": "https://b.thumbs.redditmedia.com/example.jpg",
  "images": [
    { "url": "https://i.redd.it/example.jpg", "width": 1200, "height": 800, "caption": null }
  ],
  "created_utc": "2026-06-20T10:30:00",
  "total_awards_received": 3,
  "link_flair_text": "Discussion",
  "over_18": false,
  "spoiler": false,
  "stickied": false,
  "locked": false,
  "word_count": 850,
  "token_count": 1200
}

A comment (returned in post mode, or in subreddit mode with includeComments):

{
  "id": "xyz789",
  "post_id": "abc123",
  "parent_id": "t3_abc123",
  "permalink": "/r/ArtificialInteligence/comments/abc123/how_i_built_an_ai_agent/xyz789/",
  "body": "This is brilliant — how do you handle rate limits?",
  "body_markdown": "This is brilliant — how do you handle rate limits?",
  "author": "curious_dev",
  "score": 42,
  "ups": 42,
  "downs": 0,
  "created_utc": "2026-06-20T11:05:00",
  "edited": false,
  "is_submitter": false,
  "stickied": false,
  "depth": 0,
  "replies": [],
  "total_awards_received": 0,
  "word_count": 8,
  "token_count": 11
}

💡 Use cases

• 🤖 AI & LLM training data: pull real human conversations and expert Q&A from any community as clean Markdown with token counts, ready for fine-tuning and RAG pipelines.
• 📊 Market & brand research: track mentions, pain points and product feedback across subreddits to understand what people actually think.
• 😊 Sentiment analysis: scrape thousands of comments on a launch, brand or topic and feed scores, text and threads straight into your model.
• ✍️ Content & trend research: mine top posts in your niche for viral angles, headlines and audience questions worth writing about.

❓ FAQ

How do I scrape a subreddit? Set mode to subreddit, enter the subreddit name (e.g. python), pick a sort and maxPosts, then Run. You get every matching post with scores, flair, images and AI-ready text. Flip on includeComments to also pull each post's comments.

Can I scrape all the comments on a single post? Yes. Use mode: post, paste the postUrl, and set maxComments (0 = unlimited). With expandMoreComments on (the default) it resolves Reddit's "load more comments" and "continue this thread" stubs so the count matches the post.

Can I search Reddit or scrape a user's posts? Yes. Use mode: search with a searchQuery (optionally limited to one subreddit via searchSubreddit), or mode: user with a username to pull that account's public post history.

Do I need an API key? No. The Actor uses Reddit's public JSON endpoints, so there's no Reddit API key, app registration or OAuth to set up — just enter your target and Run.

What output format should I use for AI? Choose markdown — it preserves structure (bold, links, lists), stays clean and lightweight, and works great with LLMs. html and text are also available, and every item ships with word_count and token_count.

Can I get only recent posts? Yes. Use sort: top or controversial with a timeFilter (hour/day/week/month/year/all), or set sinceDate (YYYY-MM-DD) to keep only newer posts — ideal for incremental, scheduled runs.

Can I run it on a schedule or via API? Yes — schedule recurring runs in Apify, call it via the API/SDK, or connect it to Make, Zapier or n8n to push fresh Reddit data into your stack.

Can it scrape private or deleted content? No. Only public posts and comments are available — deleted/removed items and private subreddits can't be accessed without authentication.

How many posts can it return? Up to your maxPosts cap (or unlimited with 0); it paginates automatically. For very large jobs, batch with date ranges to keep runs manageable.

Is scraping Reddit legal? It extracts publicly available data from Reddit's own JSON endpoints and paces requests to respect rate limits. Use it responsibly for research and analysis, and follow applicable laws and Reddit's terms.

🔗 You might also like

• Reddit Archive Scraper — years of historical Reddit posts & comments
• Lemmy Scraper — posts & comments from Lemmy communities
• Stock Sentiment Intelligence — social sentiment signals for stocks & tickers

---

Keywords: reddit scraper, reddit api, scrape reddit, reddit data extraction, reddit comments scraper, subreddit scraper, reddit search api, reddit user scraper, reddit posts, AI training data, LLM training data, sentiment analysis, social media scraping, markdown export, reddit json api, no api key, market research, content research.