Reddit Subreddit, Thread & Search to JSON & AI Scraper avatar

Reddit Subreddit, Thread & Search to JSON & AI Scraper

Pricing

$2.00 / 1,000 scraped reddit post / thread for ais

Go to Apify Store
Reddit Subreddit, Thread & Search to JSON & AI Scraper

Reddit Subreddit, Thread & Search to JSON & AI Scraper

Extract Reddit posts, upvotes, comment counts, author metadata, outbound links, and clean LLM-ready Markdown discussions from any Subreddit, search feed, or thread URL for AI agents, RAG pipelines, and market research.

Pricing

$2.00 / 1,000 scraped reddit post / thread for ais

Rating

0.0

(0)

Developer

Tung Nguyen

Tung Nguyen

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 hours ago

Last modified

Share

Reddit Subreddit, Search & Discussion Thread to Clean JSON & AI Markdown Scraper

Extract Reddit posts, upvotes/scores, comment counts, authors, outbound links, self-text, and LLM-ready Markdown from any Subreddit (old.reddit.com/r/..., reddit.com/r/.../.json), thread URL, or community forum for AI Agents, RAG Pipelines, Sentiment Analysis, and B2B Market Research.

Why Use This Reddit to JSON & AI Markdown Scraper?

Reddit is one of the highest-signal data sources on the internet for product research, user pain points, software comparisons, and AI training context. This Actor converts noisy Reddit threads and Subreddit feeds into clean, token-counted JSON and Markdown ready for OpenAI, Claude, Gemini, LangChain, and LlamaIndex.

Key Features

  • Multi-Format Reddit Support: Automatically parses Reddit .json endpoints (?raw_json=1), old.reddit.com DOM listings, modern shreddit-post web components, and discussion threads.
  • LLM & RAG Ready (markdownForAi + estimatedTokens): Every extracted post includes a clean Markdown summary alongside word count and estimated LLM token count.
  • Ultra-Fast & Lightweight: Powered by @crawlee/cheerio on Node.js 24 — zero heavy headless browser overhead required.

Input Parameters

FieldTypeDefaultDescription
startUrlsarrayRequiredList of Subreddit URLs (e.g. https://old.reddit.com/r/programming/ or https://www.reddit.com/r/LocalLLaMA.json) or thread URLs.
maxPostsinteger50Maximum number of posts to extract per run.

Example Input JSON

{
"startUrls": [
{ "url": "https://old.reddit.com/r/programming/" }
],
"maxPosts": 50
}

Output Dataset Sample

{
"id": "t3_1abcde",
"subreddit": "r/programming",
"title": "Show r/programming: High-speed web scraping pipeline for LLMs",
"author": "dev_builder",
"score": 412,
"numComments": 89,
"url": "https://old.reddit.com/r/programming/comments/1abcde/...",
"permalink": "https://old.reddit.com/r/programming/comments/1abcde/...",
"selftext": "We benchmarked Cheerio vs Playwright for RAG ingestion...",
"wordCount": 24,
"estimatedTokens": 33,
"markdownForAi": "# Show r/programming: High-speed web scraping pipeline for LLMs\n- **Subreddit**: r/programming | **Author**: dev_builder | **Score**: 412 | **Comments**: 89",
"createdAt": "2026-11-01T08:00:00.000Z",
"scrapedAt": "2026-11-01T09:45:00.000Z"
}