🤖 Reddit Posts Scraper

Scrape posts and comments from Reddit by subreddit, URL, or keyword. Get structured data with automatic proxy fallback. 📊

---

📖 What Is This Actor?

🟠 Reddit Posts Scraper is an Apify Actor that extracts public Reddit posts and comments in one run. You can target subreddits, full URLs, or search keywords and receive clean, structured JSON—perfect for research, analytics, NLP, brand monitoring, and automation.

✅ No coding required • ✅ Proxy fallback (datacenter → residential) • ✅ Retries on blocks & timeouts • ✅ Export to JSON, CSV, or API

---

🎯 Why Choose This Actor?

⚡ Fast & scalable	Handle hundreds of posts per source with parallel comment fetching
🧩 Flexible inputs	Subreddits, URLs, or keywords—one field, multiple formats
🛡️ Reliable	Automatic proxy fallback and retries on 403, 5xx, and timeouts
📤 Structured output	Subreddit, title, author, score, comments, links, timestamps, and more
🔧 Tunable	Sort order, time filter, post/comment limits, request delay, proxy
😊 Beginner-friendly	Simple form in Apify Console; no setup or code needed

---

📥 Input Parameters

Input is grouped into four sections in the Apify Console.

📍 Where to scrape

Field	Type	Description
🏷️ Reddit URLs / Subreddits / Keywords	List (required)	One per line: full URLs (e.g. https://www.reddit.com/r/news/), subreddit names (e.g. news or r/news), or search keywords (e.g. artificial intelligence).

---

📊 Sorting & time range

Field	Type	Description
🔀 Sort order	Dropdown	Hot • New • Top • Rising. How posts are ordered.
⏱️ Time filter	Dropdown	Past hour • Past 24 hours • Past week • Past month • Past year • All time. Only applies when sort order is Top or Rising.

---

🔢 Limits

Field	Type	Description
📄 Maximum posts per source	Number (1–1000)	Max posts to scrape per subreddit/keyword. Default: 50.
💬 Maximum comments per post	Number (0–1000)	Max comments to fetch per post. Set to 0 to skip comments. Default: 100.

---

🌐 Proxy & network

Field	Type	Description
⏳ Delay between requests (seconds)	Number (0–30)	Pause between requests to reduce rate limits. A small random delay is added automatically. Default: 1.
🔐 Proxy configuration	Proxy picker	Choose proxies (e.g. Apify Proxy). If Reddit blocks the request, the actor falls back to residential proxy. Recommended for large runs.

---

📤 Output (Dataset)

Results are saved to the Reddit Posts Data dataset. Each row is one post with the following fields:

Column	Description
🏷️ Subreddit	Community name (e.g. news, technology)
📝 Title	Post title
👤 Author	Reddit username of the poster
⬆️ Score	Upvotes / score
💬 # Comments	Number of comments
📅 Posted (UTC)	Unix timestamp (UTC)
🔗 Link to post	Permalink to the Reddit thread
📄 Post text	Body/selftext of the post
🖼️ Thumbnail	Thumbnail image URL
🖼️ Image	Main image URL (if any)
💬 Comments	Array of comments (author, body, score, created_utc, replies)
🆔 Post ID	Reddit post ID
✅ Success	Whether the post was scraped successfully
⚠️ Error (if any)	Error message if the post failed

You can export the dataset as JSON, CSV, or Excel, or use the Apify API to fetch results.

---

🚀 How to Use (Apify Console)

1. 🔐 Log in at console.apify.com.
2. 🔍 Find the actor — search for Reddit Posts Scraper (or open it from the store).
3. 📥 Fill the input:
   • Under Where to scrape, add subreddits, URLs, or keywords (one per line).
   • Optionally set Sort order, Time filter, Limits, and Proxy & network.
4. ▶️ Run — click Start and watch the run log.
5. 💾 Get results — open the Output tab, preview the dataset, and Export (JSON/CSV/Excel) or use the API.

---

✨ Key Features

• 📌 Multiple input types — Subreddits, full Reddit URLs, or search keywords in one list.
• 🔄 Sort & filter — Hot, New, Top, Rising + time range (hour to all time).
• 📊 Scalable limits — Up to 1000 posts per source, up to 1000 comments per post (or 0 to skip comments).
• 🛡️ Proxy fallback — No proxy → Datacenter → Residential if Reddit blocks.
• 🔁 Retries — Automatic retries on 403, 429, 5xx (e.g. UPSTREAM503/502), timeouts, and SSL/connection issues.
• 💾 Live saving — Data is pushed to the dataset as it’s scraped (partial results kept if the run stops).
• 📤 Structured JSON — Ready for analytics, NLP, dashboards, and integrations (n8n, Zapier, Make, etc.).

---

🎯 Best Use Cases

Use case	How this actor helps
📊 Market & trend research	Pull top posts and comments by keyword or subreddit.
🧠 NLP / ML datasets	Get clean text (title, body, comments) for training or analysis.
📝 Content & SEO	Discover what people talk about and find content ideas.
📈 Brand monitoring	Track mentions and sentiment across communities.
📰 Journalism & research	Gather quotes and discussions from public threads.
🔄 Automation	Trigger runs via API or connect to n8n, Zapier, Google Sheets.

---

⚖️ Legal & Ethical Use

• ✅ Allowed: Scraping publicly available Reddit content for research, analytics, and insights.
• ❌ Do not: Scrape private subreddits without permission, misuse personal data, or ignore Reddit’s terms and rate limits.
• 🛡️ This actor is designed for ethical, compliant use of public data only.

---

📋 Input / Output Examples

📥 Example input (JSON)

{
  "startUrls": [
    "https://www.reddit.com/r/news/",
    "news",
    "artificial intelligence"
  ],
  "sortOrder": "top",
  "timeFilter": "week",
  "maxPosts": 50,
  "maxComments": 100,
  "requestDelay": 1,
  "proxyConfiguration": { "useApifyProxy": false }
}

📤 Example output item (one post)

{
  "subreddit": "news",
  "title": "Example post title",
  "author": "username",
  "score": 156,
  "num_comments": 42,
  "created_utc": 1703123456.789,
  "permalink": "https://www.reddit.com/r/news/comments/abc123/...",
  "body": "Post content...",
  "thumbnail_url": "https://...",
  "image_url": "https://...",
  "comments": [
    {
      "author": "commenter1",
      "body": "Comment text...",
      "score": 23,
      "created_utc": 1703123456.789,
      "replies": []
    }
  ],
  "post_id": "abc123",
  "success": true,
  "error_message": null
}

---

❓ Frequently Asked Questions

Question	Answer
🆓 Is it free?	You can run it on Apify’s free plan for small jobs.
🔌 API-like?	Yes — output is structured JSON; you can call the actor via Apify API.
💬 Comments included?	Yes — set Maximum comments per post > 0 (or 0 to skip).
📂 Multiple subreddits?	Yes — add as many as you want in Reddit URLs / Subreddits / Keywords.
🛡️ What if Reddit blocks?	The actor uses proxy fallback (e.g. residential) and retries.
👶 Need coding?	No — use the form in Apify Console or send JSON input via API.

---

🛠️ Support & Feedback

• 🐞 Bug reports: Use the repository Issues section.
• ✨ Custom solutions or feature requests: 📧 dev.scraperengine@gmail.com

---

✅ Summary

🟠 Reddit Posts Scraper gives you posts + comments from Reddit by subreddit, URL, or keyword, with sort order, time filter, limits, and proxy support. Output is structured, exportable, and integration-ready—ideal for research, analytics, and automation. 🚀