Reddit Scraper - Cost Effective avatar

Reddit Scraper - Cost Effective

Try for free

1 day trial then $15.00/month - No credit card required now

Go to Store
Reddit Scraper - Cost Effective

Reddit Scraper - Cost Effective

igolaizola/reddit-scraper
Try for free

1 day trial then $15.00/month - No credit card required now

Extract structured data from posts, comments, and media content on Reddit.com using search and explore modes. Ideal for trend analysis, sentiment tracking, and keyword monitoring. Supports proxy integration for uninterrupted, large-scale scraping with reliable results.

Reddit Scraper - Cost-Effective

🤖 What does Reddit Scraper do?

Reddit Scraper enables you to extract structured data from www.reddit.com, including posts, comments, and media content. It allows targeted data scraping based on specific subreddits, search queries, and sorting preferences.

💡 Why scrape Reddit?

Reddit is one of the largest discussion platforms on the internet, with millions of active users and a wide variety of topics. Scraping Reddit data can be valuable for:

  • 📊 Analyzing community discussions and trends.
  • 🔍 Monitoring keyword mentions across subreddits.
  • 📈 Researching user behavior and sentiment analysis.
  • 📰 Gathering content for aggregation platforms or analysis tools.

🚀 How to use Reddit Scraper

  1. Select Action: Choose between search or explore modes.
  2. Set Fetch Preferences: Decide whether to fetch posts, comments, or both.
  3. Define Action Parameters: Provide subreddit names, queries, and filters.
  4. Adjust Proxy Settings: Configure proxies for large-scale scraping.
  5. Run the Scraper: Start the process and monitor progress.

🔍 Search vs Explore Modes

  • Search Mode: Uses Reddit's search bar feature to find posts and comments based on search terms and filters.
  • Explore Mode: Focuses on subreddit and topic listings. It already includes post data by default, even if fetchPosts is disabled.

📝 Input Parameters

ParameterTypeDescription
actionstringAction type (search or explore)
maxItemsintegerMaximum number of posts to scrape
fetchModestringSpecify the type of data to fetch
- list (summary data from listing)
- post (full post data)
- comments (full post data + comments)
searchSubstringSubreddit to search within
searchQuerystringSearch term for posts or comments
searchTypestringType of content (posts, comments, media)
searchSortstringSorting criteria (relevance, hot, top, new, comments)
searchTimestringTime filter (hour, day, week, month, year)
exploreSubstringSubreddit to explore
exploreTopicstringTopic to explore
exploreSortstringSorting criteria (hot, new, top, rising)
exploreTimestringTime filter (only used for top sorting) (hour, day, week, month, year)
proxystructProxy configuration

Example Input

1{
2  "action": "search",
3  "maxItems": 50,
4  "fetchMode": "comments",
5  "searchSub": "golang",
6  "searchQuery": "web scraping",
7  "searchSort": "top",
8  "searchTime": "month",
9  "proxy": {
10    "useApifyProxy": true,
11    "apifyProxyGroups": ["RESIDENTIAL"]
12  }
13}

📊 Output

The scraper outputs structured JSON data containing the most relevant fields from Reddit posts and comments.

Example Output

1[
2  {
3    "id": "t3_1hlkdi4",
4    "created_at": "2024-12-24T19:13:00.649Z",
5    "url": "https://www.reddit.com/r/golang/comments/1hlkdi4/go_concurrency_problems_intermediate_level/",
6    "title": "Go Concurrency Problems intermediate level",
7    "author": "Confident-Option-341",
8    "author_id": "t2_9m4khn4mj",
9    "author_avatar": "https://www.redditstatic.com/avatars/defaults/v2/avatar_default_3.png",
10    "subreddit": "r/golang",
11    "subreddit_id": "t5_2rc7j",
12    "score": 7,
13    "type": "text",
14    "content": "Hi ! I have recently started interviewing for golang and it seems that the expectation has gone up for the concurrent aspects in golang. Are there any resources/interview problems available that would give one enough insight on the concurrency problems to practice? Would be grateful for any help! Thanks in advance!",
15    "content_link": "",
16    "comment_count": 2,
17    "language": "en",
18    "comments": [
19      {
20        "id": "t1_m3nlfno",
21        "parent_id": "",
22        "url": "https://www.reddit.com/r/golang/comments/1hlkdi4/comment/m3nlfno/",
23        "author": "jrandom_42",
24        "author_id": "t2_9qnz2",
25        "author_avatar": "https://styles.redditmedia.com/t5_di19t/styles/profileIcon_snoo562a14d7-08eb-4fdf-825c-9af5475305ba-headshot.png",
26        "score": 5,
27        "award_count": 0,
28        "type": "text",
29        "content": "Just out of interest OP, what questions have you faced in interviews in relation to Go concurrency?"
30      },
31      {
32        "id": "t1_m3mwev9",
33        "parent_id": "",
34        "url": "https://www.reddit.com/r/golang/comments/1hlkdi4/comment/m3mwev9/",
35        "author": "yourAsad",
36        "author_id": "t2_8vub84jf",
37        "author_avatar": "https://styles.redditmedia.com/t5_3er6gh/styles/profileIcon_wxj52p5lbs2b1.jpg",
38        "score": 7,
39        "award_count": 0,
40        "type": "text",
41        "content": "Yes, I faced the same issue when I gave an interview at a tech company. To improve, I started reading books, watching YouTube videos, and taking a Udemy course on Go concurrency. One of the books I read was Concurrency in Go: Tools and Techniques for Developers, which is recommended by the Go community itself"
42      }
43    ]
44  }
45]

💳 How much will it cost to scrape reddit.com?

Apify provides you with $5 free usage credits every month on the Apify Free plan. You can try and test Reddit-Scraper for free with the Free plan for a limited time.

However, if you need to get more data regularly from reddit.com, you should get an Apify subscription. We recommend our $49/month Personal plan - this plan covers the costs of Reddit-Scraper and numerous executions.

🌍 Proxy Configuration

Reddit Scraper supports proxy configurations to avoid IP blocking and ensure uninterrupted scraping. Use Apify Residential Proxies for reliable results.

🛠️ Troubleshooting

  • Double-check proxy settings.
  • Ensure subreddit and query parameters are correctly formatted.
  • Monitor logs for error messages.
  • Open an issue if you encounter any problems.

Happy Scraping! 🚀

Developer
Maintained by Community

Actor Metrics

  • 1 monthly user

  • 1 star

  • Created in Dec 2024

  • Modified 17 hours ago