Reddit Scraper Pro

The Best Reddit Scraping Tool on Apify Store

Reddit Scraper Pro is the most comprehensive and user-friendly tool available for extracting data from Reddit. Unlike other scrapers, it offers unmatched flexibility and speed, allowing you to gather vast amounts of data effortlessly without any API limitations or authentication requirements. Powered by the robust Apify SDK, it’s built to handle all your Reddit scraping needs efficiently.

Key Features

1. All In One Scraper: Fetch posts, users, comments, communities with full data spectrum (titles, descriptions, images, votes, comments, etc). Contact if something is missing.
2. No API Keys or Session Tokens Required: Extract unlimited data from Reddit without worrying about rate limits or needing API keys.
3. Advanced Search and Filters: Refine your data extraction by keyword, post type, date range, or sort order.
4. Beginner-Friendly: No coding skills required—start scraping with just a few clicks.
5. Speed and Efficiency: Optimized to scrape data faster than any other tool available.
6. API Integration: Easily integrate scraped data with your existing systems using Apify's RESTful API for seamless data management and automation.
7. Multiple Export Options: Save your scraped data in JSON, CSV, Excel, XML, or HTML formats for easy analysis and integration.

Support and Feature Requests

We strive to make Reddit Scraper Pro the most comprehensive tool for your Reddit data extraction needs. However, if you find that something is missing or not working as expected:

1. Report an Issue: You can easily report any issues directly in the Run console. This helps us track and address problems efficiently.

2. Email Support: For more detailed inquiries or feature requests, feel free to email harshmaur@gmail.com.

Rest assured, you will receive a prompt response to your issue or request. We pride ourselves on our quick problem-solving and feature implementation. Your feedback is invaluable in helping us continually improve Reddit Scraper Pro to meet your needs.

Our commitment is to provide swift solutions and implement new features rapidly, ensuring that Reddit Scraper Pro remains the most up-to-date and efficient Reddit scraping tool available.

Use Cases

• Monitor Brand Mentions: Track discussions about your brand or product across Reddit.
• Conduct Sentiment Analysis: Use comment data for sentiment analysis to understand public opinion.
• Stay Ahead of Trends: Identify and analyze trending topics within various Reddit communities.
• Perform Competitor Analysis: Monitor competitor activity and discussions to gain strategic insights.

Affordable Pricing

Start scraping Reddit with Reddit Scraper Pro for 20$ per month.

How to scrape Reddit?

Reddit Scraper doesn't require any coding skills to start using it.

1. Sign up for a free Apify account.
2. Visit the Reddit Scraper Pro page.
3. Enter the URLs or keywords for the subreddits, users, or posts you want to scrape.
4. Click "Start" and let Reddit Scraper Pro handle the rest.
5. Download your results in your preferred format: JSON, CSV, Excel, XML, or HTML.

Input parameters

Reddit Scraper Pro offers versatile input options to suit your needs:

• Direct URLs: Scrape specific data from any Reddit URL, be it a post, user, or subreddit.
• Keyword Search: Extract data based on keywords for posts, users, or communities with advanced search options like sorting and date.
• NSFW Filter: Toggle to include or exclude NSFW content from your results.
• Limits: Set the maximum number of items, posts, comments, communities, or users to scrape.

Scrape by URLs

• Subreddit: https://www.reddit.com/r/technology/
• User Profile: https://www.reddit.com/user/someusername
• Popular: https://www.reddit.com/r/popular/
• Search Urls: https://www.reddit.com/search/?q=example&type=sr

Scrape by search term

To scrape Reddit using search terms, follow these steps:

1. In the "Search Term" field, enter your desired keywords or phrases.
2. Configure the search options:
   • "Get posts": Enable to search for posts (default: true)
   • "Get comments": Enable to search for comments (default: false)
   • "Get communities": Enable to search for communities (default: false)
3. Set the "Sort search" option to determine how results are ordered:
   • Options: Relevance, Hot, Top, New, Comments (default: New)
4. For post searches, specify the "Retrieve From" time range:
   • Options: All time, Last hour, Last day, Last week, Last month, Last year (default: All time)
5. Adjust the "Include NSFW content" setting if needed (default: false)
6. Set limits for the number of results:
   • "Maximum number of posts to be saved" (default: 10)
   • "Limit of comments to be saved" (default: 10)
   • "Limit of comments per post" (default: 10)
   • "Limit of Communities to be saved" (default: 2)

Example search configuration:

• Search Term: ["cryptocurrency", "blockchain"]
• Get posts: true
• Get comments: true
• Get communities: false
• Sort search: Hot
• Retrieve From: Last month
• Include NSFW content: false
• Maximum number of posts: 50
• Limit of comments: 100
• Limit of comments per post: 20

This setup will search for cryptocurrency and blockchain-related content, focusing on hot posts and comments from the last month, excluding NSFW content, and limiting the results to 50 posts with up to 100 total comments (max 20 per post).

To see the full list of parameters, their default values, and how to set the values of your own, head over to Input Schema tab.

Input Examples

Here are some input examples for different use cases, based on the input schema. Default values are included where applicable:

1. Scraping posts from a subreddit:

   1{
   2  "startUrls": [{ "url": "https://www.reddit.com/r/technology/" }],
   3  "crawlCommentsPerPost": false,
   4  "maxPostsCount": 10,
   5  "maxCommentsPerPost": 10,
   6  "includeNSFW": false,
   7  "proxy": {
   8    "useApifyProxy": true,
   9    "apifyProxyGroups": ["RESIDENTIAL"]
   10  }
   11}
   

2. Searching for posts on a specific topic:

   1{
   2  "searchTerms": ["artificial intelligence"],
   3  "searchPosts": true,
   4  "searchComments": false,
   5  "searchCommunities": false,
   6  "searchSort": "hot",
   7  "searchTime": "week",
   8  "maxPostsCount": 50,
   9  "includeNSFW": false,
   10  "proxy": {
   11    "useApifyProxy": true,
   12    "apifyProxyGroups": ["RESIDENTIAL"]
   13  }
   14}
   

3. Scraping comments from a specific post:

   1{
   2  "startUrls": [
   3    {
   4      "url": "https://www.reddit.com/r/AskReddit/comments/example_post_id/example_post_title/"
   5    }
   6  ],
   7  "crawlCommentsPerPost": true,
   8  "maxCommentsPerPost": 100,
   9  "includeNSFW": false,
   10  "proxy": {
   11    "useApifyProxy": true,
   12    "apifyProxyGroups": ["RESIDENTIAL"]
   13  }
   14}
   

4. Extracting community information:

   1{
   2  "startUrls": [{ "url": "https://www.reddit.com/r/AskScience/" }],
   3  "maxPostsCount": 0,
   4  "maxCommentsCount": 0,
   5  "includeNSFW": false,
   6  "proxy": {
   7    "useApifyProxy": true,
   8    "apifyProxyGroups": ["RESIDENTIAL"]
   9  }
   10}
   

5. Scraping user posts and comments:

   1{
   2  "startUrls": [{ "url": "https://www.reddit.com/user/example_username" }],
   3  "maxPostsCount": 20,
   4  "maxCommentsCount": 50,
   5  "includeNSFW": false,
   6  "proxy": {
   7    "useApifyProxy": true,
   8    "apifyProxyGroups": ["RESIDENTIAL"]
   9  }
   10}
   

6. Searching for comments across Reddit:

   1{
   2  "searchTerms": ["climate change"],
   3  "searchPosts": false,
   4  "searchComments": true,
   5  "searchCommunities": false,
   6  "searchSort": "top",
   7  "searchTime": "month",
   8  "maxCommentsCount": 100,
   9  "includeNSFW": false,
   10  "proxy": {
   11    "useApifyProxy": true,
   12    "apifyProxyGroups": ["RESIDENTIAL"]
   13  }
   14}
   

7. Scraping popular posts from multiple subreddits:

   1{
   2  "startUrls": [
   3    { "url": "https://www.reddit.com/r/news/" },
   4    { "url": "https://www.reddit.com/r/worldnews/" },
   5    { "url": "https://www.reddit.com/r/politics/" }
   6  ],
   7  "maxPostsCount": 10,
   8  "crawlCommentsPerPost": true,
   9  "maxCommentsPerPost": 5,
   10  "includeNSFW": false,
   11  "proxy": {
   12    "useApifyProxy": true,
   13    "apifyProxyGroups": ["RESIDENTIAL"]
   14  }
   15}
   

These examples demonstrate various configurations for different use cases of the Reddit Scraper, adhering to the provided input schema and including default values where applicable.

Limiting results

If you need to limit the scope of your search, you can do that by setting the max number of posts you want to scrape inside a community or user. You can also set a limit to the number of comments for each post. You can limit the number of communities and the number of leaderboards by using the following parameters:

1{
2  "maxPostsCount": 10,
3  "maxCommentsPerPost": 5,
4  "maxCommunitiesCount": 2,
5  "maxCommentsCount": 100,
6  "maxItems": 1000
7}

You can also set maxItems to prevent a very long run of the Actor. This parameter will stop your scraper when it reaches the number of results you've indicated. Useful for testing.

FAQ

Is Reddit scraping legal?

While scraping publicly available data from Reddit is generally allowed, it's important to comply with Reddit's terms of service and respect the site's usage policies. It's recommended to use the scraper responsibly, avoid excessive requests, and ensure that the scraped data is used in compliance with applicable laws and regulations. You can read more about compliance with ToS in our blogpost.

Do I need to use cookies for accessing logged-in content when scraping Reddit?

No, it is not required. Reddit maintains its data publicly accessible and does not enforce users to login.

Do you need proxies for scraping Reddit?

Yes. Please use Apify's residential proxies for Reddit scraping.