Reddit Posts Scraper: Extract Reddit Data Efficiently

Overview

The Reddit Posts Scraper is a powerful tool designed to extract detailed post data from Reddit. Whether you're conducting sentiment analysis, monitoring trends, or gathering insights for research, this scraper enables efficient and accurate data collection from any subreddit.

Features

• Comprehensive Data Extraction: Retrieve essential details such as:

  • Post title
  • Author
  • Creation timestamp
  • Number of comments
  • Score (upvotes)
  • Permalink
  • Image and thumbnail URLs (if available)
  • Post body content
  • Comments

• Flexible Input Parameters: Customize your scraping with options like:

  • Subreddit name
  • Post limit
  • Post category (hot, new, top, rising)
  • Time filter (hour, day, week, month, year, all)

• Structured Output: Export the collected data in JSON format for seamless integration with analytical tools.

Usage

Input Configuration

The scraper accepts the following input parameters:

1. Subreddit Name:

   • Specify the subreddit you want to scrape.
   • Example:

     1{
     2  "subreddit_name": "worldnews",
     3   "limit": 10,
     4   "proxy_configuration": {
     5       "useApifyProxy": true,
     6       "apifyProxyGroups": [
     7           "RESIDENTIAL"
     8       ]
     9   }
     10}
     

2. Limit:

   • Set the number of posts to scrape (minimum: 1, default: 1).

3. Category:

   • Choose from "hot", "new", "top", or "rising" posts.

4. Time Filter:

   • Specify a time range for "top" category posts (hour, day, week, month, year, all).

5. Proxy Configuration:

   • Enable or disable Apify proxy settings.
   • It is recommended to enable proxies to avoid potential bans when scraping large amounts of data.

Output Data

The scraper collects the following information:

• Title
• Author
• Created UTC timestamp
• Number of comments
• Score
• Permalink (direct link to the post)
• Image URL
• Thumbnail URL
• Post body text
• Comments (if available)

The output is stored in JSON format, allowing easy data processing.

Quick Start

1. Install the scraper from the Apify Marketplace.
2. Configure the input parameters in the input schema.
3. Run the scraper and download the output in JSON format.

Example Use Cases

• Trend Monitoring: Track the most popular discussions on specific subreddits.
• Sentiment Analysis: Analyze user sentiment based on post and comment content.
• Content Aggregation: Gather data for news feeds, blogs, or research purposes.
• Competitive Analysis: Monitor engagement and popularity of competitors' content.

Output Storage

The scraper stores results in a structured dataset, allowing easy access to:

• Title
• URL
• Post metadata
• Comments
• Images (if applicable)

Output Example

1{
2  "title": "Major news event",
3  "author": "reddit_user123",
4  "created_utc": 1700000000,
5  "num_comments": 256,
6  "score": 1500,
7  "permalink": "https://www.reddit.com/r/worldnews/comments/example",
8  "image_url": "https://preview.redd.it/example.jpg",
9  "thumbnail_url": "https://b.thumbs.redditmedia.com/example.jpg",
10  "body": "This is the post content.",
11  "comments": [
12    {
13      "author": "commenter1",
14      "body": "Interesting perspective!",
15      "score": 120
16    },
17    {
18      "author": "commenter2",
19      "body": "I disagree because...",
20      "score": 85
21    }
22  ]
23}

Feedback and Support

For questions, feature requests, or support, visit the Apify community forum or contact us directly through the Apify platform.

Explore More Actors

✨ Looking for additional solutions? Check out more actors on Apify that can help with your web automation and data extraction needs. Discover a wide range of tools tailored for different scenarios at 🌐 Explore Vulnv's Actors on Apify.

📧 For inquiries or support, feel free to reach out to us at apify@vulnv.com.