Reddit Answers Scraper

This actor is designed to scrape structured answers from Reddit Answers, Reddit's AI-powered Q&A feature that aggregates community knowledge from across subreddits. Simply provide your questions, and get back comprehensive, organized answers with sources, related posts, and suggested topics—all in a clean, structured format.

---

🚀 Key Features

• ✅ Extracts AI-generated answers organized by topic sections
• ✅ Retrieves source subreddits and related Reddit posts with full metadata
• ✅ Captures related topics for deeper exploration
• ✅ Supports multiple questions in a single run
• ✅ Full proxy support for stable and geo-aware scraping

---

👤 Who Is This Actor For?

This actor is perfect for:

• 📊 Market researchers gathering community opinions and insights
• 🧠 Content creators researching trending topics and discussions
• 💬 Social media analysts tracking Reddit conversations and sentiment
• 🔍 SEO professionals finding popular questions and user-generated content
• 📚 Knowledge base builders aggregating community wisdom from Reddit
• 🤖 AI/ML practitioners collecting training data from real user discussions

---

❓ Why Is This Actor Important?

Reddit Answers is a relatively new feature that synthesizes information from multiple subreddits and posts to answer user questions. The content is dynamically streamed and rendered, making it difficult to access programmatically. This actor:

• Waits for the complete answer to be streamed before extraction
• Extracts clean and structured data including sections, sources, and related content
• Saves you hours of manual research and data collection
• Provides access to curated community knowledge at scale

---

Tech Notes

• It is recommended to set the actor memory to at least 4GB to avoid performance issues.

• It is recommended to set the actor's proxy type to residential.

---

Input Schema

Here's an example input you can pass to the actor:

{
  "questions": [
    "tips to improve water pressure",
    "how many planets are in our solar system?",
    "what is the best programming language for beginners?"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Input Parameters

• questions (required): An array of questions you want answers for. Each question will be submitted to Reddit Answers.
• proxyConfiguration (required): Proxy settings for the scraper. Useful for avoiding rate limits and geo-restrictions.

---

Output Schema

{
  "url": "https://www.reddit.com/answers/91ede21d-7f09-437e-91a6-4d5ae1f6d936/?q=how+many+planet+are+in+our+solar+system%3F&source=ANSWERS",
  "question": "how many planet are in our solar system?",
  "sources": [
    "https://www.reddit.com/r/threebodyproblem",
    "https://www.reddit.com/r/technology",
    "https://www.reddit.com/r/Astronomy"
  ],
  "sections": [
    {
      "heading": "Current Consensus",
      "content": [
        "8 Planets: The current official count of planets in our solar system is eight. This includes Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, and Neptune."
      ]
    },
    {
      "heading": "Pluto and Dwarf Planets",
      "content": [
        "Pluto's Reclassification: Pluto was reclassified as a dwarf planet in 2006..."
      ]
    },
    {
      "heading": "Potential Additional Planets",
      "content": [
        "Planet Nine: There is ongoing discussion and research about the potential existence of a ninth planet..."
      ]
    },
    {
      "heading": "Fun Facts",
      "content": [
        "Orbital Periods: The orbital periods of planets vary dramatically..."
      ]
    },
    {
      "heading": "Subreddits for Further Exploration",
      "content": [
        "r/Astronomy    r/space    r/askscience",
        "Feel free to dive deeper into these subreddits to learn more!"
      ]
    }
  ],
  "relatedPosts": [
    {
      "rank": "1",
      "title": "8 planets in the solar system.",
      "subreddit": "threebodyproblem",
      "url": "https://www.reddit.com/r/threebodyproblem/comments/1mmdaq8/8_planets_in_the_solar_system/",
      "upvotes": 59,
      "comments": 24,
      "domain": "self.threebodyproblem",
      "promoted": false,
      "score": 59
    },
    {
      "rank": "2",
      "title": "Our solar system may indeed have 9 planets, paper finds",
      "subreddit": "technology",
      "url": "https://www.reddit.com/r/technology/comments/1kqmmfg/our_solar_system_may_indeed_have_9_planets_paper/",
      "upvotes": 16,
      "comments": 75,
      "domain": "nicenews.com",
      "promoted": false,
      "score": 16
    }
  ],
  "relatedTopics": [
    "how many moons does each planet have?",
    "what are the characteristics of dwarf planets?",
    "is there a ninth planet in our solar system?"
  ]
}

Output Fields

• url: The Reddit Answers page URL for the question
• question: The question that was asked
• sources: Array of subreddit URLs that contributed to the answer
• sections: Organized answer sections with headings and content
• relatedPosts: Array of relevant Reddit posts with metadata (rank, title, subreddit, upvotes, comments, etc.)
• relatedTopics: Suggested related questions for further exploration

---

💡 Use Cases

1. Market Research

Gather authentic community opinions on products, services, or topics by asking questions and analyzing the structured responses and related discussions.

2. Content Creation

Discover what questions people are asking and what answers resonate with communities. Use the insights to create targeted content.

3. Competitive Intelligence

Ask questions about competitors, industries, or products to see what the Reddit community is saying.

4. SEO & Content Strategy

Identify popular questions and related topics to inform your content strategy and target long-tail keywords.

5. Training Data Collection

Collect high-quality Q&A pairs with source attribution for training language models or building knowledge bases.

---

👀 p.s.

Got feedback or need an extension?

Lexis Solutions is a certified Apify Partner. We can help you with custom solutions or data extraction projects.

Contact us over Email or LinkedIn

Support Our Work 💝

If you're happy with our work and scrapers, you're welcome to leave us a company review here and leave a review for the scrapers you're subscribed to. It will take you less than a minute but it will mean a lot to us!

Image Credit: https://www.reddit.com