Pricing

from $3.00 / 1,000 results

Try for free

Go to Apify Store

Discourse Community Scraper

Try for free

Scrape any public Discourse forum with latest topics, trending discussions, category browsing, tag filtering, full-text search, user profiles, and complete post threads. Works with meta.discourse.org, community forums, and any self-hosted Discourse.

Pricing

from $3.00 / 1,000 results

Rating

5.0

(7)

Developer

Crawler Bros

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

Developer tools

Automation

Other

You can access the Discourse Community Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "forumUrl": "https://meta.discourse.org",
12    "mode": "latestTopics",
13    "period": "weekly",
14    "searchQuery": "getting started",
15    "maxItems": 50
16};
17
18// Run the Actor and wait for it to finish
19const run = await client.actor("crawlerbros/discourse-community-scraper").call(input);
20
21// Fetch and print Actor results from the run's dataset (if any)
22console.log('Results from dataset');
23console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
24const { items } = await client.dataset(run.defaultDatasetId).listItems();
25items.forEach((item) => {
26    console.dir(item);
27});
28
29// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Discourse Community Scraper API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Discourse Community Scraper API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Discourse Community Scraper API in Python

Discourse Community Scraper API through CLI

Discourse Community Scraper OpenAPI definition

Discourse Community Scraper API

Discourse Forum Scraper

automation-lab/discourse-scraper

Extract topics, posts, and discussions from any public Discourse forum. Supports latest topics, category filtering, and keyword search. No login required.

Stas Persiianenko

Discourse Scraper: Topics, Posts, Users & Search

perconey/discourse-scraper

Scrape any Discourse forum via the public REST API. Latest / top topics, category topics, full topic + posts, user profiles + activity, full-text search. No browser, no proxies, no auth. Pay only per result item.

Perconey

Discourse Forum Topics Scraper

parseforge/discourse-forum-topics-scraper

Gather social activity from Discourse Forum Topics with profile name, follower count, posts, replies and timestamps. Loved by community managers, brand watchers and trend researchers. Run on demand or on a recurring schedule and feed every row into your favourite analytics or workflow stack.

ParseForge

Hacker News Comments Scraper — Threads & Discussions

openclawmara/hackernews-comments-scraper

Scrape full comment trees from Hacker News stories. Extracts threaded discussions with author, text, points, depth, timestamp. Fetch by story ID, URL, or top/new stories. Ideal for sentiment analysis, tech discourse research, and developer community insights. Uses official Firebase API.

OpenClaw Mara

Google Forums Search

burbn/google-forums-search

Search discussions and forums across the web using Google Forums tab. Find forum posts from Reddit, Quora, Stack Overflow, Apple Support & more. Filter by time, country & language. Perfect for market research, brand monitoring & community insights.

Kevin

Google Forums API

johnvc/google-forums-search-api

Extract forum threads, Q&A, and community discussions from Google Search’s "Forums" tab. Supports 40+ countries, custom localization (GL/HL), and pagination. Get structured JSON data from Reddit, LinkedIn, Quora, and niche forums for sentiment analysis, market research, or AI training.

John

5.0

Etsy Community Posts discussion Scraper

getdataforme/etsy-community-posts-scraper

An Etsy community post scraper is a tool designed to automatically extract posts, comments, and user interactions from the Etsy community forums. It helps researchers, sellers, or analysts gather insights on trending topics, customer concerns, and marketplace behavior.

GetDataForMe

Flashback.org Scraper

lexis-solutions/flashback-org-scraper

Scrape Flashback.org forum threads and posts for Swedish community insights, capturing content, user profiles, and metadata at scale with flexible search, limits, and proxy support for research and monitoring.

Lexis Solutions

YouTube Community Posts Scraper

lurkapi/youtube-community-posts-scraper

Scrape community posts from YouTube channels. Extract text, images, polls, videos, likes, comments, and engagement data from any channel's Community tab.

LurkAPI

Threads Scraper

magicfingers/threads-scraper

Scrape Threads (by Meta) public data: user profiles, posts/threads, replies, and keyword search. Extracts follower counts, engagement metrics, media URLs, and more.