💬 Discourse Forum Topics Scraper

🚀 Pull Discourse Forum Topics data in seconds. Pull topics from any public Discourse forum with replies, views, likes and tags.

🕒 Last updated 2026-05-27 · 📊 14 fields per record · Public source · No login required

The Discourse Forum Topics Scraper turns the public Discourse forums feed into clean, structured rows you can route to a warehouse, dashboard or downstream pipeline. No login, no manual copy-paste.

It is built for analysts, researchers and product teams who need the same data the source publishes, only normalised and ready to query.

🎯 Target Audience	💡 Primary Use Cases
Researchers	Build longitudinal datasets for analysis
Compliance teams	Monitor regulated entities and filings
Journalists	Investigate public records at scale
Data analysts	Power BI dashboards and reports
Academic teams	Run quantitative studies on public data
Product teams	Embed live Discourse forums records into apps

📋 What the Discourse Forum Topics Scraper does

• Queries Discourse forums for the latest records
• Supports targeted filtering via the input parameters
• Returns structured records with 14 fields, no scraping artifacts
• Handles pagination automatically up to your maxItems limit
• Cleans HTML entities and normalises dates and identifiers
• Delivers results to the Apify dataset, ready to query

💡 Why it matters Public data sources rarely offer bulk access. This Actor turns the live source into a queryable dataset.

🎬 Full Demo

🚧 Coming soon

⚙️ Input

Field	Type	Required	Description
maxItems	integer	No	Free users 10. Paid users optional, max 1,000,000.

Example 1, default run (preview)

{
  "maxItems": 10
}

Example 2, larger pull

{
  "maxItems": 100
}

⚠️ Good to Know Free users are limited to 10 items per run. Upgrade to a paid plan to unlock up to 1,000,000 items.

📊 Output

Field	Type
🆔 ID id	string
📌 Title title	string
slug slug	string
categoryId categoryId	string
postsCount postsCount	string
replyCount replyCount	string
views views	string
likeCount likeCount	string
createdAt createdAt	string
lastPostedAt lastPostedAt	string
tags tags	string
🔗 Source sourceUrl	string
🕒 Collected scrapedAt	string
❌ Error error	string

✨ Why choose this Actor

Feature	Detail
🌐 No login required	Public data only, no credentials needed
🔍 Targeted filtering	Search and filter via input parameters
📊 14 fields per record	Comprehensive coverage of Discourse forums
🧹 Clean output	Dates normalised, HTML stripped, arrays flattened
⚡ Fast	Direct source access without browser overhead
🔄 Auto-pagination	Retrieves results up to your maxItems
🛡️ Retry logic	Multi-attempt retry with backoff for reliability

📈 How it compares to alternatives

Method	Speed	Scale	Structured Output	Free
This Actor	Fast	1,000,000 records	Yes (14 fields)	10 free, unlimited paid
Manual site search	Slow	Limited per session	No	Yes
Custom script	Variable	Unlimited	Requires dev work	Dev cost

🚀 How to use

1. Create a free Apify account, includes $5 free credit
2. Open the Discourse Forum Topics Scraper actor page
3. Configure your input, set filters or leave defaults
4. Set maxItems (10 for a quick preview, higher for bulk pulls)
5. Click Run and wait for the dataset to populate
6. Review the dataset in the Apify console

💼 Business use cases

Compliance and Due Diligence

Teams use Discourse forums data to verify entities, monitor regulatory status and feed downstream pipelines.

Market Research

Analysts map Discourse forums records to understand market structure, competitive activity or regulatory trends.

Lead Generation

Sales teams enrich CRM records with Discourse forums data to identify prospects and qualify leads.

Investigative Journalism

Reporters use bulk pulls to find patterns, anomalies and stories hidden in public records.

🔌 Automating Discourse Forum Topics Scraper

Connect this Actor to your existing workflows using Apify integrations:

• Make (Integromat), trigger a run on a schedule and push results to Google Sheets or a database
• Zapier, automatically send new records to Airtable, Notion or your CRM
• Slack, get notified when a monitored entity has new activity
• Webhooks, receive real-time notifications when a run completes

🌟 Beyond business use cases

Academic Research

Study trends, behaviours and patterns in Discourse forums records across time.

Civic Tech and Transparency

Civic-tech projects build dashboards on top of bulk pulls to surface public-interest insights.

Education

Educators use real Discourse forums data to teach data analysis and domain knowledge.

Personal Research

Individuals, researchers, hobbyists, family historians, use bulk access to answer questions no single web search can.

🤖 Ask an AI assistant about this scraper

Paste a few sample records into ChatGPT, Claude or another AI assistant and ask it to summarise the dataset, explain fields, identify patterns or suggest filter combinations.

❓ Frequently Asked Questions

🔍 What does this Actor do? It pulls Discourse forums records into a clean, queryable dataset.

📊 How many records are available? The Actor reflects whatever the live source publishes at run time.

🔑 Do I need an account or API key? No. This Actor uses public sources that require no authentication.

📅 How up-to-date is the data? The Actor queries the source live on every run.

🔍 Can I filter by specific fields? Yes, see the Input section above for all supported filters.

⚡ How fast is the scraper? A typical 10-item preview completes in under 30 seconds.

📄 Where do the results live? Records are stored in the Apify dataset attached to the run and can be queried via the Apify API.

🏆 Why are some fields null for certain records? Some fields are optional at the source. The Actor returns null rather than fabricating values.

📋 Can I run this on a schedule? Yes, use the Apify scheduler or trigger via Make, Zapier or Webhooks.

💰 Is there a cost to use this Actor? Free users receive 10 records per run. Create a paid account to unlock up to 1,000,000 records per run.

🌍 Does it cover the full source? Yes, see the coverage line above.

🛡️ Is this Actor compliant? The Actor accesses only publicly available data, in line with the source's published terms of service.

🔌 Integrate with any app

Send data from the Apify platform to:

Spreadsheets and Databases Google Sheets, Airtable, Notion, PostgreSQL, MySQL, MongoDB

Automation and Workflows Make (Integromat), Zapier, n8n, Pipedream, Activepieces

Cloud Storage AWS S3, Google Cloud Storage, Azure Blob Storage, Dropbox

APIs and Webhooks REST API, Webhooks, Apify API

🔗 Recommended Actors

Actor	Description
OurAirports Global Airport Database Scraper	Pull worldwide airport data with ICAO and IATA codes
FINRA BrokerCheck Scraper	Pull broker and firm registration data from FINRA
Hacker News Stories Scraper	Pull live Hacker News top stories with score and comments

💡 Pro Tip browse the complete ParseForge collection for more public-data scrapers.

🆘 Need Help? Open our contact form

⚠️ Disclaimer Independent tool, not affiliated with Discourse forums. Only publicly available data is collected.