🔮 Metaculus Questions Scraper

🚀 Export Metaculus forecasting questions in seconds, including community predictions, prediction counts, categories, and resolution dates, straight from the public api2 endpoint.

🕒 Last updated: 2026-05-29 · 📊 12 fields per record · 50,000+ Metaculus questions · Crowdsourced forecasting

The Metaculus Questions Scraper turns the Metaculus public api2/questions/ endpoint into a clean dataset. It walks the cursor-paginated feed, filters by status and free-text search, and emits one row per question with the community median prediction, category, and timing.

🎯 Target Audience	💡 Primary Use Cases
🔮 Forecasters	Calibration & track records
📊 Researchers	Wisdom-of-crowds datasets
🏢 Hedge funds	Tail-risk signal monitoring
🤖 ML researchers	Forecast aggregation training
📰 Journalists	Real-world probability quotes
👩‍💻 Developers	Mirror Metaculus locally

📋 What the Metaculus Questions Scraper does

• Calls https://www.metaculus.com/api2/questions/ with status, search, and ordering filters.
• Walks pagination until maxItems is reached.
• Extracts community median prediction, prediction count, categories, close & resolve times.
• Exports as CSV, Excel, JSON, JSONL, XML, RSS, or HTML.

💡 Why it matters: Metaculus is the largest serious forecasting community on the internet. Their community predictions are battle-tested calibration sources.

🎬 Full Demo

🚧 Coming soon.

⚙️ Input

Field	Type	Required	Description
maxItems	integer	No	Free 10, paid up to 1M.
status	enum	No	open, closed, resolved, all.
search	string	No	Full-text query.
orderBy	enum	No	Sort order.

Example 1:

{ "status": "open", "orderBy": "-vote_score", "maxItems": 50 }

Example 2:

{ "search": "AI", "status": "open" }

⚠️ Good to Know: The Metaculus api2 endpoint is public. No key required.

📊 Output

Field	Type	Description
🆔 id	number	Question ID.
📛 title	string	Question title.
🔗 url	string	Public URL.
🟢 status	string	open/closed/resolved.
🏷️ category	string	Comma-joined categories.
⏰ close_time	string	When forecasting closes.
🔮 community_prediction	number	Community median (q2).
🧮 num_predictions	number	Total predictions count.
🕒 scrapedAt	string	When fetched.
❌ error	string	Error if upstream failed.

Sample record:

{
  "id": 12345,
  "title": "Will AGI be declared before 2030?",
  "url": "https://www.metaculus.com/questions/12345/",
  "status": "open",
  "category": "AI, Tech",
  "close_time": "2029-12-31T23:59:00Z",
  "community_prediction": 0.18,
  "num_predictions": 4521,
  "scrapedAt": "2026-05-29T13:00:00.000Z",
  "error": null
}

✨ Why choose this Actor

| 🆓 | Public Metaculus api2, no key. | | 🔮 | Pulls community median directly. | | 🔢 | Numeric casting on every numeric field. | | 🛟 | Errors surfaced cleanly. | | 🔌 | Status, search, sort filters. | | 💾 | CSV / Excel / JSON / XML / RSS / HTML. |

📈 How it compares to alternatives

Approach	Setup	Pagination?	Filter?	Errors?
Raw fetch	20 min	manual	manual	❌
Custom scraper	1 hr	✅	partial	partial
This Actor	5 sec	✅	✅	✅

🚀 How to use

1. Click Try for free.
2. Pick a status / search.
3. Click Start.

💼 Business use cases

📊 Tail-risk monitoring. Watch AI, geopolitics, biosecurity questions for tail signals.

💼 Calibration research. Build calibration plots vs Metaculus community.

📰 Newsroom. Quote crowd probabilities in stories.

🤖 ML. Train forecast aggregation models.

🔌 Automating Metaculus Questions Scraper

• Make / Zapier to Airtable / Slack.
• Cron schedule native Apify.
• Webhooks on completion.
• Pipe to BigQuery / Snowflake / Postgres.

🌟 Beyond business use cases

🎓 Education. Teach forecasting / Bayesian inference.

🧪 Personal research. Track your interest area.

🤝 Open data. Public forecast dashboards.

🧰 Prototyping. Quick feed.

🤖 Ask an AI assistant about this scraper

Drop this README into ChatGPT or Claude.

❓ Frequently Asked Questions

❓ API key? None.

❓ Pagination? Cursor-paginated, fully walked.

❓ Filter? Yes - status, search, sort.

❓ Cast? Yes.

❓ Errors? Clean {error} record.

❓ Schedule? Yes.

❓ Scraping or API? Public api2.

❓ Schema stable? Yes.

❓ Formats? CSV, Excel, JSON, JSONL, XML, RSS, HTML.

❓ Coverage? All Metaculus questions.

🔌 Integrate with any app

Apify integrations with Make, Zapier, Slack, Discord, Google Drive, Google Sheets, Gmail, Airbyte, Keboola, Telegram, GitHub, REST/webhook.

🔗 Recommended Actors

Actor	What it does
ParseForge PredictIt Markets Scraper	Political prediction markets.
ParseForge The Odds API Sports Scraper	Sports betting markets.
ParseForge Stocktwits Trending Symbols Scraper	Retail sentiment.
ParseForge Alpha Vantage Public Scraper	Stocks, FX, crypto.

💡 Pro Tip: browse the complete ParseForge collection for 900+ scrapers.

---

Disclaimer: This actor scrapes only publicly available data. ParseForge is not affiliated with, endorsed by, or sponsored by any of the third-party services referenced. Users are responsible for complying with the target site's terms of service and applicable law. Create a free account w/ $5 credit.