PredictIt Comments Scraper: Extract User Discussions from Prediction Markets

Scrape user comments and discussions from PredictIt.org prediction markets.

The PredictIt Comments Scraper is an Apify Actor designed for sentiment analysis, market research, and data journalism. It extracts user comments from PredictIt prediction markets, including author information, likes, timestamps, and reply relationships.

Whether you're analyzing trader sentiment, studying prediction market communities, or tracking political discussions, this tool delivers structured comment data in JSON, CSV, Excel, or HTML formats.

Why Use PredictIt Comments Scraper?

🎯 Perfect for

• 📊 Sentiment Analysis: Analyze trader sentiment and market psychology from user discussions.
• 🔍 Market Research: Understand the reasoning behind market movements and price changes.
• 📰 Data Journalism: Track political discussions and public opinion on prediction markets.
• 🏫 Academic Research: Study prediction market communities and crowd wisdom.
• 💹 Trading Insights: Gain edge by understanding what other traders are thinking.

✨ Key Features

• ✅ Full Comment Extraction - Scrape all comments from any PredictIt market thread.
• ✅ Author Details - Get username, display name, avatar, and reputation scores.
• ✅ Reply Threading - Preserve parent-child relationships between comments.
• ✅ Proxy Rotation - Built-in intelligent proxy management for reliability.
• ✅ Flexible Export - Download structured datasets in JSON, CSV, Excel, or HTML.

What Data Can PredictIt Comments Scraper Extract?

📋 Comment Information

Field	Description
id	Unique comment identifier
message	Comment text content (HTML formatted)
raw_message	Raw comment text without HTML
createdAt	Timestamp when comment was posted
likes	Number of likes on the comment
dislikes	Number of dislikes on the comment
points	Net points (likes - dislikes)
parent	Parent comment ID (if this is a reply)
depth	Reply depth level (0 = top-level)
thread	Discussion thread identifier
forum	Forum name (predictit)
marketId	Added field - PredictIt market ID for multi-market identification
isEdited	Whether comment was edited
isDeleted	Whether comment was deleted
isSpam	Whether comment is marked as spam

👤 Author Information

Field	Description
author.username	Author's unique username
author.name	Author's display name
author.id	Author's unique user ID
author.reputation	Author's reputation score
author.reputationLabel	Reputation label (e.g., "High", "Average")
author.joinedAt	When author joined the platform
author.avatar	Avatar image URLs (small, large, xlarge)
author.profileUrl	Link to author's profile

How to Scrape PredictIt Comments

Quick Start Guide

1. Enter Market IDs or URLs - Paste PredictIt market IDs or full URLs
2. Set a limit (optional) - Maximum comments to scrape per market (0 = unlimited)
3. Run the Actor - Comments will be automatically collected
4. Download results - Export in JSON, CSV, Excel, or HTML format

Input Example

{
  "marketIdsOrUrls": ["8153"],
  "limit": 100
}

Input Parameters

Parameter	Type	Required	Default	Description
marketIdsOrUrls	array	✅ Yes	-	List of market IDs or URLs to scrape comments from
limit	integer	No	0	Maximum comments per market (0 = unlimited)

Examples

Scrape by Market ID:

{
  "marketIdsOrUrls": ["8153", "8523", "8456"]
}

Scrape by URL:

{
  "marketIdsOrUrls": [
    "https://www.predictit.org/markets/detail/8153/Who-will-win-the-2028-Democratic-presidential-nomination"
  ]
}

Limit comments per market:

{
  "marketIdsOrUrls": ["8153"],
  "limit": 50
}

Output

You can download the dataset in JSON, CSV, Excel, or HTML formats.

Output Example

{
    "editableUntil": "2026-01-23T00:13:12",
    "dislikes": 0,
    "thread": "10582691464",
    "numReports": 0,
    "likes": 0,
    "message": "<p>Clinton and Obama didn't have ICE agents and the national guard weaponized against state government's wishes. Nice try...</p><p>The rest is fan fiction. You think it is good that Elon Musk, an African immigrant, can buy politicians and make them their pets (and weaponize Xitter against them). That's anti-American</p>",
    "id": "6824235631",
    "createdAt": "2026-01-16T00:13:12",
    "author": {
        "username": "predictit-89feadf95f72e7b17368cd49e8c26211",
        "about": "",
        "name": "0lumpy",
        "disable3rdPartyTrackers": false,
        "isPowerContributor": false,
        "joinedAt": "2020-11-09T03:01:27",
        "rep": 9.799519999999998,
        "profileUrl": "https://disqus.com/by/predictit-89feadf95f72e7b17368cd49e8c26211/",
        "url": "",
        "reputation": 9.799519999999998,
        "location": "",
        "isPrivate": false,
        "signedUrl": "",
        "isPrimary": true,
        "isAnonymous": false,
        "id": "359337336",
        "reputationLabel": "High",
        "avatar": {
            "permalink": "https://disqus.com/api/users/avatars/predictit-89feadf95f72e7b17368cd49e8c26211.jpg",
            "xlarge": {
                "permalink": "https://disqus.com/api/users/avatars/predictit-89feadf95f72e7b17368cd49e8c26211.jpg",
                "cache": "https://c.disquscdn.com/uploads/users/35933/7336/avatar200.jpg?1769526039"
            },
            "cache": "https://c.disquscdn.com/uploads/users/35933/7336/avatar92.jpg?1769526039",
            "large": {
                "permalink": "https://disqus.com/api/users/avatars/predictit-89feadf95f72e7b17368cd49e8c26211.jpg",
                "cache": "https://c.disquscdn.com/uploads/users/35933/7336/avatar92.jpg?1769526039"
            },
            "small": {
                "permalink": "https://disqus.com/api/users/avatars/predictit-89feadf95f72e7b17368cd49e8c26211.jpg",
                "cache": "https://c.disquscdn.com/uploads/users/35933/7336/avatar32.jpg?1769526039"
            },
            "isCustom": true
        }
    },
    "media": [],
    "isSpam": false,
    "isDeletedByAuthor": false,
    "isHighlighted": false,
    "hasMore": false,
    "parent": 6824161739,
    "isApproved": true,
    "isNewUserNeedsApproval": false,
    "isDeleted": false,
    "isFlagged": false,
    "raw_message": "Clinton and Obama didn't have ICE agents and the national guard weaponized against state government's wishes. Nice try...\n\nThe rest is fan fiction. You think it is good that Elon Musk, an African immigrant, can buy politicians and make them their pets (and weaponize Xitter against them). That's anti-American",
    "isAtFlagLimit": false,
    "canVote": false,
    "forum": "predictit",
    "depth": 6,
    "points": 0,
    "moderationLabels": [],
    "isEdited": false,
    "sb": false
},
{
    "editableUntil": "2026-01-23T20:50:07",
    "dislikes": 0,
    "thread": "10582691464",
    "numReports": 0,
    "likes": 0,
    "message": "<p><i>Clinton and Obama didn't have ICE agents and the national guard weaponized against state government's wishes. </i></p><p>Nice try... state governments have no say in immigration. They can wish as much as they want but this was all litigated back when Obama was president and Arizona tried to enforce its border with Mexico. The federal judiciary ruled that immigration enforcement is under federal authority. So Governor Walz better keep out of the way while President Trump has ICE do the work the American people re-elected him to do.</p><p>And Elon Musk is a guest in this country who better behave if he wants to stay. Ilhan Omar is the anti-American.</p>",
    "id": "6824655212",
    "createdAt": "2026-01-16T20:50:07",
    "author": {
        "username": "predictit-a9023bff2fb9d6f8ade5169e899a763b",
        "about": "",
        "name": "NPCDave",
        "disable3rdPartyTrackers": false,
        "isPowerContributor": false,
        "joinedAt": "2021-01-09T03:08:16",
        "rep": 1.2873039999999998,
        "profileUrl": "https://disqus.com/by/predictit-a9023bff2fb9d6f8ade5169e899a763b/",
        "url": "",
        "reputation": 1.2873039999999998,
        "location": "",
        "isPrivate": false,
        "signedUrl": "",
        "isPrimary": true,
        "isAnonymous": false,
        "id": "362567298",
        "reputationLabel": "Average",
        "avatar": {
            "permalink": "https://disqus.com/api/users/avatars/predictit-a9023bff2fb9d6f8ade5169e899a763b.jpg",
            "xlarge": {
                "permalink": "https://disqus.com/api/users/avatars/predictit-a9023bff2fb9d6f8ade5169e899a763b.jpg",
                "cache": "https://c.disquscdn.com/uploads/users/36256/7298/avatar200.jpg?1769477231"
            },
            "cache": "https://c.disquscdn.com/uploads/users/36256/7298/avatar92.jpg?1769477231",
            "large": {
                "permalink": "https://disqus.com/api/users/avatars/predictit-a9023bff2fb9d6f8ade5169e899a763b.jpg",
                "cache": "https://c.disquscdn.com/uploads/users/36256/7298/avatar92.jpg?1769477231"
            },
            "small": {
                "permalink": "https://disqus.com/api/users/avatars/predictit-a9023bff2fb9d6f8ade5169e899a763b.jpg",
                "cache": "https://c.disquscdn.com/uploads/users/36256/7298/avatar32.jpg?1769477231"
            },
            "isCustom": true
        }
    },
    "media": [],
    "isSpam": false,
    "isDeletedByAuthor": false,
    "isHighlighted": false,
    "hasMore": false,
    "parent": 6824235631,
    "isApproved": true,
    "isNewUserNeedsApproval": false,
    "isDeleted": false,
    "isFlagged": false,
    "raw_message": "<i>Clinton and Obama didn&#x27;t have ICE agents and the national guard weaponized against state government&#x27;s wishes. </i>\n\nNice try... state governments have no say in immigration. They can wish as much as they want but this was all litigated back when Obama was president and Arizona tried to enforce its border with Mexico. The federal judiciary ruled that immigration enforcement is under federal authority. So Governor Walz better keep out of the way while President Trump has ICE do the work the American people re-elected him to do.\n\nAnd Elon Musk is a guest in this country who better behave if he wants to stay. Ilhan Omar is the anti-American.",
    "isAtFlagLimit": false,
    "canVote": false,
    "forum": "predictit",
    "depth": 7,
    "points": 0,
    "moderationLabels": [],
    "isEdited": false,
    "sb": false
}

💡 Use Cases

📊 Sentiment Analysis & Market Psychology

Analyze trader sentiment by examining comment patterns, discussion topics, and community reactions. Identify bullish/bearish sentiment before price movements.

📈 Trading Edge & Market Intelligence

Understand what experienced traders are discussing. Track how comment activity correlates with market movements and identify potential trading signals.

🏫 Academic & Social Research

Study prediction market communities, group dynamics, and information aggregation. Perfect for political science, economics, and behavioral research.

📰 Data Journalism & Political Coverage

Track discussions around elections, policy changes, and political events. Create engaging content showing how PredictIt communities react to breaking news.

Integration & API Access

Using Apify API

const ApifyClient = require('apify-client');

const client = new ApifyClient({
    token: 'YOUR_APIFY_TOKEN',
});

const input = {
    marketIdsOrUrls: ["8153"],
    limit: 100
};

const run = await client.actor("YOUR_ACTOR_ID").call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();

console.log(items);

Scheduling

Schedule regular scraping runs to track comment activity:

• Hourly: Monitor active market discussions in real-time
• Daily: Track daily comment trends and sentiment shifts
• Weekly: Comprehensive community analysis

📊 Export Options

• JSON: Best for API integrations and programmatic access
• CSV: Perfect for Excel analysis and data processing
• Excel: Formatted spreadsheet with proper columns
• HTML: Human-readable table for quick review

FAQ

Can I scrape multiple markets at once?

Yes! Simply add multiple IDs or URLs to the marketIdsOrUrls array.

Is there a limit to how many comments I can scrape?

No hard limit. Use the limit parameter to control comments per market, or set to 0 for unlimited.