Coindesk News Scraper

🚀 CoinDesk News Scraper

Easily extract the latest news articles from CoinDesk. The CoinDesk News Scraper gathers structured article data including titles, authors, tags, sentiment, and more — perfect for crypto market research and news monitoring.

✨ Features

• 📰 Comprehensive Article Data: Retrieve titles, descriptions, authors, publication dates, sections, tags, story types, sentiment, and featured images.
• 📄 Automatic Pagination: Automatically clicks "More stories" to collect as many articles as you need.
• ⚡ Fast & Configurable: Set a maximum number of articles to scrape and get structured results instantly.

📥 Input

Field	Type	Description	Default
startUrls	array	List of CoinDesk pages to scrape articles from.	[{ "url": "https://www.coindesk.com/latest-crypto-news" }]
maxArticles	integer	Maximum number of articles to scrape per URL.	50

🛠️ How It Works

1. Set Start URLs – Provide one or more CoinDesk pages to scrape (defaults to the latest news page).
2. Set Max Articles – Configure how many articles you want to collect per URL (default: 50).
3. Run the Scraper – The Actor navigates each page, extracts article data from the initial load, and paginates for more.

📊 Sample Output Data

The scraper provides structured JSON output with key article details. Example:

[
    {
        "url": "https://www.coindesk.com/markets/2025/01/15/bitcoin-surges-past-100k",
        "title": "Bitcoin Surges Past $100K as Institutional Demand Grows",
        "description": "Bitcoin reached a new all-time high as major institutions increased their holdings.",
        "authors": ["John Doe"],
        "publishedAt": "2025-01-15T14:30:00Z",
        "updatedAt": "2025-01-15T15:00:00Z",
        "section": "Markets",
        "tags": ["Bitcoin", "Institutional Investment", "Price Analysis"],
        "storyType": "news",
        "sentiment": "positive",
        "imageUrl": "https://www.coindesk.com/resizer/example-image.jpg"
    },
    {
        "url": "https://www.coindesk.com/policy/2025/01/15/sec-approves-new-crypto-etf",
        "title": "SEC Approves New Crypto ETF Amid Regulatory Shift",
        "description": "The SEC has greenlit another cryptocurrency ETF, signaling a changing regulatory landscape.",
        "authors": ["Jane Smith"],
        "publishedAt": "2025-01-15T12:00:00Z",
        "updatedAt": "2025-01-15T12:30:00Z",
        "section": "Policy",
        "tags": ["SEC", "ETF", "Regulation"],
        "storyType": "news",
        "sentiment": "neutral",
        "imageUrl": "https://www.coindesk.com/resizer/example-image-2.jpg"
    }
]

Stay on top of crypto news with CoinDesk News Scraper today! 🚀