Coingecko News Scraper

CoinGecko News Scraper

Extract crypto news articles from CoinGecko — the world's largest independent cryptocurrency data aggregator. The CoinGecko News Scraper pulls structured article data directly from CoinGecko's public news API, giving you clean JSON output with no browser automation required.

✨ Features

• 📰 Full news feed coverage: Scrape titles, descriptions, source URLs, authors, publishers, thumbnails, and timestamps
• 📄 Deep pagination: Access the full historical archive — hundreds of pages, thousands of articles
• 🔁 Date filtering: Stop scraping once you reach articles older than a given date — perfect for incremental runs
• ⚡ Fast & lightweight: Pure HTTP API — no browser, no proxies, no JavaScript rendering needed
• 🛡️ Rate-limit safe: Built-in 429 handling with automatic retry using the Retry-After header

🛠️ How It Works

1. Configure inputs – Set how many articles you want and optionally a date cutoff
2. Run the scraper – The Actor calls the CoinGecko public news API page by page
3. Get structured data – Each article is normalized and saved to the dataset

📥 Input

Field	Type	Default	Description
maxItems	integer	40	Maximum number of articles to scrape. Set to 0 for no limit.
sinceDate	string	""	ISO 8601 date (e.g. 2025-01-01). Stop scraping when articles are older than this date. Leave empty to scrape all available articles.

Example input

{
    "maxItems": 100,
    "sinceDate": "2025-01-01"
}

API key: Set the COINGECKO_API_KEY environment variable to your free CoinGecko Demo API key. This raises the rate limit from ~5 to 30 req/min and is strongly recommended for large runs.

📊 Sample Output Data

The scraper provides structured JSON output for each article. Example:

[
    {
        "id": 106866045,
        "title": "Only 25 + 40 Days to Get a MiCA License? Let's Decode the Actual Timeline",
        "description": "MiCA Decoded is a 12-article weekly series breaking down the EU's crypto regulation framework.",
        "url": "https://news.bitcoin.com/only-25-40-days-to-get-a-mica-license/",
        "newsSite": "Bitcoin.com",
        "author": "Guest Author",
        "locale": "en",
        "thumbnailUrl": "https://assets.coingecko.com/articles/images/106866045/large/thumb.jpg",
        "publishedAt": "2026-04-12T06:30:26.000Z",
        "crawledAt": "2026-04-12T06:30:26.000Z",
        "scrapedAt": "2026-04-12T10:00:00.000Z"
    }
]

You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

📋 Data Fields

Field	Type	Description
id	number	Unique CoinGecko article ID (monotonically increasing)
title	string	Article headline
description	string	1–2 sentence summary
url	string	Link to the original article on the publisher's site
newsSite	string	Publisher name (e.g. Cointelegraph, CoinDesk, BeInCrypto)
author	string | null	Byline (may be null or "Guest Author")
locale	string	Language code (currently always "en")
thumbnailUrl	string | null	Thumbnail image hosted on CoinGecko's CDN
publishedAt	string	ISO 8601 publication timestamp
crawledAt	string	ISO 8601 timestamp when CoinGecko indexed the article
scrapedAt	string	ISO 8601 timestamp when this Actor scraped the article

💡 Tips

• Incremental runs: Use sinceDate to only fetch articles newer than your last run — set it to yesterday's date to get a daily update
• Full archive: Set maxItems: 0 and omit sinceDate to paginate through the entire archive (1,000+ articles)
• Speed: With a free CoinGecko Demo API key set as COINGECKO_API_KEY, the scraper safely runs at ~30 pages/min (600 articles/min)
• News sources: CoinGecko aggregates 50+ publishers including Cointelegraph, CoinDesk, BeInCrypto, The Block, Decrypt, Forbes Digital Assets, NewsBTC, and more

❓ FAQ & Support

Is scraping CoinGecko legal? This Actor uses CoinGecko's public API — the same endpoint used by their own website. It respects rate limits and does not scrape personal data.

Why are some author fields null or "Guest Author"? This reflects the data CoinGecko provides — some publishers don't expose a byline in their feed.

The scraper stopped early — what happened? Most likely a rate limit (429). Providing a free COINGECKO_API_KEY environment variable resolves this for the vast majority of runs.

Found a bug or need a custom feature? Open an issue on the ../../issues.