Cointelegraph Search Scraper 🔍

Powerful scraper for extracting article data from Cointelegraph's search results. Get detailed information about crypto news articles matching your keywords.

Features ✨

• 🎯 Search for multiple keywords
• 📊 Extract comprehensive article metadata
• ⏱️ Automatic scrolling with smart detection
• 🚀 High-performance and reliable
• 🛡️ Built-in anti-blocking measures

Output Data Structure 📋

For each article, you'll get:

• Article title and slug
• Author information
• Publication date and time
• View count
• Category and badges
• Lead text/description
• Article URL
• Scraping timestamp

Usage 💡

1. Enter your search keywords
2. Set maximum items to scrape (optional)
3. Run the actor and get structured JSON results

Input Parameters 📝

• keywords: Array of keywords to search for
• maxItems: Maximum number of items to scrape (default: unlimited)

Use Cases 🎯

• Crypto news monitoring
• Market research and analysis
• Content aggregation
• Competitive analysis
• Trading signals generation

Limitations ⚠️

• Respects Cointelegraph's robots.txt
• Rate limiting implemented for stability
• Maximum 1000 results per search term recommended

Need custom features or modifications? Contact us for support! 🤝

Input Example

A full explanation of an input example in JSON.

{
    "keywords": [
        "fashion"
    ],
    "maxItems": 20
}

Output sample

The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

[
    {
        "keyword": "trump",
        "post": {
            "id": "171373",
            "slug": "ramaswamy-leaves-doge-ohio-governor-bid-leaving-musk-sole-leader",
            "views": 497,
            "postTranslate": {
                "id": "1027264",
                "title": "Ramaswamy exits DOGE for Ohio governor bid, leaving Musk as sole head",
                "leadText": "Vivek Ramaswamy said on X he was leaving the Department of Government Efficiency and was “confident that Elon and the team will succeed in streamlining government.”",
                "avatar": "https://s3.cointelegraph.com/uploads/2025-01/0194866e-1a22-73f9-b4d2-4e0f69274bb2",
                "published": "2025-01-21T03:50:25+00:00",
                "publishedHumanFormat": "40 minutes ago",
                "author": {
                    "id": "1056",
                    "slug": "martin-young",
                    "authorTranslates": [
                        {
                            "id": "17082",
                            "name": "Martin Young",
                            "__typename": "AuthorTranslate"
                        }
                    ],
                    "__typename": "Author"
                },
                "__typename": "PostTranslate"
            },
            "category": {
                "id": "2",
                "slug": "latest-news",
                "categoryTranslates": [
                    {
                        "id": "67",
                        "title": "Latest News",
                        "__typename": "CategoryTranslate"
                    }
                ],
                "__typename": "Category"
            },
            "author": {
                "id": "1056",
                "slug": "martin-young",
                "authorTranslates": [
                    {
                        "id": "17082",
                        "name": "Martin Young",
                        "__typename": "AuthorTranslate"
                    }
                ],
                "__typename": "Author"
            },
            "postBadge": {
                "id": "38",
                "label": "default",
                "postBadgeTranslates": [
                    {
                        "id": "815",
                        "title": "News",
                        "__typename": "PostBadgeTranslate"
                    }
                ],
                "__typename": "PostBadge"
            },
            "showShares": true,
            "showStats": true,
            "__typename": "Post",
            "postUrl": "https://cointelegraph.com/news/ramaswamy-leaves-doge-ohio-governor-bid-leaving-musk-sole-leader"
        },
        "scrapedAt": "2025-01-21T04:31:10.324Z"
    },
    ...
]