Cointelegraph Search Scraper 🔍

Powerful scraper for extracting article data from Cointelegraph's search results. Get detailed information about crypto news articles matching your keywords.

Features ✨

• 🎯 Search for multiple keywords
• 📊 Extract comprehensive article metadata
• ⏱️ Automatic scrolling with smart detection
• 🚀 High-performance and reliable
• 🛡️ Built-in anti-blocking measures

Output Data Structure 📋

For each article, you'll get:

• Article title and slug
• Author information
• Publication date and time
• View count
• Category and badges
• Lead text/description
• Article URL
• Scraping timestamp

Usage 💡

1. Enter your search keywords
2. Set maximum items to scrape (optional)
3. Run the actor and get structured JSON results

Input Parameters 📝

• keywords: Array of keywords to search for
• maxItems: Maximum number of items to scrape (default: unlimited)

Use Cases 🎯

• Crypto news monitoring
• Market research and analysis
• Content aggregation
• Competitive analysis
• Trading signals generation

Limitations ⚠️

• Respects Cointelegraph's robots.txt
• Rate limiting implemented for stability
• Maximum 1000 results per search term recommended

Need custom features or modifications? Contact us for support! 🤝

Input Example

A full explanation of an input example in JSON.

1{
2    "keywords": [
3        "fashion"
4    ],
5    "maxItems": 20
6}

Output sample

The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

1[
2    {
3        "keyword": "trump",
4        "post": {
5            "id": "171373",
6            "slug": "ramaswamy-leaves-doge-ohio-governor-bid-leaving-musk-sole-leader",
7            "views": 497,
8            "postTranslate": {
9                "id": "1027264",
10                "title": "Ramaswamy exits DOGE for Ohio governor bid, leaving Musk as sole head",
11                "leadText": "Vivek Ramaswamy said on X he was leaving the Department of Government Efficiency and was “confident that Elon and the team will succeed in streamlining government.”",
12                "avatar": "https://s3.cointelegraph.com/uploads/2025-01/0194866e-1a22-73f9-b4d2-4e0f69274bb2",
13                "published": "2025-01-21T03:50:25+00:00",
14                "publishedHumanFormat": "40 minutes ago",
15                "author": {
16                    "id": "1056",
17                    "slug": "martin-young",
18                    "authorTranslates": [
19                        {
20                            "id": "17082",
21                            "name": "Martin Young",
22                            "__typename": "AuthorTranslate"
23                        }
24                    ],
25                    "__typename": "Author"
26                },
27                "__typename": "PostTranslate"
28            },
29            "category": {
30                "id": "2",
31                "slug": "latest-news",
32                "categoryTranslates": [
33                    {
34                        "id": "67",
35                        "title": "Latest News",
36                        "__typename": "CategoryTranslate"
37                    }
38                ],
39                "__typename": "Category"
40            },
41            "author": {
42                "id": "1056",
43                "slug": "martin-young",
44                "authorTranslates": [
45                    {
46                        "id": "17082",
47                        "name": "Martin Young",
48                        "__typename": "AuthorTranslate"
49                    }
50                ],
51                "__typename": "Author"
52            },
53            "postBadge": {
54                "id": "38",
55                "label": "default",
56                "postBadgeTranslates": [
57                    {
58                        "id": "815",
59                        "title": "News",
60                        "__typename": "PostBadgeTranslate"
61                    }
62                ],
63                "__typename": "PostBadge"
64            },
65            "showShares": true,
66            "showStats": true,
67            "__typename": "Post",
68            "postUrl": "https://cointelegraph.com/news/ramaswamy-leaves-doge-ohio-governor-bid-leaving-musk-sole-leader"
69        },
70        "scrapedAt": "2025-01-21T04:31:10.324Z"
71    },
72    ...
73]