# Blockworks Scraper (`tonyaka_educational_watermill/blockworks-scraper`) Actor Scrape news articles, podcast episodes, and newsletters from Blockworks.co — the leading institutional crypto & digital assets media platform. - **URL**: https://apify.com/tonyaka\_educational\_watermill/blockworks-scraper.md - **Developed by:** [Tony](https://apify.com/tonyaka_educational_watermill) (community) - **Categories:** News, Automation, Integrations - **Stats:** 2 total users, 0 monthly users, 0.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $1.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Blockworks Scraper Extract structured data from [Blockworks.co](https://blockworks.co) — the leading institutional crypto and digital assets media platform. Collect breaking news articles, podcast episodes from all 9 shows, and newsletter archives in a single automated run. ### 🔍 What does Blockworks Scraper do? Blockworks is the go-to source for institutional crypto intelligence, covering Bitcoin, Ethereum, DeFi, macro markets, and digital asset regulation. This Actor gives you programmatic access to everything Blockworks publishes: - **News articles** — titles, authors, publish dates, excerpts, full content, categories, tags, and featured images - **Podcast episodes** — all 9 shows including Empire, 0xResearch, Bell Curve, The Breakdown, Forward Guidance, Supply Shock, Lightspeed, 1000x, and Inflection Point - **Newsletters** — titles, publish dates, URLs, and excerpts from the Blockworks newsletter archive All results are saved to an Apify Dataset and can be exported as JSON, CSV, Excel, or XML. --- ### 🚀 Getting started 1. Click **Try for free** or **Start for free** above 2. Configure your input (or leave defaults to scrape everything) 3. Hit **Start** — results appear in the **Output** tab as they're collected 4. Export your data in any format from the **Storage** tab No coding required. --- ### 📥 Input parameters | Field | Type | Default | Description | |-------|------|---------|-------------| | `contentTypes` | Array | `["news", "podcasts", "newsletters"]` | Which content types to scrape. Select any combination. | | `maxArticles` | Integer | `100` | Maximum number of news articles to return. | | `maxEpisodesPerShow` | Integer | `50` | Maximum podcast episodes per show. | | `dateFrom` | String | *(none)* | Only return content published on or after this date. Format: `YYYY-MM-DD` | | `dateTo` | String | *(none)* | Only return content published on or before this date. Format: `YYYY-MM-DD` | | `categories` | Array | *(all)* | Filter news articles by category (e.g. `Bitcoin`, `DeFi`, `Ethereum`, `Regulation`, `Macro`). Leave empty for all categories. | | `podcastShows` | Array | *(all)* | Filter to specific podcast shows by slug. Options: `empire`, `0xresearch`, `bellcurve`, `thebreakdown`, `forwardguidance`, `supplyshock`, `lightspeed`, `1000x`, `inflectionpoint` | #### Example input ```json { "contentTypes": ["news", "podcasts"], "maxArticles": 50, "maxEpisodesPerShow": 10, "dateFrom": "2025-01-01", "categories": ["Bitcoin", "DeFi"], "podcastShows": ["empire", "0xresearch"] } ```` *** ### 📤 Output format All results are stored in a single dataset with a `contentType` field so you can easily filter downstream. #### News article ```json { "contentType": "article", "url": "https://blockworks.co/news/bitcoin-etf-record-inflows", "slug": "bitcoin-etf-record-inflows", "title": "Bitcoin ETFs See Record $1.2B Inflows as Institutional Demand Surges", "author": "Jason Yanowitz", "authorUrl": "https://blockworks.co/author/jason-yanowitz", "publishedAt": "2025-03-15T14:30:00.000Z", "modifiedAt": "2025-03-15T16:00:00.000Z", "excerpt": "Spot bitcoin ETFs recorded their largest single-day inflow since launch...", "content": "Full article text...", "categories": ["Bitcoin", "ETFs"], "tags": ["BlackRock", "Fidelity", "institutional"], "featuredImageUrl": "https://blockworks.co/wp-content/uploads/...", "source": "blockworks.co", "scrapedVia": "google-news-rss" } ``` #### Podcast episode ```json { "contentType": "podcast-episode", "showName": "Empire", "showSlug": "empire", "showUrl": "https://blockworks.co/podcast/empire", "episodeTitle": "Why Solana is Winning the Developer War", "episodeNumber": "342", "season": null, "description": "Jason and Santi sit down with Anatoly Yakovenko to discuss...", "publishedAt": "2025-03-10T08:00:00.000Z", "duration": "01:12:45", "audioUrl": "https://feeds.simplecast.com/...", "audioType": "audio/mpeg", "episodeUrl": "https://blockworks.co/podcast/empire/...", "imageUrl": "https://...", "explicit": "no", "source": "blockworks.co", "scrapedVia": "rss" } ``` #### Newsletter ```json { "contentType": "newsletter", "title": "The Daily: Fed Signals Pause, BTC Holds $70K", "publishedAt": "2025-03-14T09:00:00.000Z", "url": "https://blockworks.co/newsletter/...", "excerpt": "Good morning. Here's what you need to know today...", "source": "blockworks.co", "scrapedVia": "html" } ``` *** ### 🎯 Use cases **Crypto research & analysis** Monitor Blockworks for breaking news, track narrative shifts across articles and podcasts, and build a real-time feed of institutional crypto sentiment. **Competitive intelligence** Track what topics Blockworks covers most, which guests appear on podcasts, and how coverage of specific assets evolves over time. **Content aggregation** Build crypto news dashboards, Slack/Discord bots, or newsletter digests powered by Blockworks content. **AI & machine learning** Create training datasets for crypto-specific LLMs, sentiment analysis models, or topic classification systems using real institutional media content. **Academic research** Study media framing of digital assets, track how crypto narratives develop, or analyze the relationship between Blockworks coverage and market movements. **Due diligence** Quickly aggregate all Blockworks coverage of a specific project, protocol, or company for investment research. *** ### 🎙️ Podcast shows covered | Show | Slug | Description | |------|------|-------------| | Empire | `empire` | Interviews with top crypto founders — the real stories behind the headlines | | 0xResearch | `0xresearch` | Deep dives into protocol research, DeFi, and onchain analytics | | Bell Curve | `bellcurve` | Macro and market structure debates from leading traders and analysts | | The Breakdown | `thebreakdown` | Daily macro and crypto market analysis | | Forward Guidance | `forwardguidance` | Institutional macro perspective on digital assets | | Supply Shock | `supplyshock` | Bitcoin-focused show covering adoption, mining, and macro | | Lightspeed | `lightspeed` | Solana ecosystem news and analysis | | 1000x | `1000x` | Crypto markets and trading with professional traders | | Inflection Point | `inflectionpoint` | Big-picture conversations about the future of finance | *** ### ⚙️ Technical notes **Scraping strategy** The Actor uses a multi-strategy approach for maximum reliability: 1. **Google News RSS** (primary for news) — fast, always accessible, no proxy needed 2. **Direct RSS feeds** — used for podcast episodes via hosting platform feeds 3. **Playwright browser** — JavaScript-rendered page fallback **Proxy** News articles are collected via Google News RSS and require no proxy. Podcast episode discovery and newsletter scraping use Playwright and may benefit from Apify's residential proxies for best results. The Actor is pre-configured to use Apify Proxy automatically. **Rate limits** This Actor is designed to be respectful of rate limits and adds delays between requests. For large scrapes (10,000+ articles), consider scheduling runs over multiple days. *** ### 💡 Tips - **Date filtering** is the most powerful input for targeted research. Combine `dateFrom` and `dateTo` to pull a specific time window. - **Category filtering** on news (e.g. `"categories": ["DeFi"]`) narrows results significantly and speeds up runs. - **Podcast-only runs** are fast and cheap — set `"contentTypes": ["podcasts"]` and you'll get episode metadata for all 9 shows in seconds. - Use **Apify Schedules** to run this Actor daily and keep a continuously updated dataset of Blockworks content. *** ### 🔄 Integrations Connect this Actor's output directly to: - **Google Sheets** via the Apify Google Sheets integration - **Zapier / Make** for workflow automation - **Slack / Discord** for real-time news alerts - **Airtable** for research databases - **Any REST API** via the Apify HTTP integration *** ### 📊 Pricing This Actor uses **pay-per-result** pricing: - **$0.50** per Actor start - **$0.001** per result (article, episode, or newsletter) A typical run scraping 100 articles + 450 podcast episodes = ~$1.05 in Actor fees, plus standard Apify platform compute costs. *** ### 🐛 Issues & feedback Found a bug or have a feature request? Use the **Issues** tab above to report it. Response time is typically within 48 hours. Common issues: - **0 results for newsletters** — Blockworks' newsletter archive URL structure changes periodically. Try running with `"contentTypes": ["news", "podcasts"]` in the meantime. - **Missing podcast episodes** — Some shows may have updated their RSS feed URL. Open an issue and it'll be patched within 48 hours. *** *This Actor is not affiliated with or endorsed by Blockworks Group Inc. It is an independent tool for accessing publicly available content.* # Actor input Schema ## `contentTypes` (type: `array`): Which types of content to scrape. Select one or more. ## `maxArticles` (type: `integer`): Maximum number of news articles to scrape. Applies when 'news' is selected. ## `maxEpisodesPerShow` (type: `integer`): Maximum number of podcast episodes to retrieve per show. Applies when 'podcasts' is selected. ## `dateFrom` (type: `string`): Only return content published on or after this date. Format: YYYY-MM-DD (e.g. 2024-01-01). Leave blank for no lower bound. ## `dateTo` (type: `string`): Only return content published on or before this date. Format: YYYY-MM-DD (e.g. 2024-12-31). Leave blank for no upper bound. ## `categories` (type: `array`): Filter news articles by category name (e.g. DeFi, Bitcoin, Regulation, Ethereum). Leave empty to include all categories. ## `podcastShows` (type: `array`): Which podcast shows to scrape, by slug (e.g. empire, bellcurve, 0xresearch, thebreakdown, forwardguidance, supplyshock, lightspeed, 1000x, inflectionpoint). Leave empty to scrape all shows. ## `proxyConfiguration` (type: `object`): Apify Proxy settings. Residential proxies are required — Blockworks is protected by Cloudflare which blocks data center IPs. Select 'Apify Proxy (residential)' for best results. ## Actor input object example ```json { "contentTypes": [ "news", "podcasts", "newsletters" ], "maxArticles": 100, "maxEpisodesPerShow": 50, "categories": [], "podcastShows": [], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "contentTypes": [ "news", "podcasts", "newsletters" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("tonyaka_educational_watermill/blockworks-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "contentTypes": [ "news", "podcasts", "newsletters", ], "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("tonyaka_educational_watermill/blockworks-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "contentTypes": [ "news", "podcasts", "newsletters" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call tonyaka_educational_watermill/blockworks-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=tonyaka_educational_watermill/blockworks-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Blockworks Scraper", "description": "Scrape news articles, podcast episodes, and newsletters from Blockworks.co — the leading institutional crypto & digital assets media platform.", "version": "1.0", "x-build-id": "y1ZnD4h1d7fhhnPxv" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/tonyaka_educational_watermill~blockworks-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-tonyaka_educational_watermill-blockworks-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/tonyaka_educational_watermill~blockworks-scraper/runs": { "post": { "operationId": "runs-sync-tonyaka_educational_watermill-blockworks-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/tonyaka_educational_watermill~blockworks-scraper/run-sync": { "post": { "operationId": "run-sync-tonyaka_educational_watermill-blockworks-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "contentTypes": { "title": "Content Types", "type": "array", "description": "Which types of content to scrape. Select one or more.", "items": { "type": "string", "enum": [ "news", "podcasts", "newsletters" ] }, "default": [ "news", "podcasts", "newsletters" ] }, "maxArticles": { "title": "Max News Articles", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum number of news articles to scrape. Applies when 'news' is selected.", "default": 100 }, "maxEpisodesPerShow": { "title": "Max Episodes Per Podcast Show", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of podcast episodes to retrieve per show. Applies when 'podcasts' is selected.", "default": 50 }, "dateFrom": { "title": "Date From (ISO 8601)", "type": "string", "description": "Only return content published on or after this date. Format: YYYY-MM-DD (e.g. 2024-01-01). Leave blank for no lower bound." }, "dateTo": { "title": "Date To (ISO 8601)", "type": "string", "description": "Only return content published on or before this date. Format: YYYY-MM-DD (e.g. 2024-12-31). Leave blank for no upper bound." }, "categories": { "title": "News Categories (optional filter)", "type": "array", "description": "Filter news articles by category name (e.g. DeFi, Bitcoin, Regulation, Ethereum). Leave empty to include all categories.", "default": [], "items": { "type": "string" } }, "podcastShows": { "title": "Podcast Shows (optional filter)", "type": "array", "description": "Which podcast shows to scrape, by slug (e.g. empire, bellcurve, 0xresearch, thebreakdown, forwardguidance, supplyshock, lightspeed, 1000x, inflectionpoint). Leave empty to scrape all shows.", "default": [], "items": { "type": "string" } }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Apify Proxy settings. Residential proxies are required — Blockworks is protected by Cloudflare which blocks data center IPs. Select 'Apify Proxy (residential)' for best results." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```