# Crunchbase News Scraper (`crawlerbros/crunchbase-news-scraper`) Actor Extract startup, funding, M\&A, and tech news articles from news.crunchbase.com like title, content, author, date, categories, tags, featured image. Uses the public WordPress REST API. No proxy required. - **URL**: https://apify.com/crawlerbros/crunchbase-news-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Developer tools, News, SEO tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 7 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $1.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Crunchbase News Scraper Extract startup, funding, M&A, and tech news articles from **news.crunchbase.com** — Crunchbase's editorial news site with **8,500+ articles** covering venture capital, AI, startups, IPOs, and more. Returns full content, author, date, categories, tags, and featured image. ### Features - **16 output fields** per article — flat schema with typed defaults (zero nulls) - **8,500+ articles indexed** — going back years - **Filter by keyword, category, or date** - **Public WordPress REST API** — no authentication, no proxy, no cookies - **Pagination** — walks pages until `maxItems` reached (100 per page) - **Pre-resolved category and tag names** (not just IDs) ### Note on Crunchbase Data The main `crunchbase.com` site (organization profiles, funding rounds, search) is gated behind login + Cloudflare and cannot be scraped without authenticated session cookies. This scraper instead targets `news.crunchbase.com`, which runs WordPress and exposes its content via the public REST API. The news site covers most of the same topics (funding rounds, M&A, IPOs, market analysis) as the gated database, just in editorial article form. ### Input | Field | Type | Description | |---|---|---| | `search` | String | Free-text keyword (searches title + content) | | `category` | String | Category slug to filter by (e.g., `venture`, `startups`, `ai`, `crypto`, `cybersecurity`, `ipo`, `ma`, `web3`, `saas`). Friendly aliases like `artificial-intelligence` → `ai` and `fintech` → `fintech-ecommerce` are also accepted. | | `after` | String | Only articles published after this date (`YYYY-MM-DD` or ISO 8601) | | `maxItems` | Integer | Maximum articles to return (default 50, max 1000) | #### Example Input ```json { "search": "Series A", "category": "artificial-intelligence", "after": "2026-01-01", "maxItems": 100 } ```` ### Output Each article has **16 fields**. All fields are always present — empty strings, zero, or empty array as typed defaults, never `null`. #### Identity | Field | Type | Description | |---|---|---| | `id` | Integer | Article ID | | `url` | String | Full article URL | | `slug` | String | URL slug | | `title` | String | Article title (HTML stripped) | #### Content | Field | Type | Description | |---|---|---| | `excerpt` | String | Short summary (HTML stripped, ~500 chars) | | `content` | String | Full article content (HTML stripped, truncated to 5,000 chars) | #### Dates | Field | Type | Description | |---|---|---| | `publishedDate` | String | Publication date (ISO 8601) | | `modifiedDate` | String | Last modified date (ISO 8601) | #### Author & Taxonomy | Field | Type | Description | |---|---|---| | `authorId` | Integer | Primary author ID | | `authorName` | String | Primary author name | | `categoryNames` | Array | Category names (e.g., `["AI", "Business"]`) | | `categoryIds` | Array | Category IDs | | `tagNames` | Array | Tag names | #### Media | Field | Type | Description | |---|---|---| | `featuredImageUrl` | String | Featured image URL | | `featuredImageId` | Integer | Featured image ID | #### Metadata | Field | Type | Description | |---|---|---| | `scrapedAt` | String | ISO 8601 scrape timestamp | ### FAQ **Q: Do I need a proxy?** No. news.crunchbase.com runs WordPress and exposes its REST API publicly at `/wp-json/wp/v2/posts`. Works directly from datacenter IPs. **Q: How many articles per page?** 100 (the WordPress API maximum). The scraper paginates automatically. **Q: How do I find category slugs?** Browse to news.crunchbase.com, click any category, and the URL is `/category/{slug}/`. Verified working slugs (by article volume): `venture`, `startups`, `business`, `ai`, `public`, `fintech-ecommerce`, `health-wellness-biotech`, `cybersecurity`, `transportation`, `clean-tech-and-energy`, `crypto`, `ma`, `data`, `liquidity`, `ipo`, `media-entertainment`, `seed`, `enterprise`, `agtech-foodtech`, `web3`, `real-estate-property-tech`, `semiconductors-and-5g`, `robotics`, `retail`, `saas`. Friendly aliases (`artificial-intelligence`, `fintech`, `health`, `m&a`, etc.) are auto-mapped to the canonical slug. **Q: Can I get organization data (logos, funding rounds, etc.)?** Not from this scraper. The main crunchbase.com database is gated. This actor scrapes the news site only. Use it when you need editorial commentary, market analysis, and funding-round summaries. **Q: How fresh is the data?** news.crunchbase.com publishes new articles daily. The WordPress API serves the live database — new articles appear within minutes of publication. ### Use Cases - **Funding round monitoring** — track new VC deals via news coverage - **Market analysis** — extract content from sector reports (AI, fintech, climate) - **Competitive intelligence** — search for mentions of competitors / partners - **Content syndication** — feed Crunchbase News into your own newsroom - **Trend tracking** — aggregate by tag/category to identify rising topics # Actor input Schema ## `search` (type: `string`): Free-text keyword to search article titles + content (e.g., 'AI', 'Series A', 'IPO'). ## `category` (type: `string`): Category slug to filter by. Common: 'venture', 'startups', 'ai' (or 'artificial-intelligence'), 'crypto', 'fintech', 'cybersecurity', 'health', 'ipo', 'ma', 'web3', 'saas'. Leave empty for all. ## `after` (type: `string`): Only articles published after this date (YYYY-MM-DD or full ISO 8601). Leave empty for all. ## `maxItems` (type: `integer`): Maximum number of articles to return. ## Actor input object example ```json { "maxItems": 5 } ``` # Actor output Schema ## `articles` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "maxItems": 5 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/crunchbase-news-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "maxItems": 5 } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/crunchbase-news-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "maxItems": 5 }' | apify call crawlerbros/crunchbase-news-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/crunchbase-news-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Crunchbase News Scraper", "description": "Extract startup, funding, M&A, and tech news articles from news.crunchbase.com like title, content, author, date, categories, tags, featured image. Uses the public WordPress REST API. No proxy required.", "version": "1.0", "x-build-id": "tj35kyz3pPYYHd4AR" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~crunchbase-news-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-crunchbase-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~crunchbase-news-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-crunchbase-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~crunchbase-news-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-crunchbase-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "search": { "title": "Search Query", "type": "string", "description": "Free-text keyword to search article titles + content (e.g., 'AI', 'Series A', 'IPO')." }, "category": { "title": "Category Slug (optional)", "type": "string", "description": "Category slug to filter by. Common: 'venture', 'startups', 'ai' (or 'artificial-intelligence'), 'crypto', 'fintech', 'cybersecurity', 'health', 'ipo', 'ma', 'web3', 'saas'. Leave empty for all." }, "after": { "title": "Published After (ISO date)", "type": "string", "description": "Only articles published after this date (YYYY-MM-DD or full ISO 8601). Leave empty for all." }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of articles to return.", "default": 50 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```