Techcrunch Scraper

Scrape articles from TechCrunch, the leading technology news publication. Search by keyword or browse latest posts. Get titles, authors, categories, excerpts, and publication dates.

What does TechCrunch Scraper do?

TechCrunch Scraper uses the WordPress REST API to extract articles from TechCrunch. It fetches article metadata including titles, author names, category tags, excerpts, publication dates, and featured images. Search for specific topics or get the latest articles.

Who is it for?

• 💼 Venture capitalists — tracking startup funding announcements and industry trends
• 📊 Market researchers — analyzing technology industry news and company launches
• 📰 Journalists — monitoring tech news for story leads and competitive coverage
• 🏢 Startup founders — staying current with competitor news and funding rounds
• 📈 Business analysts — building datasets of tech industry events and announcements

Why scrape TechCrunch?

TechCrunch is one of the most influential technology media outlets, covering startups, venture capital, and emerging tech. It's a primary source for tech industry news and analysis.

Key reasons to scrape it:

• Market intelligence — Track startup funding announcements and trends
• Competitive monitoring — Follow coverage of specific companies or sectors
• Content research — Find trending topics in the tech industry
• Media analysis — Study coverage patterns and journalist focus areas
• Investment research — Monitor funding rounds and startup valuations

Use cases

• Venture capitalists tracking funding announcements and startup coverage
• PR professionals monitoring tech media for client mentions
• Startup founders keeping up with industry trends and competitor news
• Content marketers finding trending tech topics for content strategy
• Researchers analyzing tech media coverage patterns
• Newsletter creators sourcing tech news for curated digests

How to scrape TechCrunch

1. Go to TechCrunch Scraper on Apify Store
2. Enter a search keyword (or leave empty for latest articles)
3. Set result limits
4. Click Start and wait for results
5. Download data as JSON, CSV, or Excel

Input parameters

Parameter	Type	Default	Description
searchQuery	string	""	Search keyword. Leave empty for latest articles
maxArticles	integer	50	Maximum articles to return
maxPages	integer	5	Max pages (20 articles per page)

Input example

{
    "searchQuery": "AI startups",
    "maxArticles": 20,
    "maxPages": 1
}

Output

Each article in the dataset contains:

Field	Type	Description
id	number	WordPress post ID
title	string	Article headline
url	string	Full article URL
excerpt	string	Article summary
author	string	Author name
categories	string[]	Article categories (e.g. AI, Startups)
publishedAt	string	Publication date and time
modifiedAt	string	Last modified date and time
featuredImage	string	Featured image URL
scrapedAt	string	ISO timestamp of extraction

Output example

{
    "id": 3098742,
    "title": "Cursor has reportedly surpassed $2B in annualized revenue",
    "url": "https://techcrunch.com/2026/03/02/cursor-has-reportedly-surpassed-2b-in-annualized-revenue/",
    "excerpt": "The four-year-old startup saw its revenue run rate double over the past three months.",
    "author": "Marina Temkin",
    "categories": ["Startups", "AI"],
    "publishedAt": "2026-03-02T17:53:59",
    "modifiedAt": "2026-03-02T17:54:05",
    "featuredImage": "https://techcrunch.com/wp-content/uploads/2025/07/opengraph-image.png",
    "scrapedAt": "2026-03-03T03:40:50.532Z"
}

How much does it cost to scrape TechCrunch?

TechCrunch Scraper uses pay-per-event pricing:

Event	Price
Run started	$0.001
Article extracted	$0.002 per article

Cost examples

Scenario	Articles	Cost
Quick check	20	$0.041
Weekly digest	100	$0.201
Monthly archive	500	$1.001

Platform costs are negligible — typically under $0.005 per run.

Using the Apify API

Node.js

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });

const run = await client.actor('automation-lab/techcrunch-scraper').call({
    searchQuery: 'AI startups',
    maxArticles: 20,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Found ${items.length} articles`);
items.forEach(article => {
    console.log(`[${article.categories.join(', ')}] ${article.title} by ${article.author}`);
});

Python

from apify_client import ApifyClient

client = ApifyClient('YOUR_API_TOKEN')

run = client.actor('automation-lab/techcrunch-scraper').call(run_input={
    'searchQuery': 'AI startups',
    'maxArticles': 20,
})

dataset = client.dataset(run['defaultDatasetId']).list_items().items
print(f'Found {len(dataset)} articles')
for article in dataset:
    cats = ', '.join(article['categories'])
    print(f"[{cats}] {article['title']} by {article['author']}")

Integrations

TechCrunch Scraper works with all Apify integrations:

• Scheduled runs — Build a daily digest of tech news
• Webhooks — Get notified when new articles match your keywords
• API — Trigger runs and fetch results programmatically
• Google Sheets — Export articles to a spreadsheet for analysis
• Slack — Share relevant articles with your team

Connect to Zapier, Make, or Google Sheets for automated workflows.

Tips

• Leave searchQuery empty to get the most recent articles across all categories
• Search for company names to track specific startup coverage
• Filter by categories in the output to focus on Startups, AI, Venture, etc.
• Monitor author names to follow specific journalists' coverage
• Schedule daily runs to build a comprehensive news monitoring system
• Use excerpts for quick scanning before clicking through to full articles

Legality

Scraping publicly available data is generally legal according to the US Court of Appeals ruling (HiQ Labs v. LinkedIn). This actor only accesses publicly available information and does not require authentication. Always review and comply with the target website's Terms of Service before scraping. For personal data, ensure compliance with GDPR, CCPA, and other applicable privacy regulations.

FAQ

Does it include full article text? The scraper extracts excerpts (summaries), not full article body text. This keeps costs low and avoids content licensing concerns.

How far back can I search? The WordPress API allows paginating through TechCrunch's entire article archive — thousands of articles going back years.

Can I filter by category? Search by keyword covers topics effectively. Categories are included in the output for post-scrape filtering.

How often should I run it? TechCrunch publishes 20-50 articles per day. A daily run with maxArticles: 50 captures a full day's coverage.

Is the API rate-limited? TechCrunch's WordPress API handles moderate request volumes. The scraper uses pagination responsibly with built-in delays.

Use with Claude AI (MCP)

This actor is available as a tool in Claude AI through the Model Context Protocol (MCP). Add it to Claude Desktop, Cursor, Windsurf, or any MCP-compatible client.

Setup for Claude Code

$claude mcp add --transport http apify "https://mcp.apify.com"

Setup for Claude Desktop, Cursor, or VS Code

Add this to your MCP config file:

{
    "mcpServers": {
        "apify": {
            "url": "https://mcp.apify.com"
        }
    }
}

Example prompts

• "Get the latest TechCrunch articles about AI startups and summarize the key trends"
• "Find all TechCrunch articles mentioning our competitor Acme Corp from the past month"
• "Pull today's TechCrunch headlines and group them by category"

Learn more in the Apify MCP documentation.

cURL

curl "https://api.apify.com/v2/acts/automation-lab~techcrunch-scraper/run-sync-get-dataset-items?token=YOUR_API_TOKEN" \
  -X POST -H "Content-Type: application/json" \
  -d '{"searchQuery": "AI startups", "maxArticles": 20}'

The scraper returns articles with HTML entities in the excerpt. TechCrunch's WordPress API sometimes includes HTML entities (like ’ for apostrophes) in excerpts. Strip HTML tags in post-processing if you need plain text.

My search returns old articles instead of recent ones. The WordPress search API returns results by relevance, not date. To get the latest articles, leave searchQuery empty and use maxArticles to control volume.

Other news scrapers

• Dev.to Scraper — scrape developer articles and discussions from Dev.to
• Hacker News Scraper — scrape stories, comments, and discussions from Hacker News
• Lobsters Scraper — scrape tech stories and comments from Lobste.rs
• Substack Scraper — scrape newsletter posts and articles from Substack
• Wikipedia Scraper — scrape Wikipedia articles and structured data