TechCrunch Articles Scraper

Search TechCrunch by keyword and pull clean, structured article records at scale — headlines, direct article URLs, excerpts, author name and profile link, category name and category-page link, featured image, publish date, and last-modified timestamp. A single term like openai surfaces 3,600+ matching articles from a ~261,000-article public archive. Built for journalists, market researchers, competitive-intelligence analysts, and content teams tracking tech news who need a ready-to-use TechCrunch dataset without copying stories out of the site one page at a time.

Why This Scraper?

• The full ~261,000-article TechCrunch archive — search the entire public catalog, not just the front page. A single keyword like openai returns 3,600+ matching articles in one run.
• Author attribution on every article — both the writer's name and their clickable TechCrunch author profile URL, so you can trace a byline or build a per-author feed.
• Category taxonomy with links — each article carries its section name (Fundraising, AI, Security…) plus the category-page URL, not just a bare label.
• Precise date-range windowing — publishedAfter and publishedBefore box results to an exact YYYY-MM-DD range for time-boxed coverage studies and event tracking.
• Newest-first or Most-Relevant ordering — sort a keyword's matches chronologically for a live feed, or by relevance to surface the strongest matches first.
• Batch keywords in one run — pass an array of terms (artificial intelligence, startup funding, cybersecurity) and each is searched independently, with the matching keyword stamped on every row.
• Featured image, excerpt, and last-modified timestamp per article — a ready-to-render card for each story, plus a modifiedAt field to catch updated posts.
• Latest-feed mode — leave keywords empty to stream TechCrunch's newest published articles in chronological order, no search term required.

Use Cases

Market & Competitive Intelligence

• Track every TechCrunch mention of a competitor, product, or funding round
• Monitor coverage of a specific sector (AI, fintech, climate) over time
• Map which topics TechCrunch covers most heavily in a given quarter
• Build a briefing feed of the latest tech-industry stories

Media Monitoring & PR

• Catch new articles that name your company, founders, or executives
• Measure share of voice against competitors across TechCrunch coverage
• Archive press clips by author, category, and publish date for reports
• Alert stakeholders when a story about your space goes live

Content & SEO Research

• Analyze which authors and categories dominate a topic
• Study headline and excerpt patterns for high-coverage keywords
• Curate topical newsletters from a keyword's newest matches
• Pull featured-image and excerpt data to power content roundups

Trend & Timeline Analysis

• Chart a story's coverage arc with a keyword plus a tight date window
• Compare article volume for competing technologies across years
• Build a dated corpus of a keyword's coverage for longitudinal study
• Feed clean article metadata into sentiment or topic-modeling pipelines

Lead & Company Research

• Surface funding and launch stories to spot emerging companies early
• Follow a single author's beat by profile URL to track their coverage
• Compile a dated list of startups featured under a given category

Getting Started

Simple Keyword Search

The minimum input — one or more keywords:

{
    "keywords": ["artificial intelligence"],
    "maxResults": 100
}

Time-Boxed Coverage

Track a story's coverage arc within an exact date window, newest first:

{
    "keywords": ["openai"],
    "publishedAfter": "2025-01-01",
    "publishedBefore": "2025-06-30",
    "sortBy": "date",
    "maxResults": 500
}

Multi-Keyword, Most Relevant

Batch several topics in one run, ordered by relevance:

{
    "keywords": ["startup funding", "cybersecurity", "electric vehicles"],
    "sortBy": "relevance",
    "maxResults": 300
}

Input Reference

What to Search

Parameter	Type	Default	Description
keywords	string[]	["artificial intelligence"]	Words or phrases to search TechCrunch for — one per line, each searched separately. Leave empty to collect the latest published articles instead.

Options

Parameter	Type	Default	Description
maxResults	integer	100	Maximum articles per keyword. Three keywords with a limit of 100 returns up to 300 articles. Set to 0 for no limit.
sortBy	select	Newest First	Order matches before collection: Newest First (chronological) or Most Relevant. Latest-feed mode is always newest first.
publishedAfter	string	—	Only collect articles published on or after this date (YYYY-MM-DD, e.g. 2025-01-01). Leave empty for no lower limit.
publishedBefore	string	—	Only collect articles published on or before this date (YYYY-MM-DD, e.g. 2025-12-31). Leave empty for no upper limit.

Output

Each record is one TechCrunch article with clean, flat fields:

{
    "id": 2891234,
    "title": "OpenAI launches new reasoning model with major benchmark gains",
    "url": "https://techcrunch.com/2025/03/18/openai-launches-new-reasoning-model/",
    "slug": "openai-launches-new-reasoning-model",
    "excerpt": "The company says the new model outperforms its predecessor on math and coding tasks while cutting latency.",
    "authorName": "Kyle Wiggers",
    "authorUrl": "https://techcrunch.com/author/kyle-wiggers/",
    "categoryName": "AI",
    "categoryUrl": "https://techcrunch.com/category/artificial-intelligence/",
    "imageUrl": "https://techcrunch.com/wp-content/uploads/2025/03/openai-model.jpg",
    "publishedDate": "2025-03-18",
    "publishedAt": "2025-03-18T14:32:05",
    "modifiedAt": "2025-03-18T16:10:41",
    "searchKeyword": "openai",
    "scrapedAt": "2026-07-03T13:45:12.284917+00:00"
}

Article Fields

Field	Type	Description
id	number	Unique TechCrunch article identifier
title	string	Article headline
url	string	Direct link to the article on TechCrunch
slug	string	URL slug for the article
excerpt	string	Short article summary, plain text
imageUrl	string | null	Featured image URL

Author & Category

Field	Type	Description
authorName	string | null	Article author's name
authorUrl	string | null	Link to the author's TechCrunch profile page
categoryName	string | null	Article category / section name (e.g. "AI", "Fundraising")
categoryUrl	string | null	Link to the category's TechCrunch page

Dates & Provenance

Field	Type	Description
publishedDate	string	Publication date, YYYY-MM-DD
publishedAt	string	Full publication timestamp (ISO 8601)
modifiedAt	string	Last-modified timestamp (ISO 8601) — catches updated posts
searchKeyword	string | null	The keyword that matched this article. null in latest-feed mode
scrapedAt	string	ISO 8601 timestamp of when the record was captured

Tips for Best Results

• Leave keywords empty for the latest feed — no search term needed; the scraper streams TechCrunch's newest published articles in chronological order, ideal for a rolling tech-news monitor.
• Combine a keyword with a tight date window — pair a term with publishedAfter and publishedBefore to isolate a single story's coverage arc instead of pulling the whole archive.
• Widen date boundaries by a day for exact cutoffs — publishedAfter/publishedBefore filter on TechCrunch's own publication timezone, so articles right at the edge of your range can shift by a few hours; add a day of buffer if you need airtight precision.
• maxResults is per keyword — three keywords at a limit of 100 returns up to 300 rows. Budget your run accordingly, and use 0 only when you truly want everything.
• Start small to validate — set maxResults to 25–50 on your first run to confirm the fields and keyword match your needs, then scale up.
• Use Most Relevant for research, Newest First for monitoring — relevance surfaces the strongest matches for a topic study; newest-first is best for feeds and alerts.
• Filter noise with specific phrases — a precise phrase like startup funding returns tighter results than a single broad word, cutting incidental mentions.
• Follow a beat by author — every row carries the author's profile URL, so you can pivot from a keyword search to tracking one writer's coverage.

Pricing

From $2.49 per 1,000 results — pay only for the articles you receive, cheaper than comparable TechCrunch scrapers on the store. Bronze, Silver, and Gold subscribers pay progressively less; the table below shows total cost at each discount tier.

Results	No discount	Bronze	Silver	Gold
100	$0.30	$0.28	$0.27	$0.25
1,000	$2.95	$2.80	$2.65	$2.49
10,000	$29.50	$28.00	$26.50	$24.90
100,000	$295.00	$280.00	$265.00	$249.00

A "result" is any article row in the output dataset. There are no compute or time-based charges — you pay per result, plus a small fixed per-run start fee. Platform fees depend on your Apify plan.

Integrations

Export data in JSON, CSV, Excel, XML, or RSS. Connect to 1,500+ apps via:

• Zapier / Make / n8n — Workflow automation
• Google Sheets — Direct spreadsheet export
• Slack / Email — Notifications on new results
• Webhooks — Trigger custom APIs on run completion
• Apify API — Full programmatic access

Legal & Ethical Use

This actor is designed for legitimate media monitoring, market research, and journalistic work. Users are responsible for complying with applicable laws and TechCrunch's Terms of Service. Respect copyright when redistributing headlines or summaries, and do not use collected data for spam, harassment, or any illegal purpose.