Pricing

from $1.00 / 1,000 results

Try for free

Go to Apify Store

News Source Crawler

Try for free

Given a news website URL, discover and extract articles with full metadata with title, authors, publish date, body text, top image, keywords, and summary. Works with any news site via sitemap or HTML discovery.

Pricing

from $1.00 / 1,000 results

Rating

5.0

(13)

Developer

Crawler Bros

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

News

Automation

Developer tools

You can access the News Source Crawler programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "websiteUrl": "https://techcrunch.com",
12    "maxArticles": 20
13};
14
15// Run the Actor and wait for it to finish
16const run = await client.actor("crawlerbros/news-source-crawler").call(input);
17
18// Fetch and print Actor results from the run's dataset (if any)
19console.log('Results from dataset');
20console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
21const { items } = await client.dataset(run.defaultDatasetId).listItems();
22items.forEach((item) => {
23    console.dir(item);
24});
25
26// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

News Source Crawler API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use News Source Crawler API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

News Source Crawler API in Python

News Source Crawler API through CLI

News Source Crawler OpenAPI definition

News Source Crawler API

News Website Crawler & Article Extractor

xtech/news-source-crawler

Scrape all articles from any news website. Extract full text, metadata, keywords, and summaries. Ideal for content analysis, research, and news aggregation.

Xtech

380

4.8

(3)

Multi-Source News & Content Scraper

moving_beacon-owner1/rss-feeds----multi-source-news-content-scraper

Multi-Source News & Content Scraper. Aggregates articles from multiple RSS/Atom feeds simultaneously. Includes 60+ pre-built news source presets and supports custom feed URLs. No API key required.

Jamshaid Arif

Construction Dive Scraper

lexis-solutions/constructiondive-com-scraper

Construction Dive scraper for USA construction news and press releases: extract articles, contacts, images, and metadata from ConstructionDive.com Deep Dive section for construction tech, PR, and market research workflows.

Lexis Solutions

Ballotpedia.org Scraper

lexis-solutions/ballotpedia-org-scraper

Scrape Ballotpedia.org political encyclopedia articles — ballot measures, legislation, lawsuits & electoral data. Extract structured JSON with title, URL & full text. Ideal for political research, news monitoring & content aggregation.

Lexis Solutions

RSS & News Feed Aggregator — Multi-Source Article Scraper

joyouscam35875/rss-news-aggregator

Aggregate and parse RSS/Atom feeds from any source. Extract articles with titles, descriptions, authors, dates, images. Optionally fetch full article content. Perfect for news monitoring and AI pipelines. $0.0005/article.

Ken Digital

Train Your Local LLM for Business & Finance - DataPro

omissive_aurora/train-your-local-llm-for-business-finance---datapro

Train your local LLM for business and finance with Ultimate DataPro. Scrapes live stock prices, SEC EDGAR filings, options chains, and financial news - then auto-builds Alpaca/ShareGPT fine-tuning datasets. Export as JSONL, CSV, or Parquet. Push to HuggingFace Hub.

d.leigh hunte

Google News Scraper — Headlines, Sources, URLs

scrapeify/google-news-scraper

Turn any Google News query into a deduplicated dataset of up to 2,000 articles: titles, sources, dates, RSS links, resolved publisher URLs, clean snippets. Multiple RSS time-window passes for depth beyond single-feed limits. Excel-ready CSV. No API key. Not affiliated with Google.

Scrapeify

Google News Scraper Comprehensive

scrapeio/google-news-scraper

Enter a keyword and collect up to 2,000 deduplicated Google News articles—headlines, publisher URLs, dates, sources, and snippets—from the public RSS layer. Excel‑ready CSV (UTF‑8 BOM, quoted fields) plus JSON. Perfect for brand monitoring, PR measurement, and news datasets. No Google Cloud API key.

Shop Intel

5.0

(4)

Google Images Scraper

automation-lab/google-images-scraper

Scrape Google Images results. Extract full-resolution image URLs, thumbnails, dimensions, titles, and source pages. Filter by size, color, type, and usage rights. No API key needed.

Stas Persiianenko

AI News Scraper

buseta/ai-news-scraper

Most Comprehensive AI News Scraper - scrape news about AI from all over the internet. Get full news contents, summaries, images, and more. Last Update: Mar 22, 2026