Universal News Scraper avatar

Universal News Scraper

Pricing

from $10.00 / 1,000 results

Go to Apify Store
Universal News Scraper

Universal News Scraper

Universal News Scraper Scrapes BBC, CNN, Reuters, Al Jazeera, The Guardian, and NYT using RSS feeds + web scraping. No API keys or login needed.

Pricing

from $10.00 / 1,000 results

Rating

0.0

(0)

Developer

Jamshaid Arif

Jamshaid Arif

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Share

Universal News Scraper — Apify Actor

Scrapes BBC, CNN, Reuters, Al Jazeera, The Guardian, and NYT using RSS feeds + web scraping. No API keys or login needed.

Input

FieldTypeDefaultDescription
sourcesarrayall 6 sourcesWhich news sources to scrape
methodstringautoauto (RSS + scrape fallback), rss, or scrape
maxArticlesPerSourceinteger20Max articles per source
searchKeywordstring""Filter by keyword (optional)

Example input

{
"sources": ["bbc", "cnn", "guardian"],
"method": "auto",
"maxArticlesPerSource": 15,
"searchKeyword": "war"
}

Output

Each article in the dataset has:

{
"source": "BBC News",
"sourceKey": "bbc",
"title": "Article headline here",
"url": "https://www.bbc.com/news/...",
"summary": "Brief description of the article...",
"publishedAt": "Tue, 01 Apr 2026 12:00:00 GMT",
"scrapedAt": "2026-04-01T14:30:00+00:00",
"method": "auto"
}

How it works

  1. RSS feeds (primary) — Fast, structured, returns title + link + summary + date
  2. Web scraping (fallback) — Hits homepages with CSS selectors when RSS fails
  3. Reuters uses a Google News RSS workaround (direct scraping returns 401)

Run locally

$apify run --input '{"sources": ["bbc", "cnn"], "maxArticlesPerSource": 5}'

Deploy to Apify

apify login
apify push