Pricing

$20.00/month + usage

Go to Apify Store

News Website Crawler & Article Extractor

Try for free

Developed by

Xtech

Scrape all articles from any news website. Extract full text, metadata, keywords, and summaries. Ideal for content analysis, research, and news aggregation.

0.0 (0)

Pricing

$20.00/month + usage

Last modified

3 months ago

News

SEO tools

Social media

News Source URL

urlstringRequired

The URL of the news website you want to crawl (e.g., https://www.cnn.com).

Maximum Articles

maxArticlesintegerOptional

The maximum number of articles to scrape. Set to 0 for no limit.

Default value of this property is 100

Language

languageEnumOptional

The language of the articles. Choose from supported languages.

Value options:

"en": string"es": string"fr": string"de": string"it": string"pt": string"ru": string"zh": string"ja": string"ko": string"ar": string"nl": string"sv": string"da": string"no": string"fi": string"pl": string"he": string"tr": string"hu": string"el": string"uk": string"vi": string"id": string"sw": string"fa": string"hi": string"hr": string"bg": string"et": string"mk": string"be": string"sl": string"sr": string"ro": string

Default value of this property is "en"

Keyword Search [Optional]

keywordSearchstringOptional

Filter articles containing specific keywords. Leave blank to get all articles. Supports boolean operators: AND, OR, NOT with parentheses (e.g., 'climate AND (change OR crisis) NOT politics').

Search in Article Titles

searchInTitlebooleanOptional

Apply keyword search to article titles.

Default value of this property is true

Search in Article Content

searchInContentbooleanOptional

Apply keyword search to article text content.

Default value of this property is true

Case Sensitive Search

caseSensitivebooleanOptional

Make keyword search case sensitive.

Default value of this property is false

Minimum Word Count

minWordCountintegerOptional

Skip articles that have fewer words than this number. Use 0 for no minimum.

Default value of this property is 0

Extract Summary & Keywords

extractSummarybooleanOptional

Generate article summaries and keywords using Natural Language Processing (NLP). Note: This increases processing time.

Default value of this property is true

Include Images

includeImagesbooleanOptional

Extract and include image URLs from articles.

Default value of this property is true

Request Timeout (seconds)

requestTimeoutintegerOptional

Timeout for each article request in seconds.

Default value of this property is 7

Concurrent Requests

concurrencyintegerOptional

Number of articles to process simultaneously. Higher values = faster crawling but may trigger rate limits.

Default value of this property is 5

Proxy Configuration

proxyConfigurationobjectOptional

Configure proxy settings for reliable scraping. Apify Proxy is recommended for best results.

Default value of this property is {"useApifyProxy":false}

Google News Scraper (Pay Per Result)

data_xplorer/google-news-scraper-fast

⚡️ Extract real-time news including Images and Descriptions from Google News with our powerful scraper. Get comprehensive structured data including titles, sources, publication dates and full article summaries. Perfect for news monitoring, market research and content aggregation.

Data Xplorer

179

5.0

Google News Scraper

easyapi/google-news-scraper

Powerful Google News scraper, collect up to 5000 news articles with flexible search options, language support. Perfect for news aggregation, market research, and sentiment analysis. 📰🔍

EasyApi

307

3.0

Ultimate News API

glitch_404/Ultimate-News-Scraper

news scraper to scrape up to 10K news articles from over 4500 news sources in less than 20 minutes news from over 20 categories .e.g. Crypto news, World News, Latest News, Celebrities News, and a lot more. you can get news from websites like Fox News, BBC News, CNN News, Crypto and Cryptocurrencies.

Yousif Wael

131

Fast News Scraper

timgreen/fast-news-scraper

Extract full article text and metadata from popular news sites like The New York Times, AP News, Reuters, CNBC, NPR, and Wired. Scrape thousands of articles in just a few minutes.

Tim Green

404

5.0

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

5.6K

4.7

Google News Scraper

epctex/google-news-scraper

Unlock timely news insights with our Google News data retrieval tool. Get the latest news on any news at any time, and more. Effortless and powerful. 📰🔍 #NewsData

epctex

446

Tech News Article Scraper

inquisitive_sarangi/news-article-scraper

Tech News Article Scraper is a simple yet powerful tool to extract news articles from a variety of popular news websites. Supported The Verge, CNET, Wired, TechCrunch, Ars Technica

API Master

Google News Realtime Scraper

devisty/google-news

Provide real-time news and articles sourced from Google News

Devisty

185

5.0

News Article Scraper for Feeding LLM

proscraper/newsarticlescraper

Scrape news articles metadata to feed into LLM models. Returns article body, published date, article title, author etc.

Owais Nazir

Advanced News Scraper

dorcy/advanced-news-scraper

This scraper is crafted to extract the latest news articles based on custom search queries, providing a wealth of information, including article titles, sources, publication dates, full article text, and AI-generated summary.