Pricing

$10.00/month + usage

Go to Store

Ultimate News API

Try for free

Developed by

Yousif Wael

news scraper to scrape up to 10K news articles from over 4500 news sources in less than 20 minutes news from over 20 categories .e.g. Crypto news, World News, Latest News, Celebrities News, and a lot more. you can get news from websites like Fox News, BBC News, CNN News, Crypto and Cryptocurrencies.

0.0 (0)

Pricing

$10.00/month + usage

Total users

118

Monthly users

Runs succeeded

90%

Last modified

a month ago

News

SEO tools

Back to issues Create new issue

Duplicated results

Open

polarisnetroot opened this issue

Hi there, the result returns duplicated results.

Practically, all data are the same but with slight differences in the modified and creation dates.

My precious result said it returns 514 results, but after looking through all data with a script, the following shows results where all fields the same (e.g. URL, Body, images, etc.) except the timestamp.

[{'Modified': ('2025-03-07 04:43:46', '2025-03-07 04:42:54'),
  'Published': ('2025-03-07 04:43:46', '2025-03-07 04:42:54')},
 {'Modified': ('2025-03-07 04:43:46', '2025-03-07 04:42:57'),
  'Published': ('2025-03-07 04:43:46', '2025-03-07 04:42:57')},
 {'Modified': ('2025-03-07 04:43:46', '2025-03-07 04:42:59'),
  'Published': ('2025-03-07 04:43:46', '2025-03-07 04:42:59')},
 {'Modified': ('2025-03-07 04:43:46', '2025-03-07 04:43:02'),
  'Published': ('2025-03-07 04:43:46', '2025-03-07 04:43:02')},
...
...

After de-dup, there are only *unique 85 results.

*unique as in all except the timestamps

Add comment

Google News Scraper - Cheap

bot_kevin/Google-News-Scraper

Easily scrape news from Google News page in .json format.

bot

Google News Scraper

epctex/google-news-scraper

Unlock timely news insights with our Google News data retrieval tool. Get the latest news on any news at any time, and more. Effortless and powerful. 📰🔍 #NewsData

epctex

420

Google News Scraper

easyapi/google-news-scraper

Powerful Google News scraper, collect up to 5000 news articles with flexible search options, language support. Perfect for news aggregation, market research, and sentiment analysis. 📰🔍

EasyApi

198

5.0

Fast News Scraper

timgreen/fast-news-scraper

Extract full article text and metadata from popular news sites like The New York Times, AP News, Reuters, CNBC, NPR, and Wired. Scrape thousands of articles in just a few minutes.

Tim Green

359

5.0

Google News Realtime Scraper

devisty/google-news

Provide real-time news and articles sourced from Google News

Devisty

162

5.0

Google News Scraper

dan.scraper/google-news-scraper

This actor extracts news articles from Google News. It can extract articles from a specific topics like 'World', 'Nation', 'Business', 'Technology', 'Entertainment'. Also extract articles from a specific news source like 'CNN', 'BBC', 'TechCrunch'. Scrape all elements from Google News page.

Scrape It

Google News Scraper (Pay Per Result)

data_xplorer/google-news-scraper-fast

⚡️ Extract real-time news including Images and Descriptions from Google News with our powerful scraper. Get comprehensive structured data including titles, sources, publication dates and full article summaries. Perfect for news monitoring, market research and content aggregation.

Data Xplorer

115

5.0

Fox News Scraper

harvest/fox-news-scraper

Extracts the latest news articles from Fox News, categorized by different feeds (e.g., Latest, World News, Politics, Technology, etc.). The scraper returns structured data including article titles, links, publication dates, and content.