Google News Scraper | Beyond the 100-Article Cap, No Key avatar

Google News Scraper | Beyond the 100-Article Cap, No Key

Pricing

$1.00 / 1,000 news articles

Go to Apify Store
Google News Scraper | Beyond the 100-Article Cap, No Key

Google News Scraper | Beyond the 100-Article Cap, No Key

Scrape Google News by keyword or topic: headline, article URL, source, publish date & snippet. No API key, no login, up to 1,000 results per run. Works in Claude, ChatGPT & any MCP AI agent for live news monitoring.

Pricing

$1.00 / 1,000 news articles

Rating

0.0

(0)

Developer

The Mine Works

The Mine Works

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

0

Monthly active users

9 days ago

Last modified

Share

πŸ“° Google News Scraper: Articles, Sources & Topics

Part of the Social & Market Research MCP. This actor's data is also available to AI agents through our Social & Market Research MCP server β€” eight social, news and search-interest tools behind one endpoint. No result, no charge.

⚑ 17 of 18 runs in the last 30 days succeeded β€” the other was cancelled by the user, none failed Β· no API key, no login.

πŸ’Έ You're only charged for delivered results. Empty searches, failed pages and duplicate listings are never billed.

Overview

Google News Scraper pulls fresh news articles from Google News by search query or by topic section. For every article you get the headline, article URL, publisher name, publish date, and a short snippet as clean structured JSON, CSV, or Excel. Use it to monitor a brand across thousands of publishers, track breaking stories on any keyword, or feed live headlines into an AI agent.

The official Google News API was retired years ago, and third-party news APIs cap results and charge per call. This actor runs on the open Google News RSS feed, so it is fast, cheap, and reliable: no API key, no login, no browser automation. A single RSS feed caps at roughly 100 items; the scraper fans out across recency windows to pull up to 1,000 articles per run.

Reliability posture: blocked, empty, or failed runs are never charged. You only pay for an article record that was actually delivered.

βœ… No API key | βœ… No login | βœ… Up to 1,000 results per run | βœ… Pay only per article delivered | βœ… MCP-ready for AI agents

Features

Search Google News by keyword ("artificial intelligence", "Tesla earnings") or by topic section (WORLD, BUSINESS, TECHNOLOGY, SPORTS, SCIENCE, HEALTH). Localize with language (hl) and country (gl) codes for any Google News edition (US, GB, IN, AU, CA, DE, FR, and more). Fan-out across recency windows to exceed the roughly 100-item single-feed cap and pull up to 1,000 articles per run. Clean flat records: title, URL, source, publish date, snippet, plus the query or topic that returned each hit. Pay per result actually delivered, with zero charge on empty runs.

How it works

The actor queries the open Google News RSS feed (news.google.com/rss/search) with your search query or topic, along with the language and country codes you supply. To reach beyond the roughly 100-item single-feed cap, it fans out across successive recency windows and merges results, deduplicating by URL.

Every article is returned as a flat record with a small footprint, so runs are fast and cheap. Optional datacenter proxy is available if you want IP rotation for very large scheduled runs; the feed is otherwise open and works without a proxy.

🧾 Input configuration

Query mode:

{
"query": "artificial intelligence",
"language": "en-US",
"country": "US",
"maxResults": 100
}

Topic mode:

{
"topic": "TECHNOLOGY",
"language": "en-US",
"country": "US",
"maxResults": 50
}

πŸ“€ Output format

{
"title": "World leaders, Nobel laureates, AI experts to gather at Borgo Laudato si'",
"url": "https://news.google.com/rss/articles/CBMiugFBVV95cUxQQWtOVThVVUFfQjdweXBIWUNtaTZweFNaNl9wc0M3SnoxVGVkcmUtdU1HYTR1Z0tJdlFscmxEVG9zVHA3RXM5MUpVdDhZbkJMeVRWeFFQMmN2R0lkVHhXcjYzenFCNUxWcW1sMXhHZUNIVXAtbWtZV2NwMFpmNGY0MlRYYmdDOHFSMmFCU3pkb2tWRVBUTDY5MlhmWndSSmxIa1plOEhsdDZ4cUZVNzdlcEpoVnZONmtpVHc?oc=5",
"source": "Vatican News",
"published_at": "Wed, 15 Jul 2026 04:00:34 GMT",
"snippet": "World leaders, Nobel laureates, AI experts to gather at Borgo Laudato si' Vatican News",
"query": "artificial intelligence",
"scraped_at": "2026-07-15T04:14:30.448Z"
}

Every article record contains these fields:

FieldDescription
πŸ“° titleArticle headline
πŸ”— urlArticle URL. Google News serves this as a redirect link to the publisher's article rather than the bare publisher domain
🏒 sourcePublisher name
πŸ—“οΈ published_atPublish date (RFC 2822 from the RSS feed)
✏️ snippetShort preview text
🏷️ topicGoogle News topic (when topic mode is used)
πŸ” querySearch query (when query mode is used)
πŸ•’ scraped_atISO 8601 timestamp of capture

πŸ’Ό Common use cases

Brand and reputation monitoring Track every mention of your company or product across thousands of publishers. Alert on spikes in coverage volume before they compound.

Competitor and market intelligence Watch news flow around rivals, sectors, or emerging topics. Cluster coverage by source and date to see which outlets drive a story.

PR measurement Count coverage, sources, and timing after a launch or announcement. Slice by country edition to measure international pickup.

AI research and news agents Let a Claude or ChatGPT agent fetch and summarize the latest headlines on any subject. Build training and research datasets of news coverage over time.

πŸš€ Getting started

  1. Open the actor and enter a Search query (e.g. artificial intelligence, Tesla earnings), or leave blank and pick a Topic.
  2. Set Language (en-US, hi-IN, en-GB) and Country (US, IN, GB) if you want a specific edition.
  3. Set Max articles (up to 1,000).
  4. Click Save & Start.
  5. Download as JSON, CSV, or Excel, or pull via API or MCP.

πŸ’΅ Pricing

Pay-per-event. The rate depends on your own Apify tier:

EventApify tierPrice per article
article-scraped β€” News articleFREE$0.0025
BRONZE$0.002
SILVER$0.0018
GOLD / PLATINUM / DIAMOND$0.0015

FREE/BRONZE/SILVER/GOLD/PLATINUM/DIAMOND are Apify's own account tiers, which set your per-event rate. They are not a free-result allowance β€” every delivered record is charged at your tier's rate.

$2.50 per 1,000 articles at the FREE tier, down to $1.50 per 1,000 at GOLD and above. The charge fires only after an article has actually landed in your dataset, so queries that return nothing and failed runs are never billed.

⏰ Run it on a schedule

This is the actor most worth scheduling: a fixed brand or competitor query on a daily cadence turns into a standing news digest that nobody has to run by hand.

  1. On this actor's page, click β‹― β†’ Schedule actor (or Console β†’ Schedules β†’ Create new).
  2. Pick a frequency β€” @daily suits brand and competitor monitoring; @hourly during a launch or an unfolding story.
  3. Your saved input is reused on every run; each run appends to a named dataset.
  4. Wire the dataset to Google Sheets, Slack, or a webhook via the actor's Integrations tab so new records reach you automatically.

FAQ

Do I need a Google News API key? No. There is no API key and no login. The actor uses the open Google News RSS feed.

How many articles can I get per run? Up to 1,000. The scraper fans out across recency windows to exceed the roughly 100-item single-feed cap.

Can I search by topic instead of a keyword? Yes. Use the Topic field with values like WORLD, BUSINESS, TECHNOLOGY, SPORTS, SCIENCE, or HEALTH.

Can I localize to a specific country? Yes. Set the Country (gl) edition and Language (hl) codes (e.g. IN with hi-IN for Hindi India).

How am I charged? Pay per article delivered, at the rates in the Pricing table above: $2.50 per 1,000 articles at the FREE Apify tier, down to $1.50 per 1,000 at GOLD and above. You pay only for articles actually returned, and there is no free result quota.

Is there a Google News API? Not any more. Google retired its official News API years ago, and commercial news APIs cap results and bill per call. This actor reads the open Google News RSS feed instead, so there is no key to obtain and no per-call quota.

How do I monitor brand mentions in the news? Set query to your brand or product name, schedule the actor daily (see above), and route the dataset to Slack, Google Sheets, or a webhook from the Integrations tab. Each run appends to the same dataset, so you build a running coverage log rather than a one-off snapshot.

Does it return the full article text? No. Google News RSS provides the headline, publisher, publish date, and a short snippet, plus the link to the article. Follow the url field if you need the full body β€” it resolves through to the publisher's own page.

Use in Claude, ChatGPT & any MCP agent

https://mcp.apify.com/?tools=themineworks/google-news

Or call it programmatically with the Apify client:

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });
const run = await client.actor('themineworks/google-news').call({
query: 'artificial intelligence',
language: 'en-US',
country: 'US',
maxResults: 100,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

πŸ› οΈ Complete your media intelligence pipeline

News is one signal. Layer in trends and social:

Typical flow: pull news coverage for a brand or topic, cross-check on Threads and X for social pickup, and validate the interest curve with Google Trends.

Found a bug or have a feature request? Open an issue on the actor's Apify Console page or reach out through the Apify profile.