Google News Scraper

Monitor Google News for any keyword, topic or country edition and get articles with the real publisher URL (Google's redirect links decoded), source name, publication date and, when you want it, the full article text. Built for hourly monitoring: a time window and a since-last-run checkpoint mean a scheduled run returns only new articles. $1.00 per 1,000 articles with the decoded URL, plus $1.00 per 1,000 extracted article texts, charged only when the text was actually extracted. Decode failures, summaries, errors and empty runs cost nothing. The first 25 articles each month are free for every account.

Why this one

	This actor
Real URLs	Every article's Google link is resolved to the publisher's page with the same call Google's own client uses, so links can be opened, shared and deduplicated. A row whose URL could not be decoded is free.
Full text	Optional readable article text with author, image, description and word count. Charged only when extracted; blocked or empty pages are free and carry a textStatus explaining why.
Coverage	Keyword searches with Google operators ("exact phrase", site:, -word), nine topic sections, any custom Google News feed URL, and several country editions in one run (editions, for example GB:en, DE:de, IT:it).
Hourly monitoring	onlyNewSinceLastRun stores the newest publication time per query and skips older articles next time. publishedWithin (1h, 1d, 7d) narrows the feed on Google's side.
Reliability	No browser; one free summary record per feed with counts and stoppedBy; a feed that fails gives an error record, an article that cannot be decoded or fetched keeps its row with decodeError or articleError.
Price	$0.001 per article with a decoded URL, $0.001 per extracted text, Apify's default $0.00005 start fee. No platform usage charged on top.

What people use it for

• Media monitoring and brand alerts: every article mentioning your company, competitors or executives, hourly to Slack or a sheet, with clean links.
• News datasets: headlines and article text for market research, NLP or sentiment analysis.
• AI agents and RAG: fresh, citable news through the Apify API or the Apify MCP server.
• PR reporting: who covered a story first and which outlets picked it up (relatedArticles).
• Local and multilingual coverage: any Google News edition, for example IT/it or BR/pt-BR.

Example tasks

Ready-made configurations you can open, copy and run as they are:

• Monitor Google News for brand mentions across countries, hourly: one brand across three country editions with decoded publisher URLs and the checkpoint on for an hourly schedule.

Input

Field	Type	Default	Description
queries	array	–	Search keywords; one feed each, up to 100 articles per feed.
topics	array	[]	TOP, WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH.
feedUrls	array	[]	Any news.google.com/rss/... URL (publication or geo feeds).
language	string	en	en, en-GB, de, it, es, fr, pt-BR…
country	string	US	US, GB, DE, IT, IN…
editions	array	[]	Extra editions as COUNTRY:language (GB:en, DE:de, BR:pt-BR); every query and topic runs once per edition.
publishedWithin	string	–	1h, 12h, 1d, 7d, 30d.
maxItemsPerFeed	integer	50	Up to 100 (Google's limit per feed).
decodeUrls	boolean	true	Resolve the real publisher URL.
fetchArticleText	boolean	false	Download and extract the article body.
onlyNewSinceLastRun	boolean	false	Checkpoint mode for schedules.
checkpointStoreName	string	google-news-state	Key-value store for the checkpoints.
proxyConfiguration	object	Apify Proxy	Recommended when fetching article text; many publishers block datacenter IPs.

At least one of queries, topics or feedUrls is required.

{
    "queries": ["\"OpenAI\"", "Apify"],
    "topics": ["TECHNOLOGY"],
    "language": "en",
    "country": "US",
    "editions": ["GB:en", "DE:de"],
    "publishedWithin": "1d",
    "maxItemsPerFeed": 100,
    "fetchArticleText": true,
    "onlyNewSinceLastRun": true
}

Output

Three record types share one dataset: article rows (no type field), and summary and error records.

Article ($0.001 when url is present, free otherwise; plus $0.001 when textStatus is ok). A real row, long fields shortened:

{
  "query": "\"Pavel Durov\"",
  "feedKind": "search",
  "title": "Telegram CEO Pavel Durov Released from Custody After Facing Charges in France",
  "url": "https://coinmarketcap.com/academy/article/telegram-ceo-pavel-durov-released-from-custody-after-facing-charges-in-france",
  "googleUrl": "https://news.google.com/rss/articles/CBMiuwFBVV95cUxONFNrWWZ…",
  "source": "CoinMarketCap",
  "sourceUrl": "https://coinmarketcap.com",
  "publishedAt": "2026-10-12T08:03:50.000Z",
  "relatedArticles": [],
  "language": "en",
  "country": "US",
  "scrapedAt": "2026-10-14T15:06:59.794Z",
  "articleText": "The founder and CEO of the popular messaging app Telegram, Pavel Durov, has been released from custody after being charged by French authorities. Following an appearance in court, Durov was placed und…",
  "articleHtml": "<div><p>The founder and CEO of the popular messaging app Telegram, Pavel Durov, …",
  "author": "CoinMarketCap",
  "image": "https://academy-public.coinmarketcap.com/optimized-uploads/4…",
  "description": "The founder and CEO of the popular messaging app Telegram, Pavel Durov, has been released from custody after being charged by French authorities. Following an appearance in court, Durov was placed under judicia...",
  "siteName": "coinmarketcap.com",
  "wordCount": 435
}

Field	Type	Notes
title, source, sourceUrl	string	Headline (publisher suffix removed), publisher name and site.
url, urlStatus	string or null, string	Decoded publisher URL; urlStatus is decoded, direct, failed (free row, decodeError explains) or not_requested.
googleUrl	string	The original Google News link.
publishedAt	string	ISO 8601 UTC.
relatedArticles	array	Other outlets' coverage of the same story, as grouped by Google.
articleText, articleHtml, author, image, description, wordCount, textStatus	misc	Present when fetchArticleText is on. textStatus is ok (charged), blocked (publisher refused the request), paywall_or_empty, no_content, error or skipped; only ok is charged.
query, feedKind, language, country, scrapedAt	string	What the row was fetched for.

summary (free, one per feed): status is COMPLETE, PARTIAL (stopped by your spending limit), EMPTY or ERROR; stoppedBy is maxItems, checkpoint, endOfFeed, chargeLimit or error:

{
  "type": "summary",
  "query": "\"Pavel Durov\"",
  "feedKind": "search",
  "status": "COMPLETE",
  "articlesInFeed": 9,
  "articlesScraped": 5,
  "urlsDecoded": 5,
  "textsFetched": 5,
  "newestPublishedAt": "2026-10-12T08:03:50.000Z",
  "stoppedBy": "maxItems",
  "checkpointUsed": null
}

error (free): {"type": "error", "query": "…", "feedUrl": "…", "error": "Google News feed returned HTTP 503"}

Pricing and cost examples

Try it free. The first 25 articles each calendar month are free for every Apify account, with nothing to enter: the actor keeps count in a small key-value store in your account (free-slice-google-news-scraper) and charges only from the 26th on. The free results are real results you keep; the counter resets on the first of each month.

Job	Articles	Cost
Hourly monitor of 30 keywords in 5 editions, one new article per feed per hour on average, checkpoint on, URLs only	3,600 a day	$3.60 a day
The same monitor with article text (about 80% of texts extract)	3,600 a day	$6.50 a day
Daily digest of 10 keywords, 20 articles each, URLs only	200 a day	$0.20 a day
One-off dataset: 100 queries × 100 articles with full text	10,000	$18 to $20

Platform compute and URL decoding are included; article text is charged only when extracted. A run that finds nothing new costs only Apify's $0.00005 start fee.

Discounts for paid Apify plans, applied automatically to the buyer's plan: Bronze 10% off, Silver 25% off, Gold and enterprise tiers 40% off the prices above. Free-plan users pay the listed price.

Scheduling: hourly monitoring in two minutes

1. Create a task from this actor with your queries, editions, publishedWithin: "1d" and onlyNewSinceLastRun: true.
2. Add an Apify schedule (for example every hour).
3. Add an integration on the task: Slack, e-mail, Google Sheets, Make, Zapier, n8n or a webhook. Each run delivers only new articles; summary records tell you per feed whether the run was complete.

The checkpoint is kept per query or topic, language and country. To start over, change checkpointStoreName or delete the key-value store.

Run it from your code

Node.js:

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });
const run = await client.actor('agentsgearbox/google-news-scraper').call({
    queries: ['"Pavel Durov"'], publishedWithin: '1d', maxItemsPerFeed: 50, fetchArticleText: true,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items.filter((i) => i.url).map((i) => [i.source, i.title, i.url]));

Python:

from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("agentsgearbox/google-news-scraper").call(run_input={
    "queries": ["Apify"], "topics": ["TECHNOLOGY"], "language": "en", "country": "US", "publishedWithin": "1d"})
articles = [i for i in client.dataset(run["defaultDatasetId"]).iterate_items() if "title" in i]

cURL (synchronous, returns the dataset):

curl -X POST "https://api.apify.com/v2/acts/agentsgearbox~google-news-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"queries": ["artificial intelligence"], "publishedWithin": "1d", "maxItemsPerFeed": 20}'

For AI agents

Give your agent hands. Instead of fetching pages, getting blocked and reasoning over HTML, it calls this actor as a tool and gets verified results back as JSON, priced per result. Google News links are encoded, so an agent that fetches them itself gets redirects, not articles. This actor returns 100 articles with their real publisher URLs for $0.10, plus $0.10 if you want the full text.

• MCP, this actor only: add https://mcp.apify.com?tools=agentsgearbox/google-news-scraper to Claude Desktop, Claude Code, Cursor or any MCP client (with your Apify token), then ask for "today's Google News articles about Apify with their publisher URLs".

• MCP, all agentsgearbox actors: https://mcp.apify.com?tools=agentsgearbox/telegram-channel-scraper,agentsgearbox/google-play-reviews-scraper,agentsgearbox/substack-scraper,agentsgearbox/google-news-scraper,agentsgearbox/brand-name-generator,agentsgearbox/ai-readiness-audit,agentsgearbox/company-lookup,agentsgearbox/app-intelligence,agentsgearbox/app-store-reviews-scraper,agentsgearbox/company-jobs-scraper,agentsgearbox/apple-podcasts-scraper,agentsgearbox/remote-jobs-scraper

• No Apify account? This actor is eligible for Apify's agentic payments: an agent can buy a spend-capped token through agi.apify.com (x402, MPP or Skyfire) and call the API directly.
• Prices are per result and known in advance, so the agent can set a spending limit; error records come back as data instead of failed runs.

Limitations, stated plainly

• Google News lists at most 100 articles per feed; for more coverage, split by time window or use more specific queries.
• Google decides which articles appear in a feed; the actor cannot return what Google does not list.
• Article text depends on the publisher's page: paywalled or heavily scripted pages return a partial text, and some publishers block datacenter IPs, which is why Apify Proxy is recommended for text.
• The checkpoint compares publication times, so an article Google adds late with an older timestamp is skipped on the next run.

Troubleshooting

Symptom	Cause and fix
url is null with decodeError	Google changed its decoding endpoint or rate-limited the request; the row keeps the Google link and is not charged. Report it on the Issues tab, these are fixed quickly.
textStatus: "blocked"	The publisher blocks datacenter IPs. Turn on Apify Proxy in proxyConfiguration. Blocked rows are not charged for text.
0 articles with the checkpoint on	Nothing new since the last run; the summary shows stoppedBy: "checkpoint".
Feed returns fewer than 100	Google returned fewer matches for that query and window.
Run stopped with PARTIAL	Your spending limit for the run was reached. Raise it or lower maxItemsPerFeed.

Track record

• Published 13 October 2026 and tested every day since by an automated run on the Apify platform; every test run has succeeded. The Store's run statistics on this page reflect those runs with a delay of up to a day.
• No browser, so a run cannot fail on Chrome crashes or memory limits.
• Every actor from this account is monitored daily, so a change on Google's side is normally fixed the same day.

More from agentsgearbox

• Telegram Channel Scraper: public Telegram channels as JSON, no API key.
• Google Play Reviews Scraper: Google Play reviews with replies and versions, any market.
• Substack Scraper: Substack posts with full text and comments, custom domains too.
• Brand & Business Name Generator: brand names verified live on domains, handles and app stores.
• AI Readiness Audit: how well AI search engines and agents can read a site: crawler access, llms.txt, structured data, content without JavaScript, scored with fixes.
• Company Lookup: one row per domain with legal identity and VAT validation, contacts, socials, tech stack, open jobs, apps, news and Wikidata facts.
• App Intelligence: App Store and Google Play in one run: search, top charts, full app details and each app's twin on the other store.
• App Store Reviews Scraper · iOS + Google Play, Any Country: Reviews of any iOS or Android app from both stores in one run: stars, text, version, votes, developer replies, since-last-run checkpoint, rating trend per app..
• Company Jobs Scraper: every open job on a company's careers page: nine applicant tracking systems, one schema, salaries where stated, hiring signals free.
• Apple Podcasts Scraper: Apple Podcasts search, charts, episodes with audio links and listener reviews, any country.
• Remote Jobs Scraper: remote jobs from six boards and the Hacker News hiring thread in one schema, deduplicated, only-new mode for alerts.

All of them are pay-per-event, run without a browser, and are compared with their alternatives on agentsgearbox.com.

Support

Open an issue on this actor's Issues tab, usually answered within a day, or email support@agentsgearbox.com. More actors and daily comparisons of scrapers for 200+ websites at agentsgearbox.com.

Legal and fair use

The actor reads public Google News feeds and public article pages. Store headlines and links freely, but check the licence before republishing full article text.