Google News Scraper - Articles, Real URLs & Full Text

What does Google News Scraper do?

Google News Scraper extracts news articles from Google News by keyword search, topic section (World, Business, Technology, Science, Sports, Health and more) or top stories, in any language and country. For every article you get the title, publisher, publish date, Google News link and the real article URL, decoded from the news.google.com/rss/articles/... redirect links. Turn on full text and it also returns the main article text, author and image from the publisher's page.

It works like a Google News API: run it from the Apify Console, call it over the REST API, schedule it, or plug it into Make, Zapier, n8n, LangChain or an AI agent through MCP. It reads Google News RSS over plain HTTP, so it is fast and cheap. No browser, no login.

Why use it?

• Media monitoring and brand tracking: get every new article about your company, competitors or executives each hour or day.
• Market and financial research: collect news about stocks, sectors and commodities for sentiment analysis.
• AI and LLM pipelines: feed fresh news with full article text into RAG, summarization or newsletters.
• PR and SEO: see which publishers cover a topic and link to the real article URLs.
• News archives and datasets: back-fill months of coverage day by day with the date-split option.

What data can it extract?

Field	Description
query	Your search query, topic:BUSINESS or top-stories
position	Rank of the article in the feed
title	Headline (publisher suffix removed)
publisher, publisherUrl	News site name and homepage
publishedAt	Publish time, ISO 8601 (UTC)
googleNewsUrl	The news.google.com article link
articleUrl	Real publisher URL, decoded (null if Google won't resolve it)
snippet	Article description (filled from the publisher page when full text is on)
text, textLength	Main article text (with Fetch full article text)
textError	Why there is no full text: HTTP error, paywall teaser only (not charged), no article found
author, imageUrl	Author and lead image (with Fetch full article text)
language, country, scrapedAt	Edition and scrape time

How to scrape Google News

1. Enter one or more search queries (Google operators work: "exact phrase", OR, -word, site:reuters.com, intitle:), and/or pick topic sections. Leave both empty to get today's top stories.
2. Set language (en-US, de, fr, es-419, ja...) and country (US, DE, IN...).
3. Optionally limit by time: Published within (last hour, day, week...) or a date range.
4. Keep Decode real article URLs on, and turn on Fetch full article text if you need the article body.
5. Click Start, then download the results as JSON, CSV, Excel or HTML, or read them via the API.

How much does it cost to scrape Google News?

Pay only for results:

• $2.00 per 1,000 articles (article event), real URLs included. Rows whose real URL Google won't give are free.
• +$3.00 per 1,000 full texts (article-text event), charged only when the full text was extracted. Paywall teasers (the text is still returned), video and blocked pages are free.
• Failed queries and empty results are free. Set a maximum cost per run in the Console and the scraper never charges past it.

Input

{
    "queries": ["artificial intelligence", "site:reuters.com tesla"],
    "topics": ["BUSINESS", "TECHNOLOGY"],
    "language": "en-US",
    "country": "US",
    "timeWindow": "1d",
    "maxArticlesPerQuery": 100,
    "decodeUrls": true,
    "fetchFullText": false
}

Date range instead of timeWindow: "dateFrom": "2026-09-01", "dateTo": "2026-09-30" (both days included). Add "splitByDay": true and raise maxArticlesPerQuery to get more than 100 articles (see Tips).

Output

{
    "query": "site:reuters.com nvidia",
    "topic": null,
    "position": 1,
    "title": "DeepSeek partners with Huawei to develop chip programming tools, reducing reliance on Nvidia",
    "publisher": "Reuters",
    "publisherUrl": "https://www.reuters.com",
    "publishedAt": "2026-09-30T03:03:00.000Z",
    "googleNewsUrl": "https://news.google.com/rss/articles/CBMizgFBVV95cUxP...?oc=5",
    "articleUrl": "https://www.reuters.com/world/asia-pacific/deepseek-partners-with-huawei-develop-chip-programming-tools-reducing-reliance-2026-09-30/",
    "snippet": null,
    "language": "en-US",
    "country": "US",
    "scrapedAt": "2026-10-01T02:46:41.809Z",
    "error": null
}

Download the dataset as JSON, CSV, Excel, XML or HTML table, or fetch it from the API.

Tips

• Getting more than 100 articles. Google News RSS returns at most about 100 articles per query. To get more, split the time range: Google's after: and before: operators restrict results to a date window, so each day (or week) returns its own ~100 articles. Set dateFrom and dateTo, turn on Split date range by day and raise Max articles per query (for example 3000 for a month): the scraper runs one search per day, newest first, and stops at maxArticlesPerQuery. With the default of 100 you only get the newest day. You can also split manually by adding queries like tesla after:2026-09-01 before:2026-09-08.
• Same story, many publishers. Articles are de-duplicated by URL across all your queries in a run, so you never pay twice for the same article.
• Monitoring. Schedule the actor hourly with timeWindow: "1h" or daily with "1d" and send new rows to Slack, Google Sheets or a webhook.
• Topics follow the edition you choose: NATION is US news for US, German news for DE, and so on. Date filters apply to search queries only.
• Real URLs. Google now hides the publisher URL behind an encoded id. The scraper resolves it the same way the Google News site does. In the rare case Google refuses, articleUrl is null and the row is still returned, free of charge.
• Rate limits. If Google answers with HTTP 429 or a CAPTCHA page, the scraper backs off and switches to Apify's datacenter proxy for the rest of the run. It never solves CAPTCHAs.
• Large runs. Hundreds of queries or a long day-by-day range can take a while. Near the run timeout the scraper stops starting new searches and marks the rest as skipped (free), so the run still succeeds. Raise the timeout or split the input for more.

FAQ

Is there an official Google News API?

No. Google retired the Google News API years ago. This actor gives you the same data through Google News RSS feeds with a clean JSON output.

Why is articleUrl sometimes null?

Google could not resolve that article id (rare, usually during heavy rate limiting). The row still has the title, publisher, date and Google News link, and it is not charged.

Can I get the full article text?

Yes. Turn on Fetch full article text. The text is extracted from the publisher's page. Paywalled sites (for example Bloomberg, WSJ or FT) only show a teaser or nothing. A teaser is still returned in text, with textError saying so, and like pages without text it is not charged.

Which languages and countries are supported?

Every Google News edition: set language (hl) and country (gl). The edition id (ceid) is built automatically; set ceid yourself only to force a specific edition. If Google has no edition for your pair (for example de in US), the run stops with a free error row instead of returning another country's news.

Is it legal to scrape Google News?

The actor reads public RSS feeds and public article pages. It does not log in or collect personal data. You are responsible for how you use the data, including copyright of article texts and Google's terms. Use full article text for analysis, not for republishing. Consult a lawyer if unsure.

Disclaimer

This actor is not affiliated with, endorsed or sponsored by Google LLC. Google News is a trademark of Google LLC.

More tools from Tenfold Fleet

Actor	Price
ATS Jobs Scraper - Greenhouse, Lever, Ashby & 5 More	$2 per 1,000 (job posting)
Website Contact Scraper - Emails, Phones & Socials	$8 per 1,000 (website with contacts)
Google Ads Transparency Center Scraper - Competitor Ads by Site	$1 per 1,000 (ad scraped)
Keyword Search Volume, CPC & Difficulty Checker (Bulk)	$5 per 1,000 (keyword with data)
Remote Jobs Aggregator - RemoteOK, WWR, Himalayas & 4 more	$1.2 per 1,000 (unique remote job)
SEO Audit Tool - Technical On-Page SEO Checker & Score	$20 per 1,000 (page audited)
Shopify Products Scraper - Prices, Variants & Stock	$0.8 per 1,000 (product)
Shopify App & Theme Detector - Store Analyzer & Contacts	$8 per 1,000 (shopify store analyzed)
Sitemap URL Extractor - All URLs from sitemap.xml & robots.txt	$0.4 per 1,000 (url extracted)
Technology Detector - Wappalyzer & BuiltWith Alternative	$10 per 1,000 (website analyzed)
URL to Markdown - Web Page to LLM-Ready Text for AI Agents	$1 per 1,000 (page converted)
Workday Jobs Scraper - myworkdayjobs.com API with Salary	$1.5 per 1,000 (job posting)
YouTube Comments Scraper - Replies, Likes & Sort by Newest	$0.6 per 1,000 (comment scraped)
YouTube Transcript Scraper - Captions & Subtitles API	$3 per 1,000 (transcript extracted)