Google News Scraper — Articles, Sources & Full Text

Search Google News by keyword or pull topic headlines in any language and country, and get every article with its real publisher URL (not a news.google.com redirect), source, publish date and — optionally — the full article text, author, top image and language from the publisher's page. Built for media monitoring, brand and competitor tracking, PR reports, market research, news datasets and LLM/RAG pipelines.

$1 per 1,000 articles ($0.001 each). Full text: +$0.002 per article, charged only when the text was actually extracted. No login, no API key.

Why this Google News scraper

• Real article URLs. Google News RSS links are encrypted redirects (news.google.com/rss/articles/CBMi…) that break in spreadsheets, CRMs and crawlers. Every link is resolved to the publisher's real URL; the few that can't be resolved are flagged with decodeFailed: true instead of silently returning junk.
• More than 100 results per query. Google returns at most ~100 articles per search. When that cap is hit, the scraper automatically splits your period into single days (after: / before:) and collects up to 100 per day — e.g. 7 days can give several hundred unique articles for a busy topic.
• Full text in the same run. Turn on Extract full article text to get the main text, author, publish date, top image and language, read from the article's structured data (JSON-LD NewsArticle) and a readability-style text extractor. You pay the extra only for articles where text was found.
• Any edition, many at once. English US/UK/India, Arabic (Saudi Arabia, Egypt, UAE…), German, French, Spanish, Portuguese (Brazil), Japanese and every other Google News edition — run several editions in one go, de-duplicated.
• No duplicates. Articles are de-duplicated by their real URL across queries, topics, day windows and editions.

What you get

Field	Description
title	Headline (the " - Publisher" suffix Google adds is removed)
publisher, publisherUrl	Source name and homepage, e.g. Reuters, https://www.reuters.com
publishedAt	Publish time in ISO 8601 (UTC)
url	Real article URL on the publisher's site
decodeFailed	true if the Google link couldn't be resolved (then url is the Google link)
googleNewsUrl	Original Google News link
description	Article description (from the publisher's page when full text is on)
query / topic	Which search query or topic found the article
locale	Edition, e.g. en-US:US, ar:SA
position, dateWindow	Rank in Google's feed and the day window it came from (null = main feed)
relatedArticles	For topic headlines: other outlets covering the same story (title, publisher, Google link)
scrapedAt	Timestamp

With full text on: articleTitle, author, articlePublishedAt, articleText, textLength, topImage, language, paywalled, fullTextStatus (ok, paywalled, blocked, no-text, failed, not-decoded) and fullTextError.

How to use

1. Enter search queries (Google News operators work: "exact phrase", OR, -word, site:bbc.com, intitle:) and/or pick topics (World, Nation, Business, Technology, Entertainment, Sports, Science, Health).
2. Choose the language and country (default en-US / US) and add more editions if needed, e.g. ar:SA, de:DE, en-GB:GB.
3. Pick a time range (past hour, 24 hours, 7 days, 30 days, year) or exact dates.
4. Optional: turn on full text. Click Start, then export to JSON, CSV, Excel or send to Google Sheets, Make, Zapier or n8n.

Input example

{
  "queries": ["openai", "\"electric vehicles\" site:reuters.com"],
  "topics": ["TECHNOLOGY"],
  "language": "en-US",
  "country": "US",
  "additionalLocales": ["ar:SA"],
  "timeRange": "7d",
  "maxArticlesPerQuery": 200,
  "decodeUrls": true,
  "extractFullText": true
}

Output example

{
  "title": "NASA Seeks US Industry Plans for Commercial Space Stations",
  "publisher": "NASA (.gov)",
  "publishedAt": "2026-10-09T18:13:04Z",
  "url": "https://www.nasa.gov/news-release/nasa-seeks-us-industry-plans-for-commercial-space-stations/",
  "decodeFailed": false,
  "googleNewsUrl": "https://news.google.com/rss/articles/CBMimAFBVV95cUxPemZaQm9…",
  "publisherUrl": "https://www.nasa.gov",
  "description": "NASA is advancing American leadership in space by taking the next step toward a future where commercial space stations lead the way in low Earth orbit. On",
  "query": "nasa",
  "topic": null,
  "locale": "en-US:US",
  "position": 1,
  "dateWindow": null,
  "relatedArticles": [],
  "articleTitle": "NASA Seeks US Industry Plans for Commercial Space Stations",
  "author": "Jessica Taveau",
  "articlePublishedAt": null,
  "articleText": "NASA is advancing American leadership in space by taking the next step toward a future where commercial space stations lead the way in low Earth orbit. On Friday, the agency released its final Request for Proposals inviting industry to submit plans for the …",
  "topImage": "https://www.nasa.gov/wp-content/uploads/2022/02/nasa_meatball_large.jpg",
  "language": "en-US",
  "paywalled": false,
  "textLength": 2897,
  "fullTextStatus": "ok",
  "fullTextError": null,
  "scrapedAt": "2026-10-10T14:41:25+00:00"
}

Pricing

Pay-per-result, platform usage included:

Event	Price
Article saved	$0.001 ($1 per 1,000)
Full text extracted (only when Extract full article text is on and text was found)	+$0.002

1,000 articles with URLs cost $1; with full text at most $3. Articles from paywalled or bot-protected sites, where no text could be read, are charged only the base $0.001. Cap any run with Max total charge — the scraper stops cleanly when it's reached.

FAQ

Why does Google News give only ~100 results? Each Google News RSS feed is capped at about 100 articles. With a time range of 1 day or longer, or with dates set, the scraper detects a full feed and repeats the search for each single day (newest first), so busy topics return hundreds or thousands of articles. Day boundaries follow Google's own (US Pacific time). Topic headline feeds can't be split — they return Google's current selection.

How are the URLs decoded? Old-style Google News links contain the URL and are decoded instantly. Current links are encrypted, so the scraper asks Google News itself to resolve them (the same request the Google News web app makes), in batches. In our tests 420 of 420 links (100%) resolved, including Arabic editions; any that don't are flagged with decodeFailed: true.

Why is full text missing for some articles? Some publishers (e.g. many large paywalled newspapers) block automated visitors or show only a preview. Those articles still come with title, source, date and URL, have fullTextStatus set to blocked or paywalled, and are not charged the full-text fee. A residential proxy can help for blocked sites.

Can I monitor news on a schedule? Yes — schedule the actor with time range Past 24 hours (or Past hour) and send results to a webhook, Google Sheets or Slack.

Is it legal? The scraper reads Google News' public RSS feeds and publicly accessible article pages, like a news reader. Article texts are copyrighted by their publishers: use them for analysis, monitoring and research, and check the publishers' terms before republishing content.

Related tools by DataKiln

• Telegram Channel Scraper — posts, views & reactions from public channels
• YouTube Channel Email Finder — creator emails, socials & stats
• YouTube Comments Scraper — comments, replies & likes
• Podcast Email Finder — host emails from Apple Podcasts RSS feeds
• TikTok Profile & Email Finder — bio, stats & contacts

Support

Missing a field, an edition that doesn't work or a site whose text isn't extracted well? Open an issue on the Issues tab — we usually reply within 24 hours.