Google News Scraper & API ($1/1k) 📰

📰 Google News Scraper & Full-Text RAG API: Direct Publisher URLs, Topics, Domains & Clean Article Text

---

---

📖 Overview

Google News indexes breaking journalism, earnings announcements, regulatory filings, product launches, and local reporting across tens of thousands of verified publishers worldwide.

Yet teams building AI/RAG pipelines, PR & brand crisis monitors, or financial sentiment models routinely hit three roadblocks with legacy Google News scrapers:

• Opaque news.google.com/rss/articles/CBMi... wrapper links instead of clean canonical publisher URLs (reuters.com, techcrunch.com, bbc.com), breaking downstream deduplication and article readers.
• Headline-only feeds with zero article body text, requiring a separate scraper to fetch articleText, author, and publishedDateIso.
• High per-call API fees ($15.00–$25.00 per 1,000 requests) that charge for empty queries and lack server-side domain allowlists (domains) or custom historical date windows (dateFrom / dateTo).

Google News Scraper by UnitBytes solves all three in a single 256 MB Actor — delivering unwrapped canonical urls, rich previews, curated topic sections (TECHNOLOGY, BUSINESS, WORLD, SCIENCE, HEALTH...), and optional full-text extraction from $1.00 per 1,000 articles ($0.001/article on Gold+, and $0.00 on empty queries or duplicates).

⚡ UnitBytes · Google News, Trends, Search, Jobs, Shopping, Travel & Maps Ecosystem
📰 Google News Scraper 📍 You are here (From $1/1K) Direct publisher URLs, topic feeds, domain filters & full text	🔥 Google Trending Now From $0.30/1K • Breaking Spikes +5,000% real-time surges & 5-in-1 Google Trends Scraper	💼 Google Jobs Scraper From $4/1K • Company Hiring Multi-board jobs, parsed salaries, logos & direct ATS links
🛍️ Google Shopping Scraper From $2/1K • Retail & MAP Live product prices, deals, seller offers & store checkout URLs	✈️ Google Flights & Hotels From $2.50/1K • Travel Rates Airfares & CO2 + Hotels & OTA Parity	📍 Google Maps Suite From $0.20/1K • Local & Reviews B2B Contacts, 10K Reviews & Reddit

---

🌟 Why AI/RAG, PR & Quantitative Teams Choose UnitBytes

Capability / Metric	UnitBytes Google News Scraper	Traditional News / SERP APIs	Basic RSS Scrapers
💰 Price per 1,000 Articles	From $1.00 ($0.001 / article)	$15.00 – $25.00 per 1K requests	$3.00 – $10.00 per 1K + compute
🔗 Direct Canonical Publisher URLs	✅ Unwrapped url + publisherDomain out of the box	✅ Supported	❌ Opaque news.google.com/rss/articles/CBMi... wrappers
📄 Full-Article Body Text (articleText)	✅ Built-in extractArticleContent: true (0 extra fee)	❌ Snippet only (requires 2nd scraper)	❌ Headline only
🎯 Domain Allowlist & Date Windows	✅ domains, 1h/24h/7d, custom dateFrom–dateTo	⚠️ Manual query syntax	⚠️ Limited pagination (~100 cap)
🗂️ Search + 9 Curated Topic Feeds	✅ Keyword search + TECHNOLOGY, BUSINESS, WORLD...	⚠️ Separate endpoints	⚠️ Topic RSS only
🛡️ Empty Search & Duplicate Item Fee	✅ $0.00 item fee (Zero article-scraped charge on 0 results or duplicates)	❌ Charged per API call on 0 results	⚠️ Duplicates across queries

---

💰 Transparent Pay-Per-Event Pricing ($1.00 / 1,000 Articles on All Plans)

This Actor uses flat Pay-Per-Event (PPE) billing across every Apify tier so you pay strictly $0.001 per unique news article delivered to your dataset — with optional full-article text (extractArticleContent: true) included at zero extra event fee.

Event	Event Name	Price per Unit	Price per 1,000	Notes
Article Scraped (All Plans)	article-scraped	$0.0010	$1.00 / 1,000 articles	Flat rate on Free, Starter, Scale & Business
Actor Run Start	apify-actor-start	$0.0050	$5.00 / 1,000 runs	One-time startup event per GB RAM (min. 1 event)
Empty Queries / Duplicates	—	$0.00 / item	$0.00 item fee	Zero article-scraped charge on 0 results or deduplicated stories

🎁 Up to ~4,990 Articles / Month Free on Apify's Free Tier: Every Apify account receives $5.00 in free monthly platform credits, covering up to ~4,990 unique Google News articles every month at $0.00 cost right on the Free Plan. Set a Maximum cost per run in Apify Console or cap maxArticles for exact budget control.

---

✨ Key Capabilities

• 🔗 Direct Publisher URLs (Unwrapped): Automatically resolves Google News links into clean, canonical external publisher URLs (url, publisherDomain, publisherUrl, publisherLogo).
• 🔍 Keyword Search & 9 Curated Topic Feeds: Search any list of keywords, company tickers, or executive names (queries), or pull live curated sections (TOP_HEADLINES, WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH).
• 🎯 100% Server-Side Filtering:
  • Recency (timeRange): Past hour (1h), 24 hours (24h), 7 days (7d), 30 days (30d), or past year (1y).
  • Custom Historical Window (dateFrom / dateTo): Exact YYYY-MM-DD date ranges.
  • Publisher Allowlist (domains): Restrict coverage to trusted outlets (e.g. ["reuters.com", "techcrunch.com", "bbc.com"]).
  • Boolean Precision: Enforce exactPhrase matches and excludeWords exclusions directly on Google's servers.
• 📄 Optional Full-Article RAG Mode (extractArticleContent): Visits publicly accessible publisher pages to extract clean plain-text body paragraphs (articleText), wordCount, author, high-resolution og:image, and ISO publication timestamps (publishedDateIso). (Note: Subscription-paywalled or bot-gated publisher domains still return complete Google News headline, snippet, publisher, timestamp, and direct URL metadata.)
• 🌍 35+ Country & Language Editions: Supports us, gb, de, fr, es, it, nl, ca, au, in, sg, jp, kr, br, mx, and 20+ additional editions with automatic natural-language matching.
• 🧠 Cross-Query Deduplication: Batch dozens of queries and topics in a single run without paying twice for overlapping coverage.

---

🚀 Quick Start Input Examples

1. Keyword Monitoring with Recency & Outlet Allowlist

{
  "queries": ["NVIDIA semiconductor", "AI data centers"],
  "domains": ["reuters.com", "techcrunch.com"],
  "timeRange": "7d",
  "sortBy": "date",
  "country": "us",
  "maxArticles": 50
}

2. Curated Topic Sections (TECHNOLOGY & BUSINESS)

{
  "topics": ["TECHNOLOGY", "BUSINESS"],
  "country": "gb",
  "decodeRssUrls": true,
  "maxArticles": 60
}

3. Full-Text Extraction for AI Agents & RAG Pipelines

{
  "queries": ["European Central Bank interest rates"],
  "timeRange": "24h",
  "extractArticleContent": true,
  "maxArticles": 25
}

---

🛠️ How to Use via API (Python, Node.js & cURL)

🐍 Python Example

$pip install apify-client

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_API_TOKEN")

run = client.actor("unitbytes/google-news-scraper").call(
    run_input={
        "queries": ["Artificial Intelligence", "Cloud Computing"],
        "timeRange": "24h",
        "country": "us",
        "extractArticleContent": True,
        "maxArticles": 30,
    }
)

items = client.dataset(run["defaultDatasetId"]).list_items().items
for art in items[:5]:
    print(f"[{art['publishedAt']}] {art['publisher']}: {art['title']}")
    print(f"  URL: {art['url']} ({art.get('wordCount') or 0} words)")

---

🟨 JavaScript / Node.js Example

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_API_TOKEN' });

const run = await client.actor('unitbytes/google-news-scraper').call({
    topics: ['TECHNOLOGY', 'BUSINESS'],
    country: 'us',
    decodeRssUrls: true,
    maxArticles: 40,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Extracted ${items.length} articles`, items.slice(0, 3));

---

🌐 cURL Example

curl -X POST "https://api.apify.com/v2/acts/unitbytes~google-news-scraper/runs?token=YOUR_APIFY_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "queries": ["renewable energy storage"],
    "timeRange": "7d",
    "country": "us",
    "maxArticles": 30
  }'

---

📦 Output Dataset Sample

Every item is flat at the root level for immediate CSV/Excel export, vector database indexing, and API consumption (all sample names and URLs below are synthetic illustrations):

{
  "articleId": "CPcBSvDhrPhUpM01",
  "title": "Next-Generation Grid Storage Deployments Double Across North America",
  "url": "https://cleanenergy-journal-example.com/2026/11/12/grid-storage-deployments-double",
  "googleNewsUrl": null,
  "publisher": "CleanEnergy Journal",
  "publisherDomain": "cleanenergy-journal-example.com",
  "publisherUrl": "https://cleanenergy-journal-example.com",
  "publisherLogo": "https://www.google.com/s2/favicons?domain=cleanenergy-journal-example.com&sz=64",
  "snippet": "Utility-scale battery installations expanded by 104% year-over-year as regional grid operators accelerated peak-load balancing programs...",
  "thumbnailUrl": "https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSampleThumbnailToken",
  "publishedAt": "2026-11-12T12:15:00+00:00",
  "publishedAtText": "2 hours ago",
  "publishedTimestamp": 1794485700,
  "author": "Alex Rivera",
  "articleText": "Utility-scale battery installations expanded by 104% year-over-year across North American interconnects...\n\nGrid planners cited declining lithium-iron-phosphate pack costs and streamlined interconnection queues...",
  "wordCount": 642,
  "publishedDateIso": "2026-11-12T12:15:00+00:00",
  "relatedCount": 0,
  "relatedArticles": [],
  "sourceSurface": "google_search_news",
  "searchQuery": "grid storage deployments",
  "topic": null,
  "country": "us",
  "language": "en",
  "scrapedAt": "2026-11-12T14:20:05.112000+00:00"
}

---

⚙️ Input Parameters Reference

Field	Type	Default	Description
queries	array	["Artificial Intelligence"] (prefill)	Search keywords, phrases, or Google News URLs.
topics	array	[]	Topic sections: TOP_HEADLINES, WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH.
domains	array	[]	Restrict results to specific publisher domains (e.g. ["reuters.com", "bbc.com"]).
exactPhrase	string	""	Require exact phrase match in stories.
excludeWords	array	[]	Exclude stories containing specified terms.
timeRange	string	"any"	Recency filter: any, 1h, 24h, 7d, 30d, 1y.
dateFrom / dateTo	string	""	Custom date bounds (YYYY-MM-DD). Overrides timeRange when provided.
sortBy	string	"relevance"	relevance (top coverage) or date (newest first).
country	string	"us"	2-letter ISO edition code (us, gb, de, fr, jp, br, etc.).
language	string	"" (auto)	ISO language code. Leave empty to match the natural language of country.
feedMode	string	"auto"	auto (recommended), search (rich previews & deep pagination), or rss (topic & cluster feeds).
extractArticleContent	boolean	false	Fetch full plain-text body, author, og:image, and publishedDateIso from accessible publisher pages.
decodeRssUrls	boolean	false	Resolve news.google.com/rss/articles/... links into direct publisher URLs in RSS/Topic mode.
maxArticles	integer	50	Maximum total unique articles to extract (1–5000).

---

📋 Copy-and-Paste Directive for AI Coding Assistants (Cursor, Windsurf & Claude Code)

"Use the unitbytes/google-news-scraper Actor on Apify to extract Google News articles, unwrapped publisher URLs, UTC timestamps, topic feeds, and clean full-article text (extractArticleContent: True) for RAG pipelines. Pair it with unitbytes/google-trending-now-scraper to detect rising news spikes first. Example call: client.actor('unitbytes/google-news-scraper').call(run_input={'queries': ['Artificial Intelligence'], 'timeRange': '24h', 'extractArticleContent': True, 'maxArticles': 25})"

---

🔌 MCP Server Setup: Claude Code, Cursor & AI Agents

{
  "mcpServers": {
    "apify": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=actors,docs,unitbytes/google-news-scraper,unitbytes/google-trending-now-scraper"
    }
  }
}

---

🌐 Complete UnitBytes Google, News & Market Intelligence Ecosystem

Actor	Best For	Pricing
Google News Scraper (📍 You are here)	Direct publisher URLs, recency/domain filters, curated topic feeds & optional clean full-article text	From $1.00 / 1K
Google Trends Trending Now Scraper	Real-time +5,000% breaking search spikes across 100+ countries (4h, 24h, 48h, 7d)	From $0.30 / 1K
Google Trends Scraper (5-in-1)	Historical interest over time, regional breakdowns, breakout queries & related topics	From $0.30 / 1K
YouTube Trends & Keyword Scraper	Rising YouTube video topics, creator keyword research & viewer regions	From $0.30 / 1K
Google Jobs Scraper	Corporate hiring signals, parsed salaries, employer logos & direct ATS apply links	From $4.00 / 1K
Google Shopping Scraper	Live retail product prices, discounts, multi-seller offers & direct checkout URLs	From $2.00 / 1K
Google Flights Scraper	Real-time airfares, carriers, flight numbers, stops, layovers & CO2 emissions	From $2.50 / 1K
Google Hotels Scraper	Nightly & total hotel/rental rates, multi-OTA price parity (Booking.com, Expedia), GPS & HD photos	From $2.50 / 1K
Google Maps Email & Leads Scraper	Verified B2B business emails, phones, social profiles & website tech stacks	From $1.00 / 1K
Google Maps Reviews Scraper	Bulk extraction of up to 10,000 customer reviews per place with keyword & rating filters	From $0.25 / 1K
Reddit Posts & Search Scraper	Community discussions, brand mentions, thread comments & organic consumer sentiment	From $0.50 / run

---

⚖️ Compliance & Privacy

This Actor indexes strictly publicly accessible news metadata and publicly readable publisher articles. All output sample names and domains are synthetic illustrations. Read Apify's guide on the legality of web scraping and respect publisher copyright and robots/terms policies in downstream usage.

Disclaimer

This Actor is an independent software tool and is not affiliated with, endorsed by, or sponsored by Google LLC or any news publisher.

---

🛠️ Integrations & Support

Connect Google News Scraper directly with Apify Integrations (Make, Zapier, n8n, LangChain, LlamaIndex, Google Sheets, Slack, webhooks) or call it programmatically via the Apify API.

Have feedback, edge-case queries, or feature requests?

• 💬 Apify Issues: Open a ticket in the Actor Issues Tab
• 🚀 Apify Store: Google News Scraper