Google News Scraper (RSS search by keyword, topic, site)

What is Google News Scraper?

Google News Scraper is an Apify Actor that reads Google News RSS search and section-topic feeds for any list of keywords, site: searches or when:Nd recency queries, and returns one clean row per article — title, source, publish date and the Google News link. No API key, no browser, no anti-bot wall: Google's own public news.google.com/rss/* feeds do the work. When Resolve publisher URLs is on, the Actor also follows each article's news.google.com/rss/articles/... redirect link and resolves the publisher's real URL (see "Publisher URL resolution" below) instead of leaving you with a Google-branded link nobody wants to click.

What data does Google News Scraper extract?

Google News Scraper extracts 11 fields per article:

Field	Type	Description
query	string	The search query, or topic:NAME, this article came from
title	string	Headline as shown by Google News (often "Headline - Publisher")
googleUrl	string	The news.google.com/rss/articles/... link from the feed
publisherUrl	string|null	The article's real URL on the publisher's own site, resolved best-effort
source, sourceUrl	string	Publisher name and homepage, from the feed's <source> tag
publishedAt	string	Publish date/time (ISO 8601 UTC)
snippet	string|null	Plain text derived from the feed's description
guid	string	The feed's stable item id, used to dedupe articles across overlapping queries
error, scrapedAt	string	Per-query failure note and check timestamp

How to use Google News Scraper

1. Enter one or more Search queries — plain keywords, or Google operators like site:reuters.com AI or "exact phrase". Add Section topics (TECHNOLOGY, BUSINESS, WORLD…) if you also want whole-section feeds.
2. Set Only articles from the last N days if you want a recency window (adds Google's when:Nd operator to every query).
3. Leave Resolve publisher URLs on to get the real article link, click Start, then export as JSON, CSV, Excel or HTML.

Example input

{
    "queries": ["web scraping", "site:reuters.com AI"],
    "topics": ["TECHNOLOGY"],
    "sinceDays": 7,
    "resolvePublisherUrls": true,
    "maxItemsPerQuery": 50
}

Example output

{
    "query": "web scraping",
    "title": "EDPB web scraping guidelines for AI: Making the impossible possible? - Reed Smith LLP",
    "googleUrl": "https://news.google.com/rss/articles/CBMi3AFBVV95cUxOTUxq...?oc=5",
    "publisherUrl": "https://www.reedsmith.com/our-insights/blogs/technology-law-dispatch/102nbqu/edpb-web-scraping-guidelines-for-ai-making-the-impossible-possible/",
    "source": "Reed Smith LLP",
    "sourceUrl": "https://www.reedsmith.com",
    "publishedAt": "2026-07-14T07:00:00.000Z",
    "snippet": "EDPB web scraping guidelines for AI: Making the impossible possible? Reed Smith LLP",
    "guid": "CBMi3AFBVV95cUxOTUxq...",
    "error": null,
    "scrapedAt": "2026-09-13T00:00:00.000Z"
}

Input parameters

Parameter	Type	Default	Description
queries	array	["web scraping"]	Search terms/operators, one Google News search feed per entry
topics	array	[]	Section topics: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SCIENCE, SPORTS, HEALTH
language / country	string	en / US	Interface language and edition (builds hl/gl/ceid)
sinceDays	integer	0	Adds when:Nd to searches; 0 disables it (topics ignore it)
maxItemsPerQuery	integer	100	Cap per query/topic (Google itself rarely returns more than ~100)
resolvePublisherUrls	boolean	true	Resolve the real publisher URL (2 extra requests/article)
maxConcurrency	integer	5	Parallel feed fetches, and parallel URL resolutions (1-20)

Pricing

Google News Scraper uses pay-per-event pricing: $0.0005 per article result, i.e. $0.50 per 1,000 articles, plus a negligible actor-start fee. A single feed request typically returns dozens of articles for a fraction of a cent; resolving publisher URLs adds two extra requests per article but no extra dataset charge. Set Maximum cost per run and the Actor trims the result list to what the budget covers instead of overspending.

Google News Scraper vs. manual Google News browsing

Reading Google News by hand means opening dozens of tabs and copy-pasting headlines one at a time, and every article link is a Google-branded redirect you cannot drop into a report. This Actor takes a whole list of keywords, sites and topics in one run, returns a flat structured dataset, resolves the real publisher link, and can be scheduled to catch new coverage the moment it appears.

Using Google News Scraper with AI agents and MCP

Google News Scraper is pay-per-event with limited permissions — the two requirements for an Actor to be callable through the Apify MCP server at mcp.apify.com. An agent passes queries or topics and gets back one structured row per article — headline, source, publish date, and (best-effort) the real publisher link — ready to feed into a summarizer, a lead-monitoring workflow or a competitor-tracking pipeline. The same run works from n8n, Make, Zapier and LangChain through Apify's integrations.

FAQ

How does publisher URL resolution work? Google's feed link is never the publisher's own URL — it is a news.google.com/rss/articles/<id> redirect that answers a 302 pointing back to itself, then a client-rendered page. This Actor fetches that page, extracts the data-n-a-id/data-n-a-ts/data-n-a-sg values Google embeds in it, and posts them to Google's internal redirect-resolution endpoint to get the real URL back. This is an undocumented internal API, verified live but not published by Google — it can break without notice if Google changes the page or endpoint shape, in which case affected rows simply get publisherUrl: null and keep everything else.

Why is publisherUrl null on some rows? Either Resolve publisher URLs was off, the resolution request failed or timed out, or Google's page/endpoint shape changed since this Actor was last verified. The row still ships with its Google News link, title, source and date.

Does when:Nd apply to section topics? No — topic feeds (topics[]) are always "latest for that section"; the recency filter only applies to queries[] searches, where it is a genuine Google search operator (verified live: site:reuters.com AI when:7d returned only reuters.com articles from the prior week).

What are the limitations? Google's feeds return at most roughly 100 items per request with no further pagination, so a very broad query is naturally capped. Google News' own copyright notice restricts the feed to personal, non-commercial feed-reader use; treat bulk/commercial reuse of the underlying articles as your responsibility. A failing query still produces one row, with the reason in error.

Is this legal to run? The RSS feeds are Google's own public syndication format. Downstream use of the article text/links is subject to Google's feed terms and each publisher's own copyright — this Actor only extracts metadata and links, it does not copy article bodies.

Can I export to CSV or Excel? Yes, from the Output tab or the API, with a ready-made Overview view.

Related Actors

Part of the webdatatools web-intelligence suite — every Actor is pay-per-event, reads public data without a login, and returns one clean row per entity:

Browse the whole suite at webdatatools, or call ten of these Actors straight from Claude, Cursor or Cline with the webdatatools MCP server.

Website & domain intelligence

• Email Extractor — Website Contact & Social Finder — e-mails, phones and social profiles per domain
• Tech Stack Detector — Wappalyzer & BuiltWith Alternative — CMS, e-commerce, analytics, pixels and payments per domain
• Domain DNS & Email Security Checker — SPF, DKIM, DMARC, MX provider, registrar and domain age
• Domain Security Audit (TLS, HTTP headers, redirects, robots) — TLS expiry, security headers, redirect chain, robots and llms.txt
• Subdomain Finder (Certificate Transparency) — every subdomain seen in CT logs, with a live DNS check
• Bulk Core Web Vitals & PageSpeed Audit — Lighthouse scores, LCP, CLS, INP and top fixes per URL
• On-Page SEO Audit — title, meta, headings, links, images and schema issues per page
• Sitemap URL Extractor & Change Monitor — every sitemap URL, or new and removed pages between runs
• Wayback Machine Snapshot & Page Change Tracker — how a page changed over time, or every archived snapshot
• Bulk Domain WHOIS & RDAP Lookup — registrar, dates, status and nameservers per domain
• Web Scraper — CSS Selector & Data Extractor — pull any CSS selector off any page, one row per URL
• Website Screenshot Generator — full-page or viewport PNG/JPEG screenshots of any URL

Content for AI, LLMs and RAG

• AI Web Search & Read: Google results as clean Markdown — a query turned into clean Markdown from the top search results
• Website to Markdown — Content Crawler for LLM & RAG — any site as clean Markdown per page, no browser
• Article & News Extractor (clean text, author, date, markdown) — clean article text, author, date and Markdown per URL
• Structured Data & JSON-LD Extractor (Schema.org, Open Graph) — Schema.org and Open Graph data from any page
• Press Release Monitor: PR Newswire, BusinessWire, GlobeNewswire — PR Newswire, Business Wire and GlobeNewswire releases

Search, video and social

• YouTube Shorts Scraper — Shorts from channels, hashtags and searches with view counts
• Pinterest Pins Scraper — latest pins of public Pinterest profiles and boards
• YouTube Transcript Scraper — captions and subtitles as text + timed segments, per video or channel
• Google Search Results Scraper — SERP API — organic SERP results per keyword and country
• YouTube Comments Scraper — Comments & Replies — comments and replies with likes, no API key
• YouTube Channel Latest Videos (RSS, no API key) — the latest 15 videos of any channel from RSS
• YouTube Channel Scraper (videos, shorts, live) — a channel's full video, shorts and stream list
• YouTube Search Results Scraper (videos, channels, no API key) — videos, channels and playlists per query
• YouTube Video Details Scraper (views, likes, description, tags) — views, likes, description, tags and chapters per video
• Apple Podcasts Lookup & Episodes Scraper — podcast metadata and episodes from iTunes and RSS
• Bluesky Post, Search & Profile Scraper — posts, profiles, followers and threads from the AT Protocol API
• Telegram Channel Posts Scraper — posts, views and media flags from any public channel
• Substack Publication & Posts Scraper — archive, authors and paywall status per publication
• Google Play Reviews Scraper — reviews, ratings, replies and app versions per app
• App Store Reviews Scraper — iOS reviews and ratings per app and country
• Google Trends Scraper — interest over time, by region, and related queries per keyword
• Google Ads Transparency Scraper — ads any advertiser runs on Google, with format and dates
• Keyword Suggestions Scraper (Google, YouTube, Amazon, Bing) — autocomplete keyword ideas from four search engines
• Bilibili Scraper (Videos, Search, Popular) — Chinese video platform: views, likes, coins, danmaku, uploader
• Mastodon Scraper (Hashtags, Accounts, Trending) — public fediverse posts by hashtag, account or trending
• Meetup Events Scraper (Search by Keyword & City) — upcoming events with RSVPs, fees, venues and groups
• Eventbrite Scraper (Events by Keyword & City) — events by keyword and city with venue, dates and organizer

Leads, jobs and company data

• Career Site Jobs API (Greenhouse, Lever, Ashby, Workday +1) — company domains in, their open jobs out, ATS detected automatically
• Workday Jobs Scraper — jobs with full descriptions from any Workday career site
• Google Maps Scraper — businesses with phone, website, address, rating and coordinates per search
• LinkedIn Jobs Scraper — job titles, companies, locations and full descriptions from LinkedIn job search
• Company 360: full company profile from a domain — one row per domain: contacts, tech, security, hiring and company facts
• Hiring Signals Scraper (Greenhouse, Lever, Ashby, Workable) — open jobs and hiring velocity from 10 public ATS boards
• Y Combinator Companies & Founders Scraper — YC startups by batch, industry and hiring status
• Wikidata Entity & Company Enrichment (facts, IDs, links) — HQ, founders, employees, revenue and social IDs per company
• Email Validator & Verifier — Bulk Email Check — syntax, MX, disposable, role and free-provider checks
• OpenStreetMap POI Extractor (Overpass API: shops, amenities) — shops and amenities by radius, bbox or area
• Stock, Crypto & FX Quotes — one row per symbol from Yahoo, Binance and ECB rates
• Remote Jobs Aggregator (RemoteOK, WWR, Hacker News) — one clean row per remote job, de-duplicated across feeds
• Greenhouse Jobs Scraper — jobs with descriptions from any Greenhouse job board
• Lever Jobs Scraper — jobs with descriptions from any Lever careers page
• Ashby Jobs Scraper — jobs, salaries and descriptions from any Ashby job board
• SmartRecruiters Jobs Scraper — jobs with descriptions from any SmartRecruiters company
• Seek Jobs Scraper (Australia & New Zealand) — Seek job ads with salary, work type and location
• Dice Jobs Scraper — US tech jobs from Dice with salary and remote flag
• AutoScout24 Scraper — European car listings with price, mileage and seller
• Rightmove Scraper — UK property for sale or rent with price and agent
• Wellfound Jobs Scraper (AngelList Startup Jobs) — startup jobs with salary and equity ranges, company size and stage
• Yandex Maps Scraper (Places, Ratings, Phones) — businesses in Russia, Türkiye and the CIS with phones, ratings, hours
• Craigslist Scraper (Listings, Prices, Locations) — listings in any area and category with price, date and coordinates
• JobStreet Scraper (Malaysia, Singapore, PH, ID + JobsDB) — JobStreet and JobsDB jobs in 6 Asian countries with parsed salaries
• InfoJobs Scraper (Spain Jobs, Salaries, Companies) — Spanish jobs with salary range, contract type and full description
• Redfin Scraper (Homes for Sale, Prices, Details) — US homes for sale or sold from any Redfin search, with price and details
• Kleinanzeigen Scraper (Ads, Prices, Locations) — German classifieds with price, VB flag, ZIP, city and seller type

Developer, app and research data

• npm, PyPI & Crates.io Package Health Checker — releases, downloads, deprecation and a health score
• GitHub Repository Health & Activity Report — stars, commits, contributors and risk flags per repo
• VS Code Marketplace Extension Scraper (installs, ratings) — installs, ratings and versions per extension
• Chrome Web Store Extension Scraper (installs, ratings) — users, rating, version and developer per extension
• Google Play Scraper — apps, ratings, installs, developer contact and reviews
• App Store (iOS) App Metadata, Ratings & Top Charts Lookup — ratings, price, version and charts per app
• CrossRef DOI & Citation Metadata Lookup — papers, authors, journals and citation counts
• FDA Recalls & Adverse Events Monitor (openFDA) — food, drug and device recalls from openFDA
• iCal / ICS Calendar Feed to Events Extractor — any public calendar feed as event rows
• Shopify Store Products Scraper — catalog, prices, variants and stock per store
• Hacker News Search & Front Page Scraper — stories, comments and points by query or front page
• GitHub Trending Repositories Scraper — trending repos and developers by language and period
• Stack Overflow & Stack Exchange Q&A Scraper — questions, answers and scores by query, tag or site
• Bulk Image Downloader — download image URLs to storage with size, dimensions and a ZIP
• Google Flights Scraper (Prices, Airlines, Stops) — flight prices, airlines, times, stops and CO2 by route and date
• Google Hotels Scraper (Prices, Ratings, Reviews) — hotel prices per night, stars, rating and reviews by city and dates
• AliExpress Scraper (Search Products & Prices) — AliExpress search results with USD price, discount and rank
• Lazada Scraper (Products, Prices, Sold, Ratings) — Lazada products in 6 countries with price, rating, units sold and seller

Support and feedback

Found a topic Google added, a feed shape that changed, or a resolution bug? Open an issue on the Issues tab.