Google News Scraper (Keyword, Topic, Site, Date Range)

What is Google News Scraper?

Google News Scraper is an Apify Actor that searches Google News for any list of keywords, site: searches or section topics — with past-hour/day/week/month/year presets, excluded words and more than 100 articles per query via date splitting — and returns one clean row per article for $0.50 per 1,000 articles — title, source, publish date and the Google News link. No API key, no browser, no anti-bot wall: it reads Google's own public news feeds (news.google.com/rss/*), which answer in well under a second and need no proxy. When Resolve publisher URLs is on, the Actor also follows each article's news.google.com/rss/articles/... redirect link and resolves the publisher's real URL (see "Publisher URL resolution" below) instead of leaving you with a Google-branded link nobody wants to click.

What data does Google News Scraper extract?

Google News Scraper extracts 11 fields per article:

Field	Type	Description
query	string	The search query, or topic:NAME, this article came from
title	string	Headline as shown by Google News (often "Headline - Publisher")
googleUrl	string	The news.google.com/rss/articles/... link from the feed
publisherUrl	string|null	The article's real URL on the publisher's own site, resolved best-effort
source, sourceUrl	string	Publisher name and homepage, from the feed's <source> tag
publishedAt	string	Publish date/time (ISO 8601 UTC)
snippet	string|null	Plain text derived from the feed's description
guid	string	The feed's stable item id, used to dedupe articles across overlapping queries
error, scrapedAt	string	Per-query failure note and check timestamp

How to use Google News Scraper

1. Enter one or more Search queries — plain keywords, or Google operators like site:reuters.com AI or "exact phrase". Add Section topics (TECHNOLOGY, BUSINESS, WORLD…) if you also want whole-section feeds.
2. Pick a Time range preset (past hour, 24 hours, 7 days, 30 days or year) or Only articles from the last N days, and optionally Exclude words.
3. Need more than ~100 articles for one search? Turn on Split by date and raise Max items per query.
4. Leave Resolve publisher URLs on to get the real article link, click Start, then export as JSON, CSV, Excel or HTML.

Example input

{
    "queries": ["web scraping", "site:reuters.com AI"],
    "topics": ["TECHNOLOGY"],
    "sinceDays": 7,
    "resolvePublisherUrls": true,
    "maxItemsPerQuery": 50
}

Example output

{
    "query": "web scraping",
    "title": "EDPB web scraping guidelines for AI: Making the impossible possible? - Reed Smith LLP",
    "googleUrl": "https://news.google.com/rss/articles/CBMi3AFBVV95cUxOTUxq...?oc=5",
    "publisherUrl": "https://www.reedsmith.com/our-insights/blogs/technology-law-dispatch/102nbqu/edpb-web-scraping-guidelines-for-ai-making-the-impossible-possible/",
    "source": "Reed Smith LLP",
    "sourceUrl": "https://www.reedsmith.com",
    "publishedAt": "2026-07-14T07:00:00.000Z",
    "snippet": "EDPB web scraping guidelines for AI: Making the impossible possible? Reed Smith LLP",
    "guid": "CBMi3AFBVV95cUxOTUxq...",
    "error": null,
    "scrapedAt": "2026-09-13T00:00:00.000Z"
}

Input parameters

Parameter	Type	Default	Description
queries	array	["web scraping"]	Search terms/operators, one Google News search feed per entry
topics	array	[]	Section topics: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SCIENCE, SPORTS, HEALTH
language / country	string	en / US	Interface language and edition (builds hl/gl/ceid)
sinceDays	integer	0	Adds when:Nd to searches; 0 disables it (topics ignore it)
timeRange	string	—	1h, 1d, 7d, 1m (30 days) or 1y; overrides sinceDays
excludeWords	array	—	Words/phrases to exclude (-word on every search query)
splitByDate	boolean	false	Split each search into date windows to get past ~100 per request
maxItemsPerQuery	integer	100	Cap per query/topic (1-1000; above ~100 needs splitByDate)
maxItems	integer	—	Cap for the whole run (newest kept)
resolvePublisherUrls	boolean	true	Resolve the real publisher URL (2 extra requests/article)
maxConcurrency	integer	5	Parallel feed fetches, and parallel URL resolutions (1-20)

Pricing

Google News Scraper uses pay-per-event pricing: $0.0005 per article result, i.e. $0.50 per 1,000 articles, plus a negligible actor-start fee. A single feed request typically returns dozens of articles for a fraction of a cent; resolving publisher URLs adds two extra requests per article but no extra dataset charge. Set Maximum cost per run and the Actor trims the result list to what the budget covers instead of overspending.

Price comparison. On 9 October 2026 the two Google News scrapers with the most monthly users in the Apify Store listed $0.004 and $0.005 per article ($4–$5 per 1,000). This Actor is $0.0005 per article — 1,000 articles cost $0.50 here and $4–$5 there.

Time ranges, exclusions and more than 100 articles per query

Time range presets. timeRange adds Google's when: operator: 1h (past hour), 1d, 7d, 1m (past 30 days — Google ignores when:1m, so it is sent as when:30d) and 1y. Checked live on 9 October 2026: bitcoin with 1h returned 47 articles, all from the last hour. timeRange overrides sinceDays; topic feeds ignore both.

Exclude words. excludeWords: ["ETF", "price prediction"] adds -ETF -"price prediction" to every search query.

More than ~100 articles per query. One Google News request returns at most about 100 articles. With splitByDate on, each search query is split into date windows (after:/before:) across the time range (or sinceDays, else the last 30 days), newest window first; articles are deduped across windows and the newest maxItemsPerQuery are kept. In a cloud run on 9 October 2026, bitcoin with timeRange: "7d", excludeWords: ["ETF"], splitByDate: true and maxItemsPerQuery: 150 fetched 3 date windows, found 300 unique articles and saved the newest 150 (none with "ETF" in the title) in about one second. Windows are whole days, so the time range needs to be 2 days or more; maxItems caps the whole run.

Google News Scraper vs. manual Google News browsing

Reading Google News by hand means opening dozens of tabs and copy-pasting headlines one at a time, and every article link is a Google-branded redirect you cannot drop into a report. This Actor takes a whole list of keywords, sites and topics in one run, returns a flat structured dataset, resolves the real publisher link, and can be scheduled to catch new coverage the moment it appears.

Using Google News Scraper with AI agents and MCP

Google News Scraper is pay-per-event with limited permissions — the two requirements for an Actor to be callable through the Apify MCP server at mcp.apify.com. An agent passes queries or topics and gets back one structured row per article — headline, source, publish date, and (best-effort) the real publisher link — ready to feed into a summarizer, a lead-monitoring workflow or a competitor-tracking pipeline. The same run works from n8n, Make, Zapier and LangChain through Apify's integrations.

Short timeouts never lose results. When the run's timeout is close (the last 10 s, or 5 % of a longer run, at most 2 min) the Actor stops fetching feeds and resolving publisher links, saves every article it has (unresolved ones with publisherUrl: null) and the run ends SUCCEEDED — not TIMED-OUT — with a status message such as Stopped early before the run timeout: all 499 article(s) saved, publisher URL resolved for 129/499…. Read the run's statusMessage to tell a complete result from a partial one.

Sizing a run. Reading the feeds takes a few seconds; resolving publisher URLs is the slow part at roughly 5–10 articles per second with the default maxConcurrency of 5. 5 queries × 100 articles with resolving on need about 1–2 minutes; with resolvePublisherUrls off the same run finishes in seconds. maxTotalChargeUsd caps the cost — the Actor keeps only as many (newest) articles as the budget covers and says so in the status message.

FAQ

How does publisher URL resolution work? Google's feed link is never the publisher's own URL — it is a news.google.com/rss/articles/<id> redirect that answers a 302 pointing back to itself, then a client-rendered page. This Actor fetches that page, extracts the data-n-a-id/data-n-a-ts/data-n-a-sg values Google embeds in it, and posts them to Google's internal redirect-resolution endpoint to get the real URL back. This is an undocumented internal API, verified live but not published by Google — it can break without notice if Google changes the page or endpoint shape, in which case affected rows simply get publisherUrl: null and keep everything else.

Why is publisherUrl null on some rows? Either Resolve publisher URLs was off, the resolution request failed or timed out, or Google's page/endpoint shape changed since this Actor was last verified. The row still ships with its Google News link, title, source and date.

Does when:Nd apply to section topics? No — topic feeds (topics[]) are always "latest for that section"; the recency filter only applies to queries[] searches, where it is a genuine Google search operator (verified live: site:reuters.com AI when:7d returned only reuters.com articles from the prior week).

What are the limitations? One Google News request returns at most about 100 articles; for more, turn on splitByDate (see below). Topic feeds are always the latest ~100 headlines and are not split. Google News' own copyright notice restricts the feed to personal, non-commercial feed-reader use; treat bulk/commercial reuse of the underlying articles as your responsibility. A failing query still produces one row, with the reason in error.

Is this legal to run? The RSS feeds are Google's own public syndication format. Downstream use of the article text/links is subject to Google's feed terms and each publisher's own copyright — this Actor only extracts metadata and links, it does not copy article bodies.

Can I export to CSV or Excel? Yes, from the Output tab or the API, with a ready-made Overview view.

Related Actors

Part of the webdatatools web-intelligence suite — every Actor is pay-per-event, reads public data without a login, and returns one clean row per entity:

Browse the whole suite at webdatatools, or call ten of these Actors straight from Claude, Cursor or Cline with the webdatatools MCP server.

Website & domain intelligence

• Email Extractor — Website Contact & Social Finder — e-mails, phones and social profiles per domain
• Tech Stack Detector — Wappalyzer & BuiltWith Alternative — CMS, e-commerce, analytics, pixels and payments per domain
• Domain DNS & Email Security Checker — SPF, DKIM, DMARC, MX provider, registrar and domain age
• Domain Security Audit (TLS, HTTP headers, redirects, robots) — TLS expiry, security headers, redirect chain, robots and llms.txt
• Subdomain Finder (Certificate Transparency) — every subdomain seen in CT logs, with a live DNS check
• Bulk Core Web Vitals & PageSpeed Audit — Lighthouse scores, LCP, CLS, INP and top fixes per URL
• On-Page SEO Audit — title, meta, headings, links, images and schema issues per page
• Sitemap URL Extractor & Change Monitor — every sitemap URL, or new and removed pages between runs
• Wayback Machine Snapshot & Page Change Tracker — how a page changed over time, or every archived snapshot
• Bulk Domain WHOIS & RDAP Lookup — registrar, dates, status and nameservers per domain
• Web Scraper — CSS Selector & Data Extractor — pull any CSS selector off any page, one row per URL
• Website Screenshot Generator — full-page or viewport PNG/JPEG screenshots of any URL

Content for AI, LLMs and RAG

• AI Web Search & Read: Google results as clean Markdown — a query turned into clean Markdown from the top search results
• Website to Markdown — Content Crawler for LLM & RAG — any site as clean Markdown per page, no browser
• llms.txt Generator (Website to llms.txt & llms-full.txt) — llms.txt and llms-full.txt for any website or docs site
• PDF to Markdown Converter (Text, Headings, Metadata) — PDF files to clean Markdown with headings, metadata and token counts
• RAG Text Chunker (Markdown to Chunks, Token Counts) — heading-aware RAG chunks with exact GPT token counts from any dataset
• Article & News Extractor (clean text, author, date, markdown) — clean article text, author, date and Markdown per URL
• Structured Data & JSON-LD Extractor (Schema.org, Open Graph) — Schema.org and Open Graph data from any page
• Press Release Monitor: PR Newswire, BusinessWire, GlobeNewswire — PR Newswire, Business Wire and GlobeNewswire releases

Search, video and social

• YouTube Shorts Scraper — Shorts from channels, hashtags and searches with view counts
• Pinterest Pins Scraper — latest pins of public Pinterest profiles and boards
• YouTube Transcript Scraper — captions and subtitles as text + timed segments, per video or channel
• Google Search Results Scraper — SERP API — organic SERP results per keyword and country
• YouTube Comments Scraper — Comments & Replies — comments and replies with likes, no API key
• YouTube Channel Latest Videos (RSS, no API key) — the latest 15 videos of any channel from RSS
• YouTube Channel Scraper (videos, shorts, live) — a channel's full video, shorts and stream list
• YouTube Search Results Scraper (videos, channels, no API key) — videos, channels and playlists per query
• YouTube Video Details Scraper (views, likes, description, tags) — views, likes, description, tags and chapters per video
• Apple Podcasts Lookup & Episodes Scraper — podcast metadata and episodes from iTunes and RSS
• Bluesky Post, Search & Profile Scraper — posts, profiles, followers and threads from the AT Protocol API
• X Tweet Scraper (Twitter Posts by URL, No Login) — X (Twitter) posts by URL with likes, replies, author, media and MP4 links
• TikTok Profile Scraper (Followers, Likes, Bio, Video Stats) — TikTok profiles with exact follower and like counts, plus video stats
• Telegram Channel Posts Scraper — posts, views and media flags from any public channel
• Substack Publication & Posts Scraper — archive, authors and paywall status per publication
• Google Play Reviews Scraper — reviews, ratings, replies and app versions per app
• App Store Reviews Scraper — iOS reviews and ratings per app and country
• Trustpilot Reviews Scraper (Ratings, Replies, No Login) — Trustpilot reviews with stars, full text, verification and company replies
• Google Trends Scraper — interest over time, by region, and related queries per keyword
• Google Ads Transparency Scraper — ads any advertiser runs on Google, with format and dates
• Keyword Suggestions Scraper (Google, YouTube, Amazon, Bing) — autocomplete keyword ideas from four search engines
• Bilibili Scraper (Videos, Search, Popular) — Chinese video platform: views, likes, coins, danmaku, uploader
• Mastodon Scraper (Hashtags, Accounts, Trending) — public fediverse posts by hashtag, account or trending
• Meetup Events Scraper (Search by Keyword & City) — upcoming events with RSVPs, fees, venues and groups
• Eventbrite Scraper (Events by Keyword & City) — events by keyword and city with venue, dates and organizer

Leads, jobs and company data

• Career Site Jobs API (Greenhouse, Lever, Ashby, Workday +1) — company domains in, their open jobs out, ATS detected automatically
• Workday Jobs Scraper — jobs with full descriptions from any Workday career site
• Google Maps Scraper — businesses with phone, website, address, rating and coordinates per search
• 2GIS Places Scraper (Phones, Websites, Ratings, Hours) — 2GIS businesses in Russia, Kazakhstan, UAE and more with phones, website, rating and hours
• LinkedIn Jobs Scraper — job titles, companies, locations and full descriptions from LinkedIn job search
• Company 360: full company profile from a domain — one row per domain: contacts, tech, security, hiring and company facts
• Hiring Signals Scraper (Greenhouse, Lever, Ashby, Workable) — open jobs and hiring velocity from 10 public ATS boards
• Y Combinator Companies & Founders Scraper — YC startups by batch, industry and hiring status
• Wikidata Entity & Company Enrichment (facts, IDs, links) — HQ, founders, employees, revenue and social IDs per company
• Email Validator & Verifier — Bulk Email Check — syntax, MX, disposable, role and free-provider checks
• OpenStreetMap POI Extractor (Overpass API: shops, amenities) — shops and amenities by radius, bbox or area
• Stock, Crypto & FX Quotes — one row per symbol from Yahoo, Binance and ECB rates
• Yahoo Finance Scraper (Quotes, Fundamentals, Financials, News) — Yahoo Finance fundamentals, analyst targets, financial statements, ownership, news and history per ticker
• DexScreener Scraper (DEX Pairs, Prices, Liquidity, Boosts) — DEX pairs with price, volume, liquidity, FDV and boosted tokens across chains
• Polymarket Scraper (Prediction Markets, Odds, Volume) — Polymarket markets and events with outcome prices, volume and liquidity
• StockTwits Scraper (Messages, Sentiment, Trending) — StockTwits messages with Bullish/Bearish sentiment and trending symbols
• Economic Calendar Scraper (Forex Events, Impact, Forecasts) — This week's macro events with impact, forecast and previous values
• Crypto Fear & Greed Index — Daily Crypto Fear & Greed Index values with full history
• Remote Jobs Aggregator (RemoteOK, WWR, Hacker News) — one clean row per remote job, de-duplicated across feeds
• Greenhouse Jobs Scraper — jobs with descriptions from any Greenhouse job board
• Lever Jobs Scraper — jobs with descriptions from any Lever careers page
• Ashby Jobs Scraper — jobs, salaries and descriptions from any Ashby job board
• SmartRecruiters Jobs Scraper — jobs with descriptions from any SmartRecruiters company
• Seek Jobs Scraper (Australia & New Zealand) — Seek job ads with salary, work type and location
• Dice Jobs Scraper — US tech jobs from Dice with salary and remote flag
• AutoScout24 Scraper — European car listings with price, mileage and seller
• Rightmove Scraper — UK property for sale or rent with price and agent
• Wellfound Jobs Scraper (AngelList Startup Jobs) — startup jobs with salary and equity ranges, company size and stage
• Yandex Maps Scraper (Places, Ratings, Phones) — businesses in Russia, Türkiye and the CIS with phones, ratings, hours
• Craigslist Scraper (Listings, Prices, Locations) — listings in any area and category with price, date and coordinates
• JobStreet Scraper (Malaysia, Singapore, PH, ID + JobsDB) — JobStreet and JobsDB jobs in 6 Asian countries with parsed salaries
• InfoJobs Scraper (Spain Jobs, Salaries, Companies) — Spanish jobs with salary range, contract type and full description
• StepStone Scraper (Germany, Austria, Belgium Jobs) — StepStone jobs in Germany, Austria and Belgium by keyword and city
• Naukri Jobs Scraper (Salary, Skills, Company Rating) — Naukri.com jobs in India with salary range, experience, skills and company rating
• Zillow Scraper (Homes for Sale, Rent & Sold, Zestimates) — Zillow homes for sale, rent or sold with Zestimates, beds, baths and photos
• Zillow Home Details Scraper (Description, Photos, History) — full Zillow property pages: description, photos, HOA, tax rate, agent
• Redfin Scraper (Homes for Sale, Prices, Details) — US homes for sale or sold from any Redfin search, with price and details
• Kleinanzeigen Scraper (Ads, Prices, Locations) — German classifieds with price, VB flag, ZIP, city and seller type

Developer, app and research data

• npm, PyPI & Crates.io Package Health Checker — releases, downloads, deprecation and a health score
• GitHub Repository Health & Activity Report — stars, commits, contributors and risk flags per repo
• VS Code Marketplace Extension Scraper (installs, ratings) — installs, ratings and versions per extension
• Chrome Web Store Extension Scraper (installs, ratings) — users, rating, version and developer per extension
• Google Play Scraper — apps, ratings, installs, developer contact and reviews
• App Store (iOS) App Metadata, Ratings & Top Charts Lookup — ratings, price, version and charts per app
• CrossRef DOI & Citation Metadata Lookup — papers, authors, journals and citation counts
• FDA Recalls & Adverse Events Monitor (openFDA) — food, drug and device recalls from openFDA
• iCal / ICS Calendar Feed to Events Extractor — any public calendar feed as event rows
• Shopify Store Products Scraper — catalog, prices, variants and stock per store
• Hacker News Search & Front Page Scraper — stories, comments and points by query or front page
• GitHub Trending Repositories Scraper — trending repos and developers by language and period
• Stack Overflow & Stack Exchange Q&A Scraper — questions, answers and scores by query, tag or site
• Bulk Image Downloader — download image URLs to storage with size, dimensions and a ZIP
• Google Flights Scraper (Prices, Airlines, Stops) — flight prices, airlines, times, stops and CO2 by route and date
• Google Hotels Scraper (Prices, Ratings, Reviews) — hotel prices per night, stars, rating and reviews by city and dates
• Booking.com Scraper (Hotel Prices, Ratings, Availability) — Booking.com hotels for any city and dates with prices, scores and deals
• Airbnb Scraper (Listings, Prices, Ratings, Coordinates) — Airbnb stays for any city and dates with prices, ratings and coordinates
• AliExpress Scraper (Search Products & Prices) — AliExpress search results with USD price, discount and rank
• Lazada Scraper (Products, Prices, Sold, Ratings) — Lazada products in 6 countries with price, rating, units sold and seller
• Trendyol Scraper (Turkey Products, Prices, Ratings) — Trendyol products with price, basket discount, rating and promotions

Support and feedback

Found a topic Google added, a feed shape that changed, or a resolution bug? Open an issue on the Issues tab.