Google News Scraper

Scrape structured news articles from Google News in real-time — search by keywords, browse trending topics, or pull RSS feeds with clean metadata. Stop cobbling together fragmented news APIs and get everything you need in one Actor.

Main Use Cases

• Breaking news monitoring — Track keywords, brands, or events across thousands of sources in real-time
• News sentiment analysis — Feed structured article data into NLP pipelines for tone and opinion tracking
• Trend & topic intelligence — Analyze volume shifts, emerging stories, and topic clusters across 7 timeframes
• Media & competitor monitoring — Detect mentions, coverage patterns, and share-of-voice instantly
• Content aggregation — Build dashboards, feeds, or apps powered by live Google News data
• AI agent context grounding — Supply current-events retrieval to LLMs, RAG pipelines, and autonomous agents

How It Works

1. Choose a mode — search for keyword queries, topics for category browsing, or feeds for RSS-style lists
2. Set your parameters: query, topics, feeds, max articles, timeframe, language, and proxy config
3. The Actor scrapes Google News and returns structured JSON articles in your Apify Dataset
4. Access results via the Apify API, webhooks, or connect directly to downstream tools

Input Parameters

Parameter	Type	Required	Default	Description
mode	enum	Yes	—	"search", "topics", or "feeds"
query	string	Conditional	—	Search keywords (required when mode is search)
topics	string[]	Conditional	—	Topic categories: WORLD, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SCIENCE, SPORTS, HEALTH (required when mode is topics)
feeds	string[]	Conditional	—	RSS feed URLs to scrape (required when mode is feeds)
maxArticles	integer	No	100	Maximum articles to return (max: 100)
timeframe	enum	No	"7d"	"1h", "6h", "24h", "7d", or "30d"
language	string	No	"en"	Language / locale code (e.g., "en", "de", "ja")
proxyConfiguration	object	No	—	Apify proxy settings for IP rotation and anti-blocking

Output

Each article in the dataset includes:

Field	Type	Description
title	string	Article headline
url	string	Direct link to the source article
source	string	Publisher name
snippet	string	Short text summary or excerpt
published	string	Publication timestamp
cluster	string	Story cluster ID (groups related coverage)
topic	string	Topic category identifier
topicLabel	string	Human-readable topic label
imageUrl	string	Thumbnail image URL (if available)
relatedArticles	array	List of related articles in the same cluster

Example Input JSON

{
  "mode": "search",
  "query": "artificial intelligence regulation",
  "maxArticles": 100,
  "timeframe": "7d",
  "language": "en"
}

{
  "mode": "topics",
  "topics": ["TECHNOLOGY", "SCIENCE"],
  "maxArticles": 50,
  "timeframe": "24h"
}

{
  "mode": "feeds",
  "feeds": [
    "https://news.google.com/rss/topics/CAAqJggKIiBDQkFTRWdvSUwyMHZNRGx6TVdZU0FtVnVHZ0pWVXlnQVAB"
  ],
  "maxArticles": 100,
  "timeframe": "6h"
}

Example Output JSON

[
  {
    "title": "EU Passes New AI Regulation Framework",
    "url": "https://example.com/eu-ai-regulation-2026",
    "source": "Reuters",
    "snippet": "The European Union finalized sweeping artificial intelligence regulations on Friday...",
    "published": "2026-08-30T10:23:00Z",
    "cluster": "cluster_abc123",
    "topic": "TECHNOLOGY",
    "topicLabel": "Technology",
    "imageUrl": "https://example.com/thumbnail.jpg",
    "relatedArticles": [
      {
        "title": "What the EU AI Act Means for Tech Companies",
        "url": "https://example.com/eu-ai-act-explained",
        "source": "TechCrunch"
      }
    ]
  }
]

Integrations & Automation

• Apify API — Pull results via REST into any app, script, or data pipeline
• Webhooks — Trigger downstream workflows automatically when a run finishes
• Google Sheets / Excel — Export articles to spreadsheets for manual review
• Slack / Discord — Push breaking-news alerts to team channels
• Airtable / Notion — Feed article data into knowledge bases or CRMs
• Zapier / Make — Connect to thousands of apps for no-code automation
• LLMs & RAG pipelines — Supply real-time context to OpenAI, Claude, Gemini, and LangChain workflows
• Puppeteer / Playwright — Extend with browser-based extraction for paywalled or JS-heavy sources

FAQ

What is the difference between search, topics, and feeds mode?

Search queries Google News by keyword — enter any phrase and get matching articles. Topics returns articles from predefined Google News categories (Technology, Business, Sports, etc.). Feeds scrapes Google News RSS feed URLs directly for curated or regional content lists.

Can I scrape articles from a specific country or language?

Yes. Set the language parameter to your desired locale code — for example "de" for German, "ja" for Japanese, or "fr" for French. This affects which sources and articles Google News surfaces.

How does the timeframe filter work?

The timeframe parameter limits results to articles published within the selected window: 1h (1 hour), 6h (6 hours), 24h (24 hours), 7d (7 days), or 30d (30 days). Shorter windows return fresher, more targeted results.

What are cluster and relatedArticles fields?

Google News groups similar stories into clusters. The cluster field is a unique ID for each story group, and relatedArticles lists other coverage of the same event from different sources — ideal for bias analysis and multi-source reporting.

Is there a limit on how many articles I can scrape per run?

The maxArticles parameter caps results at 100 per run. For larger volumes, run the Actor on a schedule or increase maxArticles across multiple runs with different timeframes or queries.

Does this work with Google News RSS feeds?

Yes. Use mode: "feeds" and pass Google News RSS feed URLs in the feeds array. This is useful for monitoring specific sections, regions, or curated topic feeds.

SEO Keywords

Google News scraper, news data, trending topics, Google News API alternative, news aggregator data, breaking news data, news article scraping, Google News feeds, topic-based news, news monitoring, media intelligence, news trend analysis, real-time news data, news article extraction, Google News RSS scraper, news sentiment analysis, competitor media monitoring, AI news context, news dataset, Google News metadata

For AI Agents & LLM Apps

Purpose: Retrieve structured, real-time news articles from Google News for context grounding, retrieval-augmented generation (RAG), monitoring, and current-events analysis.

Minimal input:

{
  "mode": "search",
  "query": "your search terms",
  "maxArticles": 10
}

Output fields: title, url, source, snippet, published, cluster, topic, topicLabel, imageUrl, relatedArticles

Behaviors:

• Returns up to 100 articles per run
• cluster and relatedArticles enable multi-source story grouping
• Timeframe filtering (1h–30d) controls data freshness
• Language parameter supports multilingual news retrieval
• Proxy rotation available for high-frequency scheduled runs

Billing: $0.00015 per result — a 100-article run costs ~$0.015.

Legal & Compliance Disclaimer

This Actor is an independent tool developed by a third party and is not affiliated with, endorsed by, or connected to Google in any way. Google News is a trademark of Google LLC. This Actor accesses publicly available news articles and metadata from Google News for data extraction purposes. Users are solely responsible for ensuring their use of this tool complies with Google's Terms of Service, applicable laws, and all relevant regulations in their jurisdiction. The developer assumes no liability for misuse of data obtained through this Actor.

Related Actors

Verified related actors on Apify that pair well with this one. All links point to real, publicly available actors.

• Google Search Scraper
• Reddit Scraper
• Web Scraper