📰 Google News Scraper — Articles by Keyword or Topic

Monitor the news without an API key — scrape Google News for any keyword, brand, or topic and get headlines, sources, publish dates, links, and snippets as clean structured data.

Fast, reliable, and cheap: it reads Google News' own public feeds, so there's nothing to break and no proxy required.

---

✨ What you get for every article

Field	Example
title	"Xi pitches China as leader of new global AI order"
source	Reuters
publishedAt	2026-07-17T02:34:00.000Z
snippet	short description
url	link to the article
query / language / country	what produced the result

---

🎯 Who it's for

• Brand & PR monitoring — track every mention of your company or product.
• Competitor intelligence — watch what's being written about rivals.
• Market & trend research — follow a topic across hundreds of publishers.
• Newsletters & dashboards — power a daily digest from structured data.
• AI / sentiment analysis — feed clean headlines into an LLM.

---

🚀 How to use it

1. Add search queries (e.g. artificial intelligence, "your brand name"), and/or pick topics (Business, Technology, Sports…).
2. Set max articles, plus language and country for the edition you want.
3. Click Start and export to CSV, Excel, JSON, or Google Sheets.

Tip: schedule it daily and pipe results into Slack or a spreadsheet for an automatic media-monitoring feed.

---

📥 Example input

{
  "queries": ["artificial intelligence", "\"Acme Corp\""],
  "topics": ["TECHNOLOGY"],
  "maxItems": 50,
  "language": "en",
  "country": "US"
}

Google News search operators work too — e.g. tesla when:7d, site:reuters.com AI.

---

📤 Example output

{
  "title": "Xi pitches China as leader of new global AI order",
  "source": "Reuters",
  "url": "https://news.google.com/rss/articles/...",
  "publishedAt": "2026-07-17T02:34:00.000Z",
  "publishedAtText": "Fri, 17 Jul 2026 02:34:00 GMT",
  "snippet": "China's president used the summit to...",
  "query": "artificial intelligence",
  "language": "en",
  "country": "US"
}

---

❓ FAQ

Do I need an API key or proxy? Neither. It reads Google News' public feeds — no key, no quota, and no proxy needed for normal use.

Can I monitor a specific publisher? Yes — use a search operator like site:reuters.com climate.

How fresh are the results? As fresh as Google News itself — typically minutes old.

Which languages and countries work? Any Google News edition — set language (e.g. en, fr, de) and country (e.g. US, GB, FR).

Is this legal? It reads publicly available news feeds. You're responsible for how you use and republish the content.

---

🗺️ Roadmap

• Resolve publisher URLs behind Google's redirect links
• Full article text extraction (pair with the Website Content Crawler)
• Date-range filtering
• Deduplication across queries

---

Built and maintained by hichemdev. Found a bug or want a feature? Open an issue on the Actor's Issues tab.