Google News Scraper

Search Google News by keyword or collect the latest headlines by topic, for 38 countries and languages. Get clean, structured articles with title, source, publication date, the Google News link and, optionally, the original article URL on the publisher's site. Fast and lightweight: no browser, no login, no API key.

What can this Google News Scraper do?

• 🔎 Search Google News by keyword, with full support for Google News operators: "exact phrase", OR, -exclude, site:reuters.com, intitle:.
• 🗂️ Collect topic headlines: World, Nation, Business, Technology, Entertainment, Sports, Science and Health, plus the Top stories front page.
• 🌍 38 editions: United States, United Kingdom, Germany, France, Spain, Brazil, India, Japan, Thailand and many more. Any other Google News edition works too.
• 📅 Filter by time: past hour, day, week, month or year, or any date range.
• 📈 Get more than 100 results per query: Google News returns at most about 100 articles per search, so the scraper searches each day of a date range separately and collects far more.
• 🔗 Resolve publisher URLs (optional): turn news.google.com redirect links into the real article URLs, ready for further processing.
• 🧩 Related coverage: clustered topic stories include the other outlets covering the same story.
• 🔁 No duplicates across queries, days and topics within a run.

What data does it extract?

Field	Example
title	Self-Driving Cars Are Getting Better. The Risks Are Getting Bigger.
source	The New York Times
sourceUrl	https://www.nytimes.com
publishedAt	2026-09-24T10:21:39.000Z
url	https://www.nytimes.com/2026/09/22/business/self-driving-cars-tesla-fsd.html (with Resolve publisher URLs)
googleNewsUrl	https://news.google.com/rss/articles/CBMi…
query / topic	tesla / TECHNOLOGY
edition	US:en
relatedArticles	other outlets covering the same story (topics and top stories)

How to use it

1. Enter one or more search queries, pick topics, or enable top stories.
2. Choose the country and language.
3. Optionally set a time range or a date range, and enable Resolve publisher URLs.
4. Click Start and download the results as JSON, CSV, Excel or HTML, or use them via the API.

Example input

{
  "queries": ["artificial intelligence", "\"interest rates\" site:reuters.com"],
  "topics": ["BUSINESS", "TECHNOLOGY"],
  "edition": "US:en",
  "timeRange": "1d",
  "resolveUrls": true
}

Example output

{
  "title": "Tesla Roadster reveal is creating a unique options opportunity, says Mike Khouw",
  "source": "CNBC",
  "sourceUrl": "https://www.cnbc.com",
  "publishedAt": "2026-09-23T18:52:11.000Z",
  "url": "https://www.cnbc.com/2026/09/23/tesla-roadster-reveal-is-creating-a-unique-options-opportunity-says-mike-khouw.html",
  "googleNewsUrl": "https://news.google.com/rss/articles/CBMitgFBVV95cUxQQmt1…",
  "articleId": "CBMitgFBVV95cUxQQmt1…",
  "position": 2,
  "query": "tesla",
  "topic": null,
  "dateWindow": null,
  "edition": "US:en",
  "relatedArticles": [],
  "scrapedAt": "2026-09-24T10:51:38.097Z"
}

Use cases

• Media monitoring and PR: track mentions of your brand, products or executives.
• Competitive intelligence: follow competitors, markets and industries every day.
• Finance and trading: collect news for tickers and companies for sentiment analysis.
• AI and LLM pipelines: feed fresh, structured news into agents, RAG systems and summaries.
• Research: build news datasets for a topic, country and period.

How much does it cost?

You pay only for results: $2 per 1,000 articles, and $1 per 1,000 resolved publisher URLs when that option is on. These are the prices on the Apify Free plan. Paid Apify plans pay less: 10% less on Starter, 20% on Scale and 30% on Business, which is the "from" price shown in Apify Store. There is no start fee. The Apify free plan covers thousands of articles per month.

Tips

• Scheduled monitoring: run the Actor on a schedule with From date set to a relative date such as 1 day, and get every new article since yesterday.
• Big datasets: set a long date range and keep Search each day separately on.
• Precise searches: use operators like "exact phrase", site: and -exclude in the query.

FAQ

Why not just ask an AI chatbot? A chatbot with web search reads a few articles and retells them, so you get a summary, not the coverage. This Actor returns every article Google News lists for your query, day by day over the dates you choose, with title, source, date and link in the same fields every time, ready for monitoring, analytics or an AI pipeline, at a fixed price per 1,000 articles. AI agents can call it as a tool through Apify's MCP server.

Is scraping Google News legal? This Actor collects publicly available headlines and links, not personal data. Check the terms of the sources and your local laws for your use case.

Why do some articles have url: null? Resolving publisher URLs is optional. When it is on, a small share of links can still fail to resolve because of temporary Google limits; the Google News link is always present.

Can I get the full article text? Not yet. Enable Resolve publisher URLs and pass the URLs to a content extractor such as Website Content Crawler.

Integrations and API

• Google Sheets, Slack, email and dashboards: connect the Actor to Make, Zapier or n8n, or use the Integrations tab of this Actor. Schedule it hourly or daily for news alerts on your topics.
• Webhooks: call your own URL when a run finishes, for example to load the articles into your database.
• AI agents (MCP): add https://mcp.apify.com?tools=robertosan16/google-news-scraper as an MCP server in Claude, Cursor or VS Code, and your agent can search current news with this Actor.
• LangChain and LlamaIndex: feed headlines and links into RAG pipelines with the Apify loaders.
• API: one request runs the Actor and returns the articles, for runs of up to 5 minutes. Start longer runs with the runs endpoint and read the dataset when they finish.

curl -X POST "https://api.apify.com/v2/acts/robertosan16~google-news-scraper/run-sync-get-dataset-items?token=YOUR_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"queries":["artificial intelligence"],"maxItems":20}'

Found a bug or need a feature? Open an issue in the Issues tab or email support@mozartstandard.com, and we will reply quickly.