# Google News Scraper: Search, Topics, Date Ranges & Real URLs (`murch1k/google-news-scraper`) Actor

Scrape Google News by keyword or topic in any language and country: headline, publisher, publish time, real article URL (decoded from Google links) and related coverage. Date ranges are split by day to get far more than 100 results. Fast, no browser. Pay per article.

- **URL**: https://apify.com/murch1k/google-news-scraper.md
- **Developed by:** [Murch1k](https://apify.com/murch1k) (community)
- **Categories:** News, AI, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

$2.00 / 1,000 article scrapeds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Google News Scraper — Search, Topics, Date Ranges & Real Article URLs

Scrape **Google News** by keyword or topic in **any language and country** and get a clean feed of **headlines, publishers, publish times and the real article URLs** (not Google redirect links), plus **related coverage** from other outlets for top stories.

Set a **date range** and the actor searches it **day by day**, so you get up to 100 articles *per day* instead of the 100-article cap of a single Google News feed.

### Features

- **Real publisher URLs.** Google News links (`news.google.com/rss/articles/…`) are resolved to the actual article (`reuters.com/…`), ready for content extraction or deduplication. Verified on every run: 100% of resolved links match the publisher's domain.
- **Beat the 100-result limit** with day-by-day date ranges — ideal for backfills, research and media monitoring archives.
- **All Google search operators:** `"exact phrase"`, `OR`, `-exclude`, `site:reuters.com`, `intitle:`.
- **Topics / headlines:** Top stories, World, Business, Technology, Science, Health, Sports, Entertainment, Nation.
- **Any edition:** `language` + `country` (e.g. `de`/`DE`, `uk`/`UA`, `en-GB`/`GB`, `ja`/`JP`).
- **Related coverage:** other outlets covering the same story, for top-story items.
- **HTTP only, no browser:** the prefilled run (2 queries, 40 articles) takes ~8 s. Apify datacenter proxy is on by default.
- **Pay per article** with a hard cost cap.

### Use cases

- **Media monitoring & PR:** track brand, competitor and executive mentions daily.
- **Market & investment research:** news flow per ticker, company or industry over any date range.
- **AI / LLM pipelines:** feed fresh, deduplicated article URLs into a content extractor or RAG index.
- **Content curation & newsletters:** daily headlines per topic and country.
- **Academic research:** build news datasets for a period, language and country.

### Input

```json
{
  "queries": ["tesla", "\"artificial intelligence\" regulation"],
  "topics": ["TOP", "TECHNOLOGY"],
  "language": "en-US",
  "country": "US",
  "dateFrom": "2026-10-01",
  "dateTo": "2026-10-07",
  "maxArticlesPerQuery": 500,
  "decodeUrls": true
}
```

| Option | Default | Notes |
|---|---|---|
| `queries` | — | Keywords with Google operators. |
| `topics` | — | `TOP`, `WORLD`, `NATION`, `BUSINESS`, `TECHNOLOGY`, `ENTERTAINMENT`, `SPORTS`, `SCIENCE`, `HEALTH`. |
| `language` / `country` | `en-US` / `US` | Google News edition. |
| `timeRange` | `any` | `hour`, `day`, `week`, `month`, `year` (when no date range is set). |
| `dateFrom` / `dateTo` | — | Searched day by day; up to 100 articles per day. |
| `maxArticlesPerQuery` | 100 | Per query or topic. |
| `decodeUrls` | `true` | Adds the real publisher URL in `articleUrl`. |
| `includeRelated` | `true` | Related coverage for top stories. |
| `maxResults` | 0 | Cost cap for the whole run. |

### Output

#### Real output (default input)

First 2 of 40 records from a run with the prefilled input (8.4 s on a test machine; long values shortened here):

```json
[
  {
    "title": "Tesla's Roadster event is back on for Thursday night. Here's what to expect.",
    "source": "Yahoo Finance",
    "sourceUrl": "https://finance.yahoo.com",
    "publishedAt": "2026-10-14T16:33:58.000Z",
    "articleUrl": null,
    "googleNewsUrl": "https://news.google.com/rss/articles/CBMi0gFBVV95cUxPczRXSFJxNVlnWHZvME9JTEVNRVZkaXRac0taTW9LWEhUUmtYTlBoTzlRNmRuRVljd2FpbU1LVHcxcnVnTUVFTGJ…",
    "relatedArticles": [
      {
        "title": "Can the New SpaceX-Spec Tesla Roadster Actually Fly? Here’s What FAA Rules and Physics Tell Us",
        "source": "MotorTrend",
        "googleNewsUrl": "https://news.google.com/rss/articles/CBMiiwFBVV95cUxOYkJIMmFITVlzc1Zjck5UbG1vUVZOSWtjQUJlaHg3dUJSRDNjbjN4TVpiYW5mNVB5TTlhNlJOWnBCckxhWndKSGN…"
      },
      {
        "title": "Tesla set to unveil next generation Roadster sports EV after years of delay",
        "source": "Reuters",
        "googleNewsUrl": "https://news.google.com/rss/articles/CBMi0AFBVV95cUxOWGw5R18xMUUwWFdySjRKNlRpdkY1c2d4QlZWWVdxRlQ2dlpoc2JSaVJPdmpfWE1CbjE4bEF5RVpPOGFrV3E1T1B…"
      }
    ],
    "query": "tesla",
    "topic": null,
    "rank": 1,
    "language": "en-US",
    "country": "US",
    "scrapedAt": "2026-10-15T12:03:42.742Z"
  },
  {
    "title": "Tesla-SpaceX Deal News Possible This Year, Barclays Analyst Says",
    "source": "Bloomberg.com",
    "sourceUrl": "https://www.bloomberg.com",
    "publishedAt": "2026-10-14T21:13:13.000Z",
    "articleUrl": null,
    "googleNewsUrl": "https://news.google.com/rss/articles/CBMitAFBVV95cUxQQl96UVpfTm5QUGFScmJBZmJZb0FPUGQ0bW8wS1BHNDNiY2F0WFZxaWM5ZE5rMGNvakVRNXFqbTkwQ0dYTng0OVN…",
    "relatedArticles": [],
    "query": "tesla",
    "topic": null,
    "rank": 2,
    "language": "en-US",
    "country": "US",
    "scrapedAt": "2026-10-15T12:03:42.742Z"
  }
]
```

```json
{
  "title": "Tesla's China-made EV sales quicken in September",
  "source": "Reuters",
  "sourceUrl": "https://www.reuters.com",
  "publishedAt": "2026-10-09T10:17:44.000Z",
  "articleUrl": "https://www.reuters.com/business/autos-transportation/teslas-china-made-ev-sales-quicken-september-2026-10-09/",
  "googleNewsUrl": "https://news.google.com/rss/articles/CBMirwFBVV95cUxOcnJ1…?oc=5",
  "relatedArticles": [],
  "query": "tesla",
  "topic": null,
  "rank": 1,
  "language": "en-US",
  "country": "US",
  "scrapedAt": "2026-10-13T19:50:00.000Z"
}
```

### Use with AI agents (MCP), LangChain, RAG & the API

This actor is a ready-made **tool for AI agents**: an LLM can call it, wait for the run and read clean JSON back.

**MCP server (Claude Desktop, Claude Code, Cursor, VS Code, any MCP client)** — add Apify's hosted MCP server with this actor enabled as a tool:

```json
{
  "mcpServers": {
    "apify": {
      "url": "https://mcp.apify.com/?tools=murch1k/google-news-scraper",
      "headers": { "Authorization": "Bearer <APIFY_TOKEN>" }
    }
  }
}
```

**LangChain / LangGraph** (`pip install langchain-apify`, set `APIFY_API_TOKEN`):

```python
import json
from langchain_apify import ApifyActorsTool, ApifyWrapper
from langchain_core.documents import Document

## 1) give the actor to an agent as a tool
tool = ApifyActorsTool("murch1k/google-news-scraper")

## 2) or load results as Documents for a RAG index
loader = ApifyWrapper().call_actor(
    actor_id="murch1k/google-news-scraper",
    run_input={"queries": ["tesla", "\"artificial intelligence\" regulation"], "topics": ["TOP", "TECHNOLOGY"], "language": "en-US", "country": "US", "dateFrom": "2026-10-01", "dateTo": "2026-10-07", "maxArticlesPerQuery": 500, "decodeUrls": True},
    dataset_mapping_function=lambda item: Document(page_content=json.dumps(item, ensure_ascii=False), metadata={"url": item.get("url")}),
)
docs = loader.load()
```

**REST API — one synchronous call, dataset items in the response:**

```bash
curl -X POST "https://api.apify.com/v2/acts/murch1k~google-news-scraper/run-sync-get-dataset-items?token=<APIFY_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"queries": ["tesla", "\"artificial intelligence\" regulation"], "topics": ["TOP", "TECHNOLOGY"], "language": "en-US", "country": "US", "dateFrom": "2026-10-01", "dateTo": "2026-10-07", "maxArticlesPerQuery": 500, "decodeUrls": true}'
```

Also works with the Apify Python/JS clients, **Make, Zapier, n8n**, Google Sheets, webhooks and schedules. Export as JSON, CSV, Excel, XML or RSS.

**RAG tip:** Pair it with Website to Markdown or Website to RAG Chunks: feed the resolved `articleUrl` list in, get article text out, and give your agent a fresh, citable news corpus.

### Pricing

- **$2.00 per 1,000 articles** ($0.002 per article).
- The prefilled input returns 40 articles → **$0.08**.
- Example: 1,000 articles → $2.00; 10,000 → $20.00. Set **Max results (cost cap)** to limit any run.

Resolving Google News links to the real article URLs is included in the price.

### Limitations

- Google News returns at most 100 articles per feed; use a date range for more.
- Headlines and snippets belong to their publishers — use the data in line with their terms.

### FAQ

**How do I get more than 100 results?**
Set `dateFrom` and `dateTo`; the actor splits the range day by day, each day returning up to 100 articles.

**Are the URLs real publisher links?**
Yes. Google News redirect links are decoded to the original article URL (e.g. `reuters.com/...`).

**Which languages and countries are supported?**
Every Google News edition: set `language` and `country`, e.g. `de`/`DE` or `uk`/`UA`.

# Actor input Schema

## `queries` (type: `array`):

Keywords as you would type them into Google News. Supports Google operators: <code>"exact phrase"</code>, <code>OR</code>, <code>-exclude</code>, <code>site:reuters.com</code>, <code>intitle:</code>.

## `topics` (type: `array`):

Current headlines for a section: <code>TOP</code>, <code>WORLD</code>, <code>NATION</code>, <code>BUSINESS</code>, <code>TECHNOLOGY</code>, <code>ENTERTAINMENT</code>, <code>SPORTS</code>, <code>SCIENCE</code>, <code>HEALTH</code>.

## `language` (type: `string`):

Google News interface language, e.g. <code>en-US</code>, <code>en-GB</code>, <code>de</code>, <code>fr</code>, <code>es-419</code>, <code>uk</code>, <code>ja</code>.

## `country` (type: `string`):

Two-letter country code of the edition: <code>US</code>, <code>GB</code>, <code>DE</code>, <code>IN</code>, <code>UA</code>…

## `timeRange` (type: `string`):

Only for queries, ignored when a date range is set.

## `dateFrom` (type: `string`):

Start of a date range (YYYY-MM-DD). The range is searched day by day, so you get up to 100 articles per day instead of 100 in total.

## `dateTo` (type: `string`):

End of the date range (YYYY-MM-DD), inclusive. Defaults to today.

## `maxArticlesPerQuery` (type: `integer`):

Google News returns up to 100 per feed; with a date range up to 100 per day.

## `decodeUrls` (type: `boolean`):

Google News links are redirects (<code>news.google.com/rss/articles/…</code>). When on, every article also gets its real publisher URL in <code>articleUrl</code>.

## `includeRelated` (type: `boolean`):

Top-story items list other outlets covering the same story.

## `maxResults` (type: `integer`):

Stop after this many articles in total. <code>0</code> = no limit.

## `maxConcurrency` (type: `integer`):

Parallel requests.

## `proxyConfiguration` (type: `object`):

Requests go direct first (fastest); if Google rate-limits (HTTP 429), retries switch to these proxies with a fresh IP each time. Keep the default Apify datacenter proxy.

## Actor input object example

```json
{
  "queries": [
    "tesla",
    "\"artificial intelligence\" regulation"
  ],
  "language": "en-US",
  "country": "US",
  "timeRange": "any",
  "maxArticlesPerQuery": 20,
  "decodeUrls": true,
  "includeRelated": true,
  "maxResults": 0,
  "maxConcurrency": 50,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `articles` (type: `string`):

No description

## `runStats` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "queries": [
        "tesla",
        "\"artificial intelligence\" regulation"
    ],
    "maxArticlesPerQuery": 20,
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("murch1k/google-news-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "queries": [
        "tesla",
        "\"artificial intelligence\" regulation",
    ],
    "maxArticlesPerQuery": 20,
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("murch1k/google-news-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "queries": [
    "tesla",
    "\\"artificial intelligence\\" regulation"
  ],
  "maxArticlesPerQuery": 20,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call murch1k/google-news-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,murch1k/google-news-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/oh34SCBnmGpBk4u4I/builds/VGXcA8JxhaK56rWFG/openapi.json
