# Google News Scraper: Keywords, Topics & Real Article URLs (`ragequit/google-news-scraper`) Actor

Scrape Google News by keyword, topic or feed in 40+ editions. Get real publisher URLs (not Google redirects), related coverage, full article text on request, and only new articles for monitoring. More than 100 results per query.

- **URL**: https://apify.com/ragequit/google-news-scraper.md
- **Developed by:** [ragequit.wtf](https://apify.com/ragequit) (community)
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.05 / 1,000 articles

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

### What does Google News Scraper do?

**Google News Scraper** extracts articles from [Google News](https://news.google.com) by **keyword**, **topic** (Top stories, World, Business, Technology, Sports and more) or any **Google News link**, in **40+ country and language editions**. Every article comes with its **real publisher URL** (decoded from Google's redirect link at no extra cost), the publisher, publish time and the **related coverage** of the same story. Turn on **article details** to also get the description, image, author and **full text** from the publisher's page.

It works as a **Google News API**: no Google account, API key or browser. Run it from Apify Console, schedule it, or call it through the Apify API.

### Why use this Google News scraper?

- 🔗 **Real article URLs included.** Google News links redirect through Google; this Actor decodes them to the publisher's URL for every article, without charging extra.
- 📰 **More than 100 results per keyword.** Google News feeds stop at 100 articles. This Actor searches day by day to collect hundreds or thousands per keyword over any date range.
- 🔔 **Monitoring that really returns only new articles.** Switch on *Only new articles* and schedule the Actor: each run returns just what appeared since the last one.
- 📝 **Full text when you need it.** Optional article details read the publisher's page for description, image, author and main text.
- 🌍 **40+ editions.** US, UK, India, Germany, France, Spain, Brazil, Japan, Korea, China, Indonesia and more, with the topics of each edition.
- 🧹 **Clean data.** Headlines without the " - Publisher" suffix, publisher name and homepage, ISO dates, duplicate articles removed across keywords, and sources you exclude never charged.
- 💸 **Low price.** $1.50 per 1,000 articles with URLs, less on higher Apify plans.

Typical uses: **brand and competitor monitoring**, **PR and media tracking**, **market and finance news feeds**, **trend research**, and **news datasets for AI and NLP**.

### What data can I extract from Google News?

| Field | Description |
| --- | --- |
| `title` | Headline |
| `source`, `sourceUrl` | Publisher name and homepage |
| `url` | The publisher's article URL |
| `googleNewsUrl`, `articleId` | Google News link and stable article ID |
| `publishedAt` | Publish time (ISO 8601) |
| `relatedArticles` | Other coverage of the same story (topic and top-story feeds) |
| `feedType`, `feedValue`, `edition`, `position` | Where the article was found |
| `description`, `imageUrl`, `author`, `text`, `wordCount`, `siteName` | Article details (optional) |
| `detailsError` | Why details could not be read (paywalls, blocks) |

### How to scrape Google News

1. Click **Try for free** to open the Actor in Apify Console.
2. Add **keywords** (Google operators work: `"exact phrase"`, `OR`, `-exclude`, `site:reuters.com`), pick **topics**, or paste **Google News links**.
3. Choose the **edition**, a **time range** or exact dates, and how many articles you want.
4. Click **Start**, then download the results as JSON, CSV, Excel or HTML, or fetch them through the API.

### How much does it cost to scrape Google News?

Pay per article, with platform usage and proxies included. Higher Apify plans pay less:

| Result | Free plan | Bronze | Silver | Gold |
| --- | --- | --- | --- | --- |
| Article (with publisher URL) | $1.50 / 1,000 | $1.35 | $1.20 | $1.05 |
| Article with details and full text | $3.00 / 1,000 | $2.70 | $2.40 | $2.10 |

An article with details is charged once at the details price, not twice. Articles whose page cannot be read are charged as plain articles. For example, 10,000 articles with publisher URLs cost **$15** on the Free plan; with full text, **$30**. In monitoring mode you only pay for new articles.

### Input

See the **Input** tab for all options. Example:

```json
{
    "searchQueries": ["\"electric vehicles\" -tesla", "site:reuters.com nvidia"],
    "topics": ["BUSINESS", "TECHNOLOGY"],
    "edition": "US:en",
    "timeRange": "7d",
    "maxArticlesPerFeed": 300,
    "includeArticleDetails": false,
    "excludeSources": ["Yahoo Finance"]
}
```

- **Time range** and **dates** apply to keyword searches. Dates accept `YYYY-MM-DD` or relative values like `7 days`.
- **Max articles per keyword or feed** above 100 makes the Actor search day by day (up to about 100 per day) over your dates, the time range, or the last 30 days.
- **Google News links** can be any search, topic or section page you opened in the browser, or an RSS link.

### Output

You can download the dataset in various formats such as **JSON, HTML, CSV, or Excel**.

```json
{
    "resultType": "article",
    "articleId": "CBMimAFBVV95cUxN...",
    "title": "Tech stocks had a nice oversold bounce on Monday",
    "source": "CNBC",
    "sourceUrl": "https://www.cnbc.com",
    "url": "https://www.cnbc.com/2026/10/19/tech-stocks-rebound-meta-tesla-earnings.html",
    "googleNewsUrl": "https://news.google.com/rss/articles/CBMimAFBVV95cUxN...?oc=5",
    "publishedAt": "2026-10-19T21:48:50.000Z",
    "relatedArticles": [],
    "feedType": "search",
    "feedValue": "tesla earnings",
    "edition": "US:en",
    "position": 3,
    "author": "Sarah Min, Sean Conlon",
    "imageUrl": "https://image.cnbcfm.com/example.jpg",
    "wordCount": 570,
    "text": "Stocks rebounded on Monday ..."
}
```

### Tips

#### How do I monitor news for new articles?

Turn on **Only new articles (monitoring)** and create a **schedule** in Apify Console, for example every hour. The first run returns the current results and remembers the whole feed; later runs return only new articles. Use a different *Monitoring store name* for each separate monitor. Add a webhook or an integration (Slack, email, Google Sheets) to get alerts.

#### Why are some articles missing details?

Some publishers block automated visits or put articles behind a paywall. Those articles still come with their headline, publisher and URL, are charged as plain articles, and have `detailsError` explaining what happened.

#### How far back can I search?

Google News covers years of articles. Set **Published after** and **Published before** (and raise *Max articles*) to collect older coverage day by day.

### FAQ, disclaimers and support

#### Is it legal to scrape Google News?

This Actor collects publicly available headlines, links and publication metadata that Google News shows to any visitor, and, when you ask for details, the public text of the linked pages. Articles are protected by copyright: use the data for monitoring, research and analysis, link to the original sources, and check the terms of the publishers and of Google before republishing content. Results may contain personal data such as author names. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your use is legitimate, consult your lawyers.

This Actor is an independent tool and is not affiliated with or endorsed by Google.

#### How do I use it through the API?

Open the **API** tab for ready-to-use code in Python, JavaScript and cURL, or call it through the [Apify API](https://docs.apify.com/api/v2). It also works as a tool for AI agents through the Apify MCP server.

#### Something does not work. Where can I get help?

Open an issue in the **Issues** tab with a link to your run. Issues are usually answered within a day, and feature requests are welcome.

# Actor input Schema

## `searchQueries` (type: `array`):

Keywords to search Google News for. Google search operators work: "exact phrase", OR, -exclude, site:reuters.com, intitle:word.

## `topics` (type: `array`):

Google News topic sections for the chosen edition.

## `feedUrls` (type: `array`):

Any news.google.com search, topic or RSS link, e.g. a topic page you opened in the browser (news.google.com/topics/...). Converted to its feed automatically.

## `edition` (type: `string`):

Which Google News edition to use for searches and topics.

## `timeRange` (type: `string`):

Searches only: articles from this recent period. Ignored when you set exact dates below.

## `publishedAfter` (type: `string`):

Searches only: articles from this date on. YYYY-MM-DD or relative like "7 days".

## `publishedBefore` (type: `string`):

Searches only: articles up to this date. YYYY-MM-DD or relative like "1 day".

## `maxArticlesPerFeed` (type: `integer`):

A Google News feed shows up to 100 articles. For more per keyword, the Actor searches day by day (up to about 100 per day) over your dates, the time range, or the last 30 days.

## `resolveUrls` (type: `boolean`):

Decode Google's redirect links into the publisher's article URL (included in the price). Turn off for faster runs when Google links are enough.

## `includeArticleDetails` (type: `boolean`):

Open each article on the publisher's site and add its description, image, author and main text. Charged as an article with details; articles whose page cannot be read (paywalls, blocks) are charged as plain articles and get detailsError.

## `maxTextLength` (type: `integer`):

Characters of article text to keep when details are on.

## `excludeSources` (type: `array`):

Publisher names or domains to skip, e.g. "Yahoo Finance" or "yahoo.com". Skipped articles are not charged.

## `onlyNewArticles` (type: `boolean`):

Return only articles not seen in earlier runs, per keyword, topic or feed. The first run returns results and remembers the whole feed; schedule the Actor to get just new articles. Seen articles are kept in a named key-value store in your account.

## `monitorStoreName` (type: `string`):

Name of the key-value store that remembers seen articles. Use a different name for each separate monitor.

## `maxConcurrency` (type: `integer`):

How many feeds to process at the same time.

## `maxRetries` (type: `integer`):

How many times to retry a failed Google request on a new IP.

## `residentialFallback` (type: `boolean`):

Start on cheap datacenter IPs and move to Apify residential proxies for the rest of the run if Google rate-limits them. Only applies when you use Apify datacenter proxies.

## `proxyConfiguration` (type: `object`):

Apify datacenter proxies work for Google News; residential is used automatically as a fallback.

## Actor input object example

```json
{
  "searchQueries": [
    "artificial intelligence"
  ],
  "topics": [],
  "edition": "US:en",
  "timeRange": "any",
  "maxArticlesPerFeed": 100,
  "resolveUrls": true,
  "includeArticleDetails": false,
  "maxTextLength": 20000,
  "onlyNewArticles": false,
  "monitorStoreName": "google-news-monitor",
  "maxConcurrency": 5,
  "maxRetries": 6,
  "residentialFallback": true,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `results` (type: `string`):

Dataset with one row per article

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQueries": [
        "artificial intelligence"
    ],
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("ragequit/google-news-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "searchQueries": ["artificial intelligence"],
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("ragequit/google-news-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQueries": [
    "artificial intelligence"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call ragequit/google-news-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,ragequit/google-news-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/xst6sQabfeOBw0Tai/builds/DJPWQsgdDIQAxQxhB/openapi.json