# Google News Scraper + Full Article Text & Real URLs (`datanest-labs/google-news-full-text-scraper`) Actor

Search Google News or pull topic headlines in any language/country. Returns the real publisher URL (not news.google.com redirects), source, date, related coverage and optional full article text + author + image. Go beyond 100 results with date splitting.

- **URL**: https://apify.com/datanest-labs/google-news-full-text-scraper.md
- **Developed by:** [Ergin Bekar](https://apify.com/datanest-labs) (community)
- **Categories:** News, AI
- **Security:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per event

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Google News Scraper — Real Article URLs + Full Text

Scrape **Google News** search results and topic headlines in any language and country, and get what other Google News scrapers don't give you:

- ✅ **The real publisher URL** — not the `news.google.com/rss/articles/CBMi…` redirect that breaks in your pipeline
- 📰 **Full article text, author, main image and description** (optional add-on) — ready for LLMs, summarization, sentiment analysis and RAG
- 📅 **More than 100 results** — Google News caps every feed at ~100 items; set a date range and the Actor automatically splits it into daily windows
- 🔗 **Related coverage** — other outlets covering the same story (topic feeds)
- 🌍 **Any language / country** — `en-US`, `de`, `fr`, `tr`, `ja`, `pt-BR`…
- 🔎 **Google News operators** — `"exact phrase"`, `OR`, `-exclude`, `site:reuters.com`, `intitle:`

### Use cases

- **Media monitoring & PR** — track every mention of your brand, competitors or executives; schedule hourly with `timeRange: 1h`.
- **Finance & trading signals** — news flow for tickers and companies, with full text for NLP sentiment.
- **AI agents & RAG** — fresh, clean article text as context for LLM answers.
- **Market research** — trend coverage across countries and languages.
- **Content curation / newsletters** — daily digests by topic.

### Input example

```json
{
  "queries": ["nvidia earnings", "\"electric vehicles\" site:reuters.com"],
  "topics": ["TECHNOLOGY"],
  "language": "en-US",
  "country": "US",
  "timeRange": "7d",
  "maxItemsPerQuery": 100,
  "decodeUrls": true,
  "fetchArticle": true
}
```

**Historical / large pulls:** set `dateFrom` / `dateTo` and `maxItemsPerQuery` above 100 — e.g. 30 days × up to 100 articles per day.

### Output example

```json
{
  "title": "Andy Jassy says Prime Video ads are working",
  "source": "TechCrunch",
  "sourceUrl": "https://techcrunch.com",
  "publishedAt": "2026-10-29T21:14:00.000Z",
  "url": "https://techcrunch.com/2026/10/29/andy-jassy-says-prime-video-...",
  "googleNewsUrl": "https://news.google.com/rss/articles/CBMi...",
  "relatedArticles": [],
  "query": "amazon",
  "language": "en-US",
  "country": "US",
  "articleText": "Amazon CEO Andy Jassy said on Thursday...",
  "articleWordCount": 510,
  "author": "Julie Bort",
  "image": "https://techcrunch.com/wp-content/uploads/....jpg",
  "articleDescription": "...",
  "canonicalUrl": "https://techcrunch.com/2026/10/29/...",
  "scrapedAt": "2026-10-30T10:00:00.000Z"
}
```

### Pricing

- **Per article** — a small fee for each article saved (title, source, date, real URL, related coverage).
- **Full-text add-on** — charged **only** when the article text was successfully extracted. Paywalled or blocked articles are not charged for text.

### FAQ

**Why are some articles missing text?** Paywalled (WSJ, FT…) or bot-protected sites don't serve text to automated visitors. You still get the real URL and metadata.

**Do I need a proxy?** The default Apify datacenter proxy is used to avoid Google rate limits — no setup needed.

**Can I monitor news continuously?** Yes — create a Schedule (e.g. every hour with `timeRange: 1h`) and connect a webhook, Slack, Google Sheets or Zapier integration.

Feature request or a site with bad text extraction? Open an issue — fixes ship fast.

# Actor input Schema

## `queries` (type: `array`):

One query per line. Supports Google News operators: "exact phrase", OR, -exclude, site:reuters.com, intitle:word.

## `topics` (type: `array`):

Also fetch top stories for these sections.

## `language` (type: `string`):

Interface language code, e.g. en-US, en-GB, de, fr, es-419, tr, ja, pt-BR.

## `country` (type: `string`):

Two-letter country code, e.g. US, GB, DE, FR, TR, IN, BR.

## `timeRange` (type: `string`):

Only for search queries. Ignored if a date range is set.

## `dateFrom` (type: `string`):

YYYY-MM-DD. With a date range and more than 100 max items, the range is split into days to collect far more than Google's 100-result cap.

## `dateTo` (type: `string`):

YYYY-MM-DD (inclusive). Defaults to today.

## `maxItemsPerQuery` (type: `integer`):

Maximum number of articles saved for each query or topic.

## `decodeUrls` (type: `boolean`):

Convert news.google.com links into the original publisher URL.

## `fetchArticle` (type: `boolean`):

Visit each article and extract the full text, author, main image and description. Charged as an add-on only when text is successfully extracted. Paywalled sites may return no text.

## `excludeSources` (type: `array`):

Skip articles from sources whose name or domain contains any of these values, e.g. 'yahoo', 'msn.com'.

## `maxConcurrency` (type: `integer`):

How many articles are processed in parallel.

## `proxyConfiguration` (type: `object`):

Proxies are used for Google requests to avoid rate limits. The default datacenter proxy works well.

## Actor input object example

```json
{
  "queries": [
    "artificial intelligence"
  ],
  "topics": [],
  "language": "en-US",
  "country": "US",
  "timeRange": "7d",
  "maxItemsPerQuery": 20,
  "decodeUrls": true,
  "fetchArticle": false,
  "excludeSources": [],
  "maxConcurrency": 5,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `results` (type: `string`):

All articles saved to the default dataset.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "queries": [
        "artificial intelligence"
    ],
    "maxItemsPerQuery": 20,
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("datanest-labs/google-news-full-text-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "queries": ["artificial intelligence"],
    "maxItemsPerQuery": 20,
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("datanest-labs/google-news-full-text-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "queries": [
    "artificial intelligence"
  ],
  "maxItemsPerQuery": 20,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call datanest-labs/google-news-full-text-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,datanest-labs/google-news-full-text-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/kXeS0h4jdeFbfhyqg/builds/BqkFXSdN5kac4fVNm/openapi.json