# Google News Scraper Fast (Full Article + AI/RAG Markdown) (`church_of_loujess/google-news-scraper-fast`) Actor

Ultra-fast Google News scraper & URL decoder. Extracts real publisher URLs (decodes CBMi/Fbv4je links), multi-source story clusters, OpenGraph images, and full-article AI/RAG-ready Markdown + chunks across 85+ country/language editions with zero proxy requirement.

- **URL**: https://apify.com/church_of_loujess/google-news-scraper-fast.md
- **Developed by:** [H H](https://apify.com/church_of_loujess) (community)
- **Categories:** AI, MCP servers, Automation
- **Stats:** 1 total users, 0 monthly users, 0.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 extracted google news article + ai/rag markdowns

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Google News Scraper Fast (Real Publisher URL Decoder + Full-Article AI/RAG Markdown)

Extract real-time **Google News** search results and topic feeds across **85+ country/language editions**, automatically decode opaque `news.google.com/rss/articles/CBMi...` (`AU_yqL` / `Fbv4je`) redirect tokens into **real publisher URLs**, and extract **clean full-article Markdown + token-bounded RAG chunks** with **zero residential proxy requirement**.

Built as a **100% drop-in replacement** for `data_xplorer/google-news-scraper-fast` and `scrapestorm/google-news-scraper-fast-cheap-pay-per-results`, designed for AI agents, Model Context Protocol (MCP) servers, LangChain / LlamaIndex RAG pipelines, PR monitoring, and quantitative sentiment engines.

***

### Why Switch to This Google News Scraper?

| Capability | Legacy / Abandoned Google News Scrapers | **Google News Scraper Fast (This Actor)** |
| :--- | :--- | :--- |
| **Publisher URLs** | Returns broken/opaque `news.google.com/rss/articles/CBMi...` links | **Decodes the real publisher URL** (`reuters.com`, `techcrunch.com`, etc.) via `Fbv4je` RPC |
| **Full Article Text** | Headline & 1-sentence snippet only | **Full-Article Clean Markdown (`articleMarkdown`)** + OpenGraph image & author |
| **AI / RAG Readiness** | Requires secondary web scraper + chunker | **Built-in token-bounded `ragChunks`** ready for vector embedding |
| **Multi-Source Clusters** | Single link per item | **Extracts full `relatedCoverage` story cluster** across competing news outlets |
| **Proxy Cost** | Forces expensive `RESIDENTIAL` proxies by default | **Zero proxy required** (direct HTTP/2 extraction) |
| **Input Schema** | Single keyword or incompatible parameters | **Accepts both `keyword` (`data_xplorer`) & `keywords` (`scrapestorm`) + `topics`** |

***

### Key Features

- **Real Publisher URL Decoder (`Fbv4je` / `CBMi`)**: Automatically resolves Google News's modern `AU_yqL` encrypted article tokens into direct canonical publisher URLs.
- **Full-Article HTML-to-Markdown Engine**: Visits the decoded publisher URL and extracts JSON-LD (`NewsArticle`), OpenGraph (`og:image`, `og:description`, `article:author`), and clean Markdown body text stripped of ads, navbars, and cookie banners.
- **Token-Bounded RAG Chunks (`ragChunks`)**: Splits full articles into configurable word-bounded chunks (`chunkSizeWords`, default `250`) with attached metadata (`title`, `source`, `url`, `publishedAt`).
- **85+ Country & Language Editions (`region_language`)**: Supports every Google News `COUNTRY:lang` edition (`US:en`, `GB:en`, `DE:de`, `FR:fr`, `ES:es`, `JP:ja`, `BR:pt-419`, `IN:en`, etc.).
- **Official Topic Feeds (`topics`)**: Scrape `TOP_STORIES`, `WORLD`, `NATION`, `BUSINESS`, `TECHNOLOGY`, `ENTERTAINMENT`, `SPORTS`, `SCIENCE`, and `HEALTH` alongside custom search queries.

***

### Input Example

```json
{
  "keywords": ["Artificial Intelligence", "OpenAI"],
  "topics": ["TECHNOLOGY"],
  "timeframe": "7d",
  "region_language": "US:en",
  "maxArticles": 20,
  "decodeGoogleNewsUrls": true,
  "extractArticleContent": true,
  "chunkSizeWords": 250
}
```

#### Legacy `data_xplorer/google-news-scraper-fast` Input (100% Compatible)

```json
{
  "keyword": "NVIDIA",
  "maxArticles": 10,
  "timeframe": "1d",
  "region_language": "US:en"
}
```

***

### Output Example

```json
{
  "keyword": "Artificial Intelligence",
  "title": "Join Discerning AI: Exploring artificial intelligence through Marquette's mission",
  "source": "Marquette Today",
  "sourceDomainUrl": "https://today.marquette.edu",
  "publishedAt": "2026-10-14T15:48:02+00:00",
  "publishedTimestamp": 1791992882,
  "url": "https://today.marquette.edu/2026/10/join-discerning-ai-exploring-artificial-intelligence-through-marquettes-mission/",
  "googleNewsUrl": "https://news.google.com/rss/articles/CBMitwFBVV95cUxPYk1i...",
  "urlDecoded": true,
  "imageUrl": "https://today.marquette.edu/wp-content/uploads/2026/10/ai-mission.jpg",
  "author": "Marquette University",
  "description": "Marquette University hosts a symposium on ethical artificial intelligence...",
  "wordCount": 412,
  "articleMarkdown": "# Join Discerning AI: Exploring artificial intelligence...\n\nMarquette University faculty and students gathered...",
  "ragChunks": [
    {
      "chunkIndex": 0,
      "wordCount": 250,
      "title": "Join Discerning AI: Exploring artificial intelligence through Marquette's mission",
      "source": "Marquette Today",
      "url": "https://today.marquette.edu/2026/10/join-discerning-ai-exploring-artificial-intelligence-through-marquettes-mission/",
      "publishedAt": "2026-10-14T15:48:02+00:00",
      "text": "# Join Discerning AI: Exploring artificial intelligence..."
    }
  ],
  "relatedCoverageCount": 3,
  "relatedCoverage": [
    {
      "title": "Join Discerning AI: Exploring artificial intelligence through Marquette's mission",
      "source": "Marquette Today",
      "googleNewsUrl": "https://news.google.com/rss/articles/..."
    }
  ],
  "scrapedAt": "2026-10-14T18:30:00+00:00"
}
```

***

### Explore the Full Zero-Proxy AI/RAG & B2B Lead Suite (@church_of_loujess)

All 7 Actors run on **256 MB RAM** with **zero external proxies** and support **1-click MCP integration** for Claude Desktop, Cursor, and n8n:

| Actor | Best For |
| :--- | :--- |
| **[YouTube Transcript, Chapters & AI/RAG Scraper](https://apify.com/church_of_loujess/youtube-transcript-rag-scraper)** | Android InnerTube captions, chapters, iSummaryMarkdown &
agChunks |
| **[YouTube Channel Email, Socials & B2B Leads Scraper](https://apify.com/church_of_loujess/youtube-channel-email-leads-scraper)** | Creator/business emails, socials & external bio-link domain crawling |
| **[Google Trends Fast Scraper (No 429)](https://apify.com/church_of_loujess/google-trends-fast-scraper)** | Interest over time, regional breakdown, rising queries & trending searches |
| **[Google News Scraper Fast (Real Decoded URLs + Markdown)](https://apify.com/church_of_loujess/google-news-scraper-fast)** | Decodes CBMi.../AU_yqL URLs via Fbv4je RPC + full article Markdown |
| **[Website Email, Phone, Socials & Tech Stack Finder](https://apify.com/church_of_loujess/website-email-phone-finder)** | De-obfuscated emails, live DNS/MX mail provider check & 50+ tech signals |
| **[Fast Website Content & AI/RAG Markdown Crawler](https://apify.com/church_of_loujess/fast-website-content-crawler)** | Parallel sitemap.xml + BFS Markdown crawler & token-bounded
agChunks |
| **[Yahoo Finance Stock Quotes, Financials, OHLCV & AI News API](https://apify.com/church_of_loujess/yahoo-finance-scraper)** | Real-time quotes, OHLCV bars, full Income/Balance/CashFlow & AI tear-sheets |

- **Open-Source MCP Config, LangChain Loader & n8n Templates:** <https://github.com/Churchofloujess/apify-zero-proxy-mcp-suite>

# Actor input Schema

## `keywords` (type: `array`):

List of search keywords or queries for Google News (e.g. \['Artificial Intelligence', 'OpenAI', 'NVIDIA']). Supports Google search operators like site:reuters.com or intitle:AI.

## `keyword` (type: `string`):

Single search keyword (compatible with data_xplorer/google-news-scraper-fast). Merged automatically with 'keywords'.

## `topics` (type: `array`):

Optional official Google News Topic sections to scrape in addition to keywords (e.g. \['TOP_STORIES', 'TECHNOLOGY', 'BUSINESS', 'WORLD', 'SCIENCE', 'HEALTH', 'SPORTS', 'ENTERTAINMENT', 'NATION']).

## `timeframe` (type: `string`):

Time filter for Google News search (e.g. '1h' = past hour, '1d' = past 24 hours, '7d' = past 7 days, '30d' = past 30 days, '1y' = past year, 'all' = anytime).

## `region_language` (type: `string`):

Google News Country & Language edition in 'COUNTRY:lang' format (e.g. 'US:en', 'GB:en', 'CA:en', 'AU:en', 'DE:de', 'FR:fr', 'ES:es', 'JP:ja', 'BR:pt-419', 'IN:en').

## `maxArticles` (type: `integer`):

Maximum number of articles to extract per keyword or topic (default: 20, 0 = up to 100 per feed).

## `decodeGoogleNewsUrls` (type: `boolean`):

Automatically decode opaque 'news.google.com/rss/articles/CBMi...' redirect URLs into the actual target publisher URL (e.g. reuters.com, techcrunch.com).

## `extractArticleContent` (type: `boolean`):

Fetch the decoded publisher webpage and extract OpenGraph thumbnail image, author, clean full-article Markdown, and token-bounded AI/RAG chunks.

## `chunkSizeWords` (type: `integer`):

Target word count per RAG chunk when extractArticleContent is enabled.

## `proxyConfiguration` (type: `object`):

Optional proxy configuration. Works out-of-the-box with direct connections at zero proxy cost.

## Actor input object example

```json
{
  "keywords": [
    "Artificial Intelligence",
    "OpenAI"
  ],
  "topics": [],
  "timeframe": "7d",
  "region_language": "US:en",
  "maxArticles": 20,
  "decodeGoogleNewsUrls": true,
  "extractArticleContent": true,
  "chunkSizeWords": 250,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `articles` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "keywords": [
        "Artificial Intelligence",
        "OpenAI"
    ],
    "region_language": "US:en"
};

// Run the Actor and wait for it to finish
const run = await client.actor("church_of_loujess/google-news-scraper-fast").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "keywords": [
        "Artificial Intelligence",
        "OpenAI",
    ],
    "region_language": "US:en",
}

# Run the Actor and wait for it to finish
run = client.actor("church_of_loujess/google-news-scraper-fast").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "keywords": [
    "Artificial Intelligence",
    "OpenAI"
  ],
  "region_language": "US:en"
}' |
apify call church_of_loujess/google-news-scraper-fast --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,church_of_loujess/google-news-scraper-fast"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/abALzivsxFrJfjpzB/builds/WbZJDGWkdPMIyMAx1/openapi.json