# Google News Scraper - News Articles by Keyword (`sweet_stickball/google-news-scraper`) Actor

Scrape Google News articles for any keyword: headlines, sources, publish dates, URLs and snippets. Google News scraper for media monitoring by language and country, based on the public Google News RSS feed.

- **URL**: https://apify.com/sweet_stickball/google-news-scraper.md
- **Developed by:** [CrawlKit](https://apify.com/sweet_stickball) (community)
- **Categories:** News
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.70 / 1,000 articles

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Google News Scraper - News Articles by Keyword

Get news articles from **Google News** for a search query — titles, sources, dates, URLs, and snippets in flat JSON. Reads the public Google News RSS feed, with an HTML fallback. No API key, no headless browser, no start fee.

### How it works

Parses Google News's **public RSS search feed** — structured XML with article titles, sources, dates, and descriptions. If the feed returns no articles for a query, the actor tries the Google News HTML search page instead.

### Features

- **RSS feed** — one request to the Google News RSS search feed, parsed as XML
- **HTML fallback** — if the RSS feed is empty or unavailable, the actor parses the Google News search page
- **Language and country** — passes `language` and `country` to Google News (`hl`, `gl`, `ceid` parameters)
- **Flat JSON output** — one required input (`query`), results ready for spreadsheets, dashboards, or AI/LLM pipelines
- **Charged per article** — no start fee

### Input

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `query` | string | Yes | — | Search query (supports quotes, OR) |
| `maxItems` | integer | No | 20 | Maximum articles to return (1–1000; see Limitations) |
| `language` | string | No | `en` | Language code (en, fr, de, es, ja…) |
| `country` | string | No | `US` | Country code (US, GB, FR, DE, JP…) |

### Output

```json
{
    "title": "New AI Models Announced at Developer Conference",
    "source": "TechCrunch",
    "sourceUrl": "https://techcrunch.com",
    "date": "2024-01-15T12:00:00+00:00",
    "url": "https://news.google.com/rss/articles/CBMi...",
    "snippet": "New AI Models Announced at Developer Conference TechCrunch",
    "query": ""
}
```

#### Fields

| Field | Type | Description |
|-------|------|-------------|
| `title` | string | Article headline (source name stripped) |
| `source` | string | Publisher name (e.g. "TechCrunch") |
| `sourceUrl` | string | Publisher's homepage URL |
| `date` | string | Publication date (ISO 8601) |
| `url` | string | Link to the article (may be a Google News redirect) |
| `snippet` | string | Text of the RSS description, HTML stripped (max 500 chars) |
| `query` | string | Reserved; currently always empty |

### Pricing

Pay-per-event, **no start fee**: **$2.80 per 1,000 articles** on the Apify Free plan, with lower prices on paid plans.

| Event | Free | Starter | Scale | Business | Enterprise |
|-------|------|---------|-------|----------|------------|
| Article (`ARTICLE`) | $2.80 | $2.40 | $2.10 | $1.70 | $1.70 |

Prices in USD per 1,000 events.

#### Cost examples (Free plan)

| Scenario | Articles | Cost |
|----------|----------|------|
| Quick check | 20 | $0.056 |
| Daily media monitoring | 100 | $0.28 |
| Weekly research batch | 1,000 | $2.80 |

### Use cases

- **Media monitoring** — track coverage of your brand, products, or competitors
- **Trend detection** — monitor emerging topics across news sources
- **Market research** — gather news about industries, companies, or technologies
- **OSINT** — collect public news data for analysis
- **Content curation** — build automated news feeds for specific topics

### Limitations

- **About 100 articles per query** — the actor makes a single request to the Google News RSS feed, which returns at most around 100 items. A `maxItems` above that is not reached; split broad topics into several narrower queries.
- The RSS feed may not include every result shown on the Google News web interface
- Article URLs are usually Google News links (`news.google.com/rss/articles/...`) rather than direct links to the publisher
- Snippets come from the RSS `<description>` field, which Google often fills with the headline and source name rather than an article summary
- When the HTML fallback is used, `sourceUrl` is empty and `date` may be missing
- Coverage depth varies by region and language
- Rate limits are retried with exponential backoff; if Google returns no articles the run ends FAILED

### Technical details

Python 3.11, async httpx, Apify SDK. RSS parsed with `xml.etree.ElementTree`, HTML fallback with BeautifulSoup + lxml.

### Related Actors

- [Google Trends Scraper - Interest Over Time & Related Queries](https://apify.com/sweet_stickball/google-trends-scraper) — Scrape Google Trends: interest over time and related queries for up to 5 compared keywords, by country, time range and category.
- [Reddit Scraper - Subreddit Posts & Comments](https://apify.com/sweet_stickball/reddit-scraper) — Scrape Reddit posts from any subreddit (hot, new, top, rising) or the comments of a post: title, author (pseudonymized), date, link, permalink and text.
- [Bing Search Scraper & DuckDuckGo Scraper (SERP)](https://apify.com/sweet_stickball/bing-ddg-serp) — Scrape Bing and DuckDuckGo search results: organic titles, URLs, snippets and positions.
- [Telegram Channel Scraper - Public Channel Messages](https://apify.com/sweet_stickball/telegram-public-channel-scraper) — Scrape messages from public Telegram channels: text, dates, views, media and links.

# Actor input Schema

## `query` (type: `string`):

The search query for Google News. Works like the Google News search bar — use quotes for exact phrases, OR for alternatives.

## `maxItems` (type: `integer`):

Maximum number of news articles to return.

## `language` (type: `string`):

Language code for results (e.g. 'en', 'fr', 'de', 'es', 'ja').

## `country` (type: `string`):

Country code for results (e.g. 'US', 'GB', 'FR', 'DE', 'JP').

## Actor input object example

```json
{
  "query": "artificial intelligence",
  "maxItems": 10,
  "language": "en",
  "country": "US"
}
```

# Actor output Schema

## `articles` (type: `string`):

Dataset items shown with the 'articles' view.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "query": "artificial intelligence",
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("sweet_stickball/google-news-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "query": "artificial intelligence",
    "maxItems": 10,
}

# Run the Actor and wait for it to finish
run = client.actor("sweet_stickball/google-news-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "query": "artificial intelligence",
  "maxItems": 10
}' |
apify call sweet_stickball/google-news-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,sweet_stickball/google-news-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/q0HeEy6TGWK3xpMRl/builds/tPKlemFXUEzRePBXD/openapi.json