# News Scraper — Google News, Bing & Any RSS Feed (`glitchbound/news-scraper`) Actor

Track any topic across Google News, Bing News and any RSS or Atom feed, in one normalised table: headline, publisher, date, summary, image and link. Syndicated duplicates removed automatically. Filter by keyword, publisher or date. Any language and country.

- **URL**: https://apify.com/glitchbound/news-scraper.md
- **Developed by:** [Daniel Meshulam](https://apify.com/glitchbound) (community)
- **Categories:** News, AI, SEO tools
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.75 / 1,000 articles

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## News Scraper — Google News, Bing & Any RSS Feed

Track any topic across **Google News, Bing News and any RSS or Atom feed** — in one normalised table.

RSS is a publish-for-syndication format, so there's no key, no login and no bot wall anywhere in this Actor.

### Three ways in, one shape out

**Search** — `searchQueries: ["tesla recall", "\"interest rates\" ECB"]`
Full Google News search syntax: quotes, `OR`, `site:`.

**Sections** — `topics: ["technology", "business"]`
Google's curated feeds: `world` `nation` `business` `technology` `entertainment` `sports` `science` `health`.

**Any feed** — `feedUrls: ["https://github.blog/feed/", "https://hnrss.org/frontpage"]`
A publisher's own feed, a company blog, a subreddit, a podcast. **RSS 2.0 and Atom both work** — they disagree about nearly every field name, and this Actor reconciles them so a mixed list still returns one clean table.

### What you get

| Field | Example |
|---|---|
| `title` | `Apple options are doing something unusual into earnings` |
| `publisher` | `CNBC` |
| `publishedAt` | `2026-07-27T10:58:27Z` — normalised to UTC across every feed format |
| `summary` | plain text, HTML stripped |
| `url`, `image`, `categories`, `feedTitle`, `guid` | |
| `source` | which query or feed it came from |

### Syndicated duplicates removed

One wire story runs verbatim under dozens of outlets. `dedupeHeadlines` (on by default) keys on the normalised headline — not the URL, which differs per outlet — so those collapse into one row. **Duplicates are not charged.**

### Filters

```json
{
  "searchQueries": ["openai"],
  "keywords": ["funding", "lawsuit"],
  "excludeKeywords": ["opinion"],
  "publishers": ["Reuters", "Bloomberg"],
  "publishedSince": "2026-07-01",
  "maxArticlesPerSource": 100
}
```

Articles from feeds that omit a publish date are **kept**, not silently dropped — missing isn't the same as too old.

### Any language, any country

`language: "de"`, `country: "DE"` gives you the German edition. Works for `he`/`IL`, `fr`/`FR`, `es`/`ES` and the rest.

### Who this is for

- **Brand & competitor monitoring** — a query per brand, scheduled hourly
- **PR & comms** — every mention, deduplicated, with publisher and timestamp
- **Newsletters & aggregators** — merge many feeds into one clean source
- **Trading & research** — headline flow on a ticker or sector, filtered by outlet
- **AI / dataset builders** — normalised article metadata from any feed on the web

### Notes

- **Google News links are Google redirect URLs.** Google stopped exposing the publisher's direct URL in its RSS output; the link opens the article through Google News, and the `publisher` field tells you the outlet. Custom `feedUrls` return the publisher's real URL directly — use those when you need the canonical link.
- Google News returns a headline and a short summary, not full article text.
- A feed that's down or isn't valid XML comes back as one `error` row and is **not** charged; the other sources in the run still return.
- Set a **max charge per run** in the run options for a hard spend ceiling — the Actor honors it and stops cleanly.

### Pricing

Pay per result. One row = one article. Failed feeds come back as `error` rows and are **not** charged, and neither are duplicates or anything your filters removed.

# Actor input Schema

## `searchQueries` (type: `array`):

Topics to track in Google News, one per line — e.g. "tesla recall", ""interest rates" ECB". Supports quotes, OR and site: operators.

## `topics` (type: `array`):

Curated section feeds: world, nation, business, technology, entertainment, sports, science, health.

## `feedUrls` (type: `array`):

Any RSS or Atom feed URL — a publisher's own feed, a blog, a subreddit feed, a podcast. Both formats are parsed into the same shape.

## `maxArticlesPerSource` (type: `integer`):

Cap per query, section or feed, before filtering.

## `language` (type: `string`):

Two-letter language code for Google News, e.g. en, de, fr, es, he.

## `country` (type: `string`):

Two-letter country code for Google News edition, e.g. US, GB, DE, IL.

## `keywords` (type: `array`):

Only keep articles whose headline or summary contains one of these.

## `excludeKeywords` (type: `array`):

Drop articles mentioning any of these.

## `publishers` (type: `array`):

Only keep articles from publishers matching these names, e.g. "Reuters", "TechCrunch".

## `publishedSince` (type: `string`):

Only articles published on or after this date (YYYY-MM-DD). Articles whose feed omits a date are kept rather than silently dropped.

## `dedupeHeadlines` (type: `boolean`):

The same wire story appears under dozens of outlets. Keep the first copy only — duplicates are not charged.

## `includeBingNews` (type: `boolean`):

Run each query against Bing News as well as Google News for wider coverage.

## `proxyConfiguration` (type: `object`):

Proxy settings.

## Actor input object example

```json
{
  "searchQueries": [
    "artificial intelligence"
  ],
  "maxArticlesPerSource": 50,
  "language": "en",
  "country": "us",
  "dedupeHeadlines": true,
  "includeBingNews": false,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `results` (type: `string`):

News articles and RSS/Atom entries with publisher, date and summary.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQueries": [
        "artificial intelligence"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("glitchbound/news-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "searchQueries": ["artificial intelligence"] }

# Run the Actor and wait for it to finish
run = client.actor("glitchbound/news-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQueries": [
    "artificial intelligence"
  ]
}' |
apify call glitchbound/news-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=glitchbound/news-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/acts/pSoThsrYs7B17qJxt/builds/7Hr86go9fYZjiTjdr/openapi.json