# Yahoo News Scraper + Google & Bing News Aggregator (`sonic_scraper/multi-news-scraper`) Actor

Yahoo News Scraper and news aggregator: search Yahoo News, Google News and Bing News by keyword in one run. One deduplicated dataset with headline, publisher, date, snippet, source engine and links. Pick any mix of sources. Bulk queries, JSON, CSV or Excel.

- **URL**: https://apify.com/sonic_scraper/multi-news-scraper.md
- **Developed by:** [Group Oject](https://apify.com/sonic_scraper) (community)
- **Categories:** News, Marketing, SEO tools
- **Features:** Limited permissions
- **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 2 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.10 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Yahoo News Scraper + Google & Bing News Aggregator

**Scrape Yahoo News, Google News, and Bing News by keyword in one run and get one deduplicated dataset: headline, publisher, publish date, snippet, source engine, and links. Pick any mix of engines. No API key, no login, no browser.**

Yahoo News has no public search API and most news scrapers cover Google only. This news aggregator searches up to three news engines for every query you give it, labels each row with the engine that found it, removes duplicates, and returns everything in one table you can export or call through the API.

![Yahoo News Scraper output in Apify: headline, publisher, publish date, source engine, snippet and article URL](https://api.apify.com/v2/key-value-stores/lwQu1lCMCLQIIhSMQ/records/multi-news-scraper-output.png)

*Real output from a default run of Yahoo News Scraper in Apify Console.*

### What can this news scraper do?

- **Scrape Yahoo News search results** by keyword.
- **Add Google News and Bing News** in the same run, or choose only the engines you need with `searchEngines`.
- **Compare coverage**: every row has `searchEngine`, and `SUMMARY` counts articles per engine, so you can see which engine surfaced which story.
- **Run many queries**: 1 to 1,000 queries per run, up to 100 articles per query and engine.
- **Remove duplicates**: the same article found by several queries is kept once.
- **Localize** Google and Bing results with `geo` and `language`.
- **Export anywhere**: JSON, CSV, Excel, the Apify API, n8n, Make, Zapier, webhooks, and MCP for AI agents.

Typical uses: brand and executive monitoring, competitor and funding news, crisis and reputation alerts, market and sector research, and feeding current news into dashboards, LLM pipelines, and RAG systems.

### What data can I extract?

| Field | Example | Description |
|---|---|---|
| `searchEngine` | `yahoo` | `google`, `bing`, or `yahoo` |
| `title` | `OpenAI funding round valuation cut...` | Headline |
| `source` | `TNW` | Publisher name |
| `publishedAt` | `2026-10-25T09:00:00.000Z` | Publish time in ISO 8601 |
| `snippet` | `The OpenAI funding round is an...` | Summary text |
| `newsUrl` | | The news engine's link for this result |
| `articleUrl` | `https://thenextweb.com/news/...` | Direct publisher URL when the engine provides it (Bing, Yahoo); empty for Google News |
| `googleNewsUrl` / `bingNewsUrl` / `yahooNewsUrl` | | Engine-specific link, filled for the engine that found the row |
| `query`, `position`, `geo`, `language`, `guid`, `fetchedAt` | | Query, rank, edition, ID, collection time |

Each run also saves `SUMMARY` (articles per engine, top publishers, top queries), `HEADLINES_BY_SOURCE`, and `ERRORS` to the run's key-value store.

### How much does it cost?

**$3.00 per 1,000 results** ($0.003 per article saved to the dataset), plus a start fee of $0.00005 per run per GB of memory. Platform usage is included.

Example: 10 queries on all three engines that return 600 articles in total cost **about $1.80**.

If you need only one engine, the single-engine scrapers cost less: [Google News Scraper](https://apify.com/sonic_scraper/google-news-scraper) and [Bing News Scraper](https://apify.com/sonic_scraper/bing-news-scraper) are $1.00 per 1,000 results. The [Pricing tab](https://apify.com/sonic_scraper/multi-news-scraper/pricing) always shows the current rate.

### How to use it

1. Click **Try for free**.
2. Add your **Search queries**.
3. Choose the **News sources**: Yahoo News, Google News, Bing News, or any combination.
4. Optional: set `geo`, `language`, and `maxItemsPerQuery`.
5. Click **Start**, then download the dataset or read it through the API. Save the input as a task and add a **Schedule** for recurring monitoring.

### Input example

```json
{
  "queries": ["openai", "climate tech", "interest rates"],
  "searchEngines": ["yahoo", "google", "bing"],
  "geo": "US",
  "language": "en",
  "maxItemsPerQuery": 25,
  "dedupe": true
}
```

| Field | Type | Default | What it does |
|---|---|---|---|
| `queries` | string\[] | - | Search terms |
| `queriesText` | string | - | Same, pasted one per line or comma-separated |
| `searchEngines` | string\[] | `["google","bing","yahoo"]` | Engines to search |
| `geo` | string | `US` | Country for Google and Bing |
| `language` | string | `en` | Language for Google and Bing |
| `maxItemsPerQuery` | integer | `50` | Upper limit per query and engine (1 to 100) |
| `maxQueries` | integer | `100` | Maximum queries per run, up to 1,000 |
| `dedupe` | boolean | `true` | Remove duplicate articles |
| `requestDelayMs` | integer | `500` | Delay between requests |
| `maxConcurrency` | integer | `3` | Parallel requests, 1 to 10 |
| `proxyConfiguration` | object | - | Apify Proxy settings, recommended for large or scheduled runs |

### Output example

```json
{
  "searchEngine": "bing",
  "query": "openai",
  "queryType": "search",
  "title": "Texas sues OpenAI, Sam Altman over product safety",
  "newsUrl": "http://www.bing.com/news/apiclick.aspx?ref=FexRss&url=https%3a%2f%2fwww.politico.com%2f...",
  "googleNewsUrl": null,
  "bingNewsUrl": "http://www.bing.com/news/apiclick.aspx?ref=FexRss&url=https%3a%2f%2fwww.politico.com%2f...",
  "yahooNewsUrl": null,
  "articleUrl": "https://www.politico.com/news/2026/10/23/texas-sues-openai-over-product-safety-01134162",
  "source": "Politico",
  "publishedAt": "2026-10-23T13:39:00.000Z",
  "snippet": "Texas Attorney General Ken Paxton on Friday launched a lawsuit against OpenAI and CEO Sam Altman...",
  "position": 2,
  "geo": "US",
  "language": "en",
  "fetchedAt": "2026-10-25T14:00:00.000Z"
}
```

### Use it from code

```python
from apify_client import ApifyClient

client = ApifyClient("<APIFY_TOKEN>")
run = client.actor("sonic_scraper/multi-news-scraper").call(run_input={
    "queries": ["nvidia earnings"],
    "searchEngines": ["yahoo", "google", "bing"],
})
for row in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(row["searchEngine"], row["source"], row["title"])
```

Or call `https://api.apify.com/v2/acts/sonic_scraper~multi-news-scraper/run-sync-get-dataset-items` with your input as the JSON body. The Actor also works in [n8n](https://n8n.io/integrations/apify/), [Make](https://www.make.com/en/integrations/apify), [Zapier](https://zapier.com/apps/apify/integrations), and as a tool through the [Apify MCP server](https://mcp.apify.com/).

### FAQ

#### Can I scrape only Yahoo News?

Yes. Set `"searchEngines": ["yahoo"]`.

#### Why do some rows have no `articleUrl`?

Google News only exposes its own redirect link, so Google rows have `googleNewsUrl` and no `articleUrl`. Bing and Yahoo rows include the publisher URL.

#### Are duplicates removed across engines?

Duplicates are removed by link. The same story found by Bing and Yahoo with the same publisher URL is kept once. Google rows use Google's redirect link, so the same story can appear once from Google and once from another engine, which is useful for coverage comparison.

#### Is this legal?

The scraper reads publicly available news search results: headlines, publishers, dates, snippets, and links. It does not log in, bypass paywalls, or copy full articles. You are responsible for how you use and republish the data.

#### Do I get the full article text?

No. Send `articleUrl` to a web content crawler if you need full text.

#### Why did one engine return nothing?

Check `ERRORS` and `SUMMARY` in the run's key-value store. One engine failing does not stop the others.

### Related scrapers

- [Google News Scraper & Monitor](https://apify.com/sonic_scraper/google-news-scraper): Google News with date and publisher filters and only-new alerts.
- [Bing News Scraper](https://apify.com/sonic_scraper/bing-news-scraper): Bing News with direct publisher URLs.
- [Google Trends Keyword Monitor](https://apify.com/sonic_scraper/trendpulse-keyword-monitor): rising topics before they hit the news.

Questions or a feature request? Open an issue on the **Issues** tab.

# Changelog

This Actor's version history is a separate document: https://apify.com/sonic_scraper/multi-news-scraper/changelog.md

# Actor input Schema

## `queries` (type: `array`):

Search terms to pull news articles for across Google News, Bing News, and Yahoo News.

## `queriesText` (type: `string`):

Paste one query per line or comma-separated.

## `searchEngines` (type: `array`):

News sources to scrape.

## `geo` (type: `string`):

Country/market code, e.g. US, GB, CA, FR, DE. Used by Google and Bing.

## `language` (type: `string`):

Language code, e.g. en, fr, es, de. Used by Google and Bing.

## `maxItemsPerQuery` (type: `integer`):

Cap on articles kept per query per news source.

## `maxQueries` (type: `integer`):

Maximum number of search queries to process.

## `dedupe` (type: `boolean`):

Remove duplicate articles across all sources.

## `requestDelayMs` (type: `integer`):

Delay between feed requests.

## `maxConcurrency` (type: `integer`):

Parallel feed requests. Keep modest; add a proxy for high volume.

## `proxyConfiguration` (type: `object`):

Optional. Use Apify Proxy for large/repeated runs to avoid rate limits.

## `debugMode` (type: `boolean`):

Verbose logging.

## Actor input object example

```json
{
  "queries": [
    "openai",
    "climate tech",
    "interest rates"
  ],
  "searchEngines": [
    "google",
    "bing",
    "yahoo"
  ],
  "geo": "US",
  "language": "en",
  "maxItemsPerQuery": 50,
  "maxQueries": 100,
  "dedupe": true,
  "requestDelayMs": 500,
  "maxConcurrency": 3,
  "proxyConfiguration": {
    "useApifyProxy": true
  },
  "debugMode": false
}
```

# Actor output Schema

## `articles` (type: `string`):

One row per article: source, title, publisher, publish date, snippet, news link, and article URL when available.

## `headlinesBySource` (type: `string`):

Article titles grouped by publisher.

## `summary` (type: `string`):

Totals, top publishers, top queries, and articles by news source.

## `errors` (type: `string`):

Feeds that failed to fetch.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "queries": [
        "openai",
        "climate tech",
        "interest rates"
    ],
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("sonic_scraper/multi-news-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "queries": [
        "openai",
        "climate tech",
        "interest rates",
    ],
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("sonic_scraper/multi-news-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "queries": [
    "openai",
    "climate tech",
    "interest rates"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call sonic_scraper/multi-news-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,sonic_scraper/multi-news-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/cXpRSOxOcfNSoFVzO/builds/0FIAd8yaoYOICpT1O/openapi.json
