Google News Scraper: Articles, Real URLs & Full Text

Scrape Google News by keyword, topic or top headlines, in any country and language. Each article includes the headline, publisher, publish time, the real publisher URL (decoded from Google's redirect links) and, optionally, the full article text, author and image, ready for monitoring, analytics and AI pipelines.

How to use

1. Sign up for Apify — the free plan's monthly credit is enough to try this Actor.
2. Open Google News Scraper, fill in the input (the form is pre-filled with a working example) and click Start.
3. Watch results stream into the dataset table while the run is going.
4. Export as JSON, CSV, Excel, XML, HTML or RSS — or pull the results from your own code with the Apify API.

Why use this Google News scraper?

• Real article URLs. Google News RSS links point to news.google.com/rss/articles/… redirects; this actor resolves them to the publisher URL (e.g. reuters.com/…), 100% in testing.
• Full article text on demand. Turn on Include full article text to get clean main text with paragraph breaks, plus author, image and description. No second scraper needed.
• Google News operators: exact phrases, OR, exclusions, intitle:; a time range (past hour to past year); and a site filter (e.g. only reuters.com and apnews.com).
• Topics & headlines: World, Business, Technology, Sports, … and top stories for any country edition (US, GB, IN, DE, JP, KR, BR…).
• Related coverage: other outlets' headlines on the same story, as grouped by Google News.
• No browser. Fast HTTP requests.

How to scrape Google News

{
  "queries": ["openai", "\"electric vehicles\" OR EV -tesla"],
  "timeRange": "7d",
  "sites": ["reuters.com", "apnews.com"],
  "topics": ["TECHNOLOGY"],
  "language": "en",
  "country": "US",
  "decodeUrls": true,
  "includeArticleText": true,
  "maxArticlesPerQuery": 100
}

Input reference

Every option at a glance. A minimal input that works as-is:

{
  "queries": [
    "openai"
  ],
  "timeRange": "any",
  "language": "en",
  "country": "US",
  "decodeUrls": true,
  "includeRelatedCoverage": true,
  "maxArticlesPerQuery": 100,
  "maxResults": 500
}

All fields:

• queries (Search queries) — Keywords, brands, people or Google News operators ("exact phrase", OR, -exclude, intitle:). Each query is one feed.
• timeRange (Published within) — Applies to search queries. Options: any (Any time), 1h (Past hour), 1d (Past 24 hours), 7d (Past 7 days), 1m (Past month), 1y (Past year); default "any".
• sites (Only from these sites (optional)) — Limit search queries to publisher domains, e.g. reuters.com, bbc.co.uk.
• topics (Topics) — Google News topic sections (current headlines). Any of: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH.
• topHeadlines (Include top headlines) — Add the current top stories for the country. Used automatically if no query or topic is given. Default false.
• language (Language) — Language code, e.g. en, es, de, fr, ja, ko, pt-BR. Default "en".
• country (Country) — Two-letter country edition, e.g. US, GB, IN, DE, JP, KR, BR. Default "US".
• decodeUrls (Resolve real article URLs) — Convert Google News redirect links into the publisher's original article URL. Default true.
• includeArticleText (Include full article text) — Download each article and extract the main text, author, image and description. Paywalled sites may return only a teaser. Same price. Default false.
• includeRelatedCoverage (Include related coverage) — Other outlets' headlines on the same story, as listed by Google News. Default true.
• maxArticlesPerQuery (Max articles per query/topic) — Google News feeds return up to about 100 articles. Default 100.
• onlyNewArticles (Only articles that are new) — Monitoring mode. Remembers the articles you already pulled for each query and returns only the ones published since. Run it hourly to track a topic — you pay only for new articles. Default false.
• maxResults (Max results) — Stop after this many articles. You are charged per article. Default 500.
• proxy (Proxy) — Apify datacenter proxy works for Google News.

What the Google News output looks like

{
  "title": "Fed raises rates in search of 'timelier' drop in inflation, sees more tightening ahead",
  "source": "Reuters",
  "sourceUrl": "https://www.reuters.com",
  "publishedAt": "2026-09-16T10:01:00.000Z",
  "url": "https://www.reuters.com/business/warshs-words-may-matter-more-than-anticipated-fed-rate-hike-2026-09-16/",
  "googleNewsUrl": "https://news.google.com/rss/articles/CBMipwFBVV95cUxPd0VZMTZ…",
  "articleText": "Summary\n\nFed lifts benchmark interest rate to 3.75%-4.00% range\n\nNew projections show policy rate in 4.00%-4.25% range by end of 2026 and 2027\n\nTrump repeats his argument that rates should be slashed\n\nWASHINGTON, Sept 16…",
  "wordCount": 1217,
  "author": "Howard Schneider",
  "image": "https://www.reuters.com/resizer/v2/JTYLPSXGVNNERNE5GEPGSURGX4.jpg?auth=0f311004dccef8406286cc510e840d807feb01deb315da2c1baa2b7321a429f4&height=1005&width=1920&quality=80&smart=true",
  "metaDescription": "The Federal Reserve flagged more hikes in the coming months.",
  "relatedCoverage": [],
  "query": "interest rates",
  "language": "en",
  "country": "US"
}

What can you do with Google News data?

• Brand & PR monitoring: every article mentioning your company, product or executives.
• Market & competitor intelligence: news on competitors, industries and deals.
• Finance & trading signals: headlines with timestamps and full text for sentiment models.
• AI & RAG: fresh, clean news text for summaries, newsletters and agents.
• Media research: coverage volume by outlet, topic and country.

How much does it cost?

Pay per article, with URL decoding and full text included, plus a negligible start fee per run.

How to monitor Google News for changes

Turn on onlyNewArticles and the Actor remembers the articles it already returned for each query. On the next run you get only articles published since. Articles you already have are skipped before URL decoding and text extraction, so an hourly schedule stays cheap.

Limits you should know about

• Google News feeds return up to about 100 articles per query or topic; use several narrower queries or time ranges for more.
• Full text depends on the publisher: paywalled or script-only sites may return a teaser or no text (wordCount: 0).
• If something breaks after a Google change, open an issue and it will be fixed quickly.

Pricing — what you pay per article

This Actor uses pay-per-event pricing: no monthly rental, you pay for the results you get. Prices per 1,000 results by Apify plan:

Event	Free plan	Bronze	Silver	Gold+
article — One news article (with real URL and optional full text) saved to the dataset	$3.00	$2.70	$2.55	$2.40

There is also a small start fee of $0.00005 per GB of memory ($0.00005 per run at the default 1 GB). Platform compute is included in the price — you are not billed separately for run time. Set a maximum total charge on the run if you want a hard cap, and use the input limits to control how much is fetched. The current prices are always on the Pricing tab.

Tips

• Start with a small maxResults (say 20) to check the output, then raise it — you only pay per result.
• For ongoing tracking, schedule the Actor and turn on onlyNewArticles so each run returns only what is new.
• Keep the default proxy setting — it is only used as a fallback when a direct request is blocked.
• Rows the Actor cannot read are logged and skipped, never charged — check the run log if a count looks low.

Automate & schedule

Run this Actor on autopilot and pull results into your own stack:

• Apify API — start runs, fetch datasets and manage schedules over REST.
• apify-client for JavaScript and apify-client for Python — official SDKs.
• Schedules — run it on a cron to keep your data fresh.
• Webhooks — trigger downstream actions the moment a run finishes.

JavaScript

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'MY_APIFY_TOKEN' });
const run = await client.actor('tindacloud/google-news-scraper').call({
    "queries": [
        "openai"
    ],
    "timeRange": "any",
    "language": "en",
    "country": "US",
    "decodeUrls": true,
    "includeRelatedCoverage": true,
    "maxArticlesPerQuery": 100,
    "maxResults": 500
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Got ${items.length} records`);

Python

from apify_client import ApifyClient

client = ApifyClient("MY_APIFY_TOKEN")
run = client.actor("tindacloud/google-news-scraper").call(run_input={
    "queries": [
        "openai"
    ],
    "timeRange": "any",
    "language": "en",
    "country": "US",
    "decodeUrls": True,
    "includeRelatedCoverage": True,
    "maxArticlesPerQuery": 100,
    "maxResults": 500
})

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

cURL — run and get the results in one request:

curl -X POST "https://api.apify.com/v2/acts/tindacloud~google-news-scraper/run-sync-get-dataset-items?token=MY_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"queries": ["openai"], "timeRange": "any", "language": "en", "country": "US", "decodeUrls": true, "includeRelatedCoverage": true, "maxArticlesPerQuery": 100, "maxResults": 500}'

Integrate with any app

Connect the dataset to thousands of apps — no code required:

• Make — multi-step automation scenarios.
• Zapier — push new records straight into your CRM or sheet.
• n8n — self-hosted workflows.
• Slack — get notified when a run finishes or finds something new.
• Google Drive / Sheets — auto-export every run to a spreadsheet.
• Airbyte — pipe results into your data warehouse.
• GitHub — trigger runs from commits or releases.
• Webhooks — call your own endpoint when a run succeeds or fails.

Use with AI assistants (MCP)

The output is clean, LLM-ready JSON. Call this Actor from Claude, ChatGPT, Cursor or any agent framework through the Apify MCP server — ask your assistant to "collect the last 24 hours of news about our competitor in English and German, with the real publisher links" and let it run this Actor for you.

Agent-ready: autonomous payments (x402 & Skyfire)

This Actor is agent-ready — AI agents can discover it, run it and pay for it on their own. It uses pay-per-event pricing and limited permissions, so it qualifies for Apify's agentic payments:

• x402 — an open, HTTP-native payment protocol. Agents pay in USDC through the Apify MCP server — no Apify account needed.
• Skyfire — agent-to-service payments with pre-funded Skyfire tokens.

Building an AI agent, MCP tool or data pipeline? This Actor is ready to plug in and pay as it goes.

Ready-made examples

Open one, change the fields, press Start — nothing to configure:

• Scrape Google News by keyword with full text
• Track company mentions in the news

Frequently asked questions about scraping Google News

Do I need an API key or a login?

No. Paste your input, press Start. There is nothing to connect and no account on the target site to create.

How do I export the results?

Every run produces a dataset you can download as JSON, CSV, Excel, XML or HTML, or read through the Apify API from your own code. You can also connect it to Make, Zapier or n8n.

Can I run this on a schedule?

Yes. Apify schedules run it every hour, day or week without you being there. With the monitoring option on, you only get articles published since the last run.

Can I call it from Python or JavaScript?

Yes — the Apify API runs any Actor and returns the dataset, and the official Python and JavaScript clients wrap it in a few lines. AI agents can call it too, through Apify's MCP server.

What does it cost?

You pay per result, not per hour. Filters are applied before anything is charged, so narrowing the input directly lowers the bill. Pages that cannot be read are reported in the log and never charged.

Is this data public?

Everything collected here is what Google News shows to anyone without logging in. Check the target site's terms and the rules that apply to you before using the data commercially.

Related scrapers

Other scrapers from the same maker, built the same way — no browser where it isn't needed, one flat price per result:

• YouTube Transcripts
• YouTube Comments Scraper
• Threads Scraper
• Website Contact & Email Scraper

Disclaimer

This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by Google LLC. All trademarks mentioned are the property of their respective owners. "Google News" is named here only in a descriptive sense — to identify the publicly available website this Actor reads. It collects only publicly available information that anyone can see without logging in; you are responsible for making sure your use of the data complies with applicable laws, regulations and the terms of the source website.