Google News Scraper

What does Google News Scraper do?

Google News Scraper searches public Google News results and returns clean, structured records for monitoring, research, and API workflows. It uses Google News's structured public feed first, with a bounded HTML fallback if that feed format changes; it does not visit publisher paywalls, solve CAPTCHAs, or claim unavailable article-body or author data.

The Actor supports one query or up to 20 batch queries, language and country localization, exact phrases, excluded terms, publisher filtering, publication-time windows, stable IDs, and global deduplication.

Why use Google News Scraper?

• Monitor brands, companies, competitors, markets, and public-policy topics.
• Build media-intelligence alerts and research datasets.
• Run multiple topics together with fair round-robin result allocation.
• Schedule searches and access results through the Apify API, webhooks, or integrations.
• Finish typical searches in seconds because no browser is launched.
• Receive an empty dataset for a valid no-results search instead of placeholder records.

What data can Google News Scraper extract?

Field	Type	Description
id	string	Stable SHA-256-derived record ID
title	string	Headline with the redundant publisher suffix removed
url	string	Public Google News article URL
source	string	Publisher name shown by Google News
sourceUrl	string	Publisher homepage supplied by the feed, when available
sourceDomain	string	Normalized publisher domain
publishedAt	string	ISO-8601 publication timestamp
queryPosition	integer	Position within that query's results
position	integer	Position in the combined dataset
effectiveQuery	string	Query after source, exclusion, phrase, and time filters
extractionMethod	string	rss or domFallback
country, language, locale	string	Requested localization context

Optional values are omitted when Google News does not provide them. The Actor does not fill missing fields with null, empty strings, or fabricated content.

How to scrape Google News

1. Open the Actor input tab.
2. Choose Single query or Multiple queries.
3. Enter a topic such as artificial intelligence or add several batch queries.
4. Optionally choose a country, language, source, exact phrase, excluded terms, and publication window.
5. Set maxItems and run the Actor.
6. Open the dataset or download it as JSON, CSV, Excel, XML, RSS, or HTML.

How much will it cost to scrape Google News?

This Actor is compute-efficient because it fetches one structured feed per query and does not launch Chrome. A small single-query run normally uses only seconds of compute. Your exact cost depends on your Apify plan, the number of batch queries, proxy selection, retries, and run frequency. Residential proxy traffic can add proxy charges; direct feed access is the default.

Input

See the input tab for the full configuration. Important options include:

• mode: single or batch.
• query / queries: one query or up to 20 queries.
• timeRange: any time, hour, day, week, or month. This maps to a Google News when: operator.
• sortBy: preserve Google News order or sort parsed records newest-first.
• maxItems: total combined records, with maxItemsPerQuery capped at 100 because the public feed has no pagination cursor.
• proxyConfiguration: direct, Residential Apify Proxy, or custom proxy URLs. GOOGLE_SERP is intentionally rejected because it is designed for Google Search HTTP result pages, not news.google.com feed endpoints.

Legacy hl and gl inputs remain supported as locale and country overrides.

Output

You can download the dataset in various formats such as JSON, HTML, CSV, or Excel. A simplified record looks like this:

{
  "id": "09b72be268858db81a72e35e7b45a173",
  "position": 1,
  "queryPosition": 1,
  "title": "Example public news headline",
  "url": "https://news.google.com/rss/articles/example",
  "source": "Example Publisher",
  "sourceUrl": "https://example.com/",
  "sourceDomain": "example.com",
  "publishedAt": "2026-08-28T16:22:00.000Z",
  "query": "artificial intelligence",
  "extractionMethod": "rss",
  "language": "en",
  "country": "US",
  "scrapedAt": "2026-08-29T10:00:00.000Z"
}

The OUTPUT key-value-store record summarizes query counts, failures, duplicates removed, extraction methods, record count, and runtime without including proxy credentials or raw responses.

Tips and advanced options

• Use batch mode instead of launching many small runs; feeds are fetched concurrently and results are interleaved fairly.
• Keep maxConcurrency moderate. The default of 5 is fast for normal batches without unnecessary load.
• Use source, exactPhrase, and excludeTerms instead of pasting a constructed result URL.
• Enable Residential proxy only when direct cloud access is unreliable for your region or workload.
• A valid search with no matching stories completes successfully with zero records.

FAQ, disclaimer, and support

Why is the article URL on news.google.com?

Google News feeds expose a public Google News article link and the publisher homepage, but not always a direct publisher-article URL. The Actor preserves those source-backed values rather than using fragile private decoding endpoints.

Does this Actor scrape full article text?

No. Version 3 removed the previously advertised but unimplemented deepScrape option. Visiting arbitrary publisher pages would introduce paywalls, consent flows, robots restrictions, and inconsistent schemas. This Actor focuses on reliable Google News search metadata.

What happens if Google returns a CAPTCHA?

The run fails clearly and never stores the challenge page. The Actor does not solve or bypass CAPTCHAs. For ordinary access reliability, use an authorized Residential or custom proxy and conservative concurrency.

This Actor extracts publicly displayed news metadata and does not intentionally extract private user data. Results can still contain names or other personal data published in news headlines. Personal data is protected by the GDPR and other laws. Do not process personal data without a legitimate reason; consult legal counsel if unsure.

Use the Actor's Issues tab for feedback and its API tab for programmatic access.