🌐 Google News Scraper — Publishers, Real URLs avatar

🌐 Google News Scraper — Publishers, Real URLs

Pricing

from $2.00 / 1,000 article scrapeds

Go to Apify Store
🌐 Google News Scraper — Publishers, Real URLs

🌐 Google News Scraper — Publishers, Real URLs

Search world news across Google News and top publisher feeds in one run. Every competitor reads one source; this merges Google News, BBC, NYT, Guardian and your own RSS into one schema — with real decoded article URLs and cross-source dedupe. No API keys.

Pricing

from $2.00 / 1,000 article scrapeds

Rating

5.0

(1)

Developer

Dương Thiệu Trần

Dương Thiệu Trần

Maintained by Community

Actor stats

1

Bookmarked

1

Total users

0

Monthly active users

3 days ago

Last modified

Share

🌐 Global News Scraper — Google News + Publishers, One Schema

Search world news across Google News and top publisher feeds in a single run. Every other news scraper on the Store reads one source; this one merges search-engine discovery with curated publisher feeds and your own RSS, deduped across sources, into one clean schema — with the real article URLs, not Google redirect links.

No API keys. No browser. No proxies. A default run finishes in a few seconds.


Why scrape Google News and publisher RSS together

The Store is full of Google News scrapers — and they all return the same thing: Google's redirect URLs, one source, no dedupe. This actor is built differently.

Typical Google News scraperThis actor
Sources per run1 (Google News)Google News + 9 publishers + your feeds
Article URLsnews.google.com/rss/articles/... redirectsreal publisher URLs (decoded)
Cross-source dedupenone✅ same story from two sources collapses, keeping both
Languagesusually Englishen · vi · de · fr · es · ja editions
Schemaone shape per actorone unified schema across every source

News article data fields you get

{
"id": "a1b2c3d4e5f6",
"title": "Tesla cuts EV prices across Europe",
"url": "https://www.reuters.com/business/autos/tesla-...",
"source": "Reuters",
"source_type": "google_news",
"url_decoded": true,
"summary": "Tesla lowered prices on its Model 3 and Model Y across...",
"language": "en",
"published_at": "2026-08-14T09:12:00Z",
"fetched_at": "2026-08-14T10:00:00Z",
"also_seen_in": ["BBC"]
}
  • url is the real publisher link, decoded from Google's redirect — competitors leave it as an unusable news.google.com URL.
  • also_seen_in names every other source that carried the same story, so you keep the provenance instead of losing the duplicate.
  • published_at is a proper timestamp — RFC-822 named-timezone dates (the standard RSS form) are parsed correctly, so nothing sorts to the bottom with a null date.

News sources: Google News, BBC, NYT, Guardian

SourceWhat it covers
Google NewsAny topic you search, from hundreds of outlets, in six language editions
Publisher feedsBBC · Guardian · NYT · TechCrunch · The Verge · Ars Technica · Wired · Al Jazeera · CNBC — mapped to their topic sections when you search technology/business/science
Your feedsPaste any RSS/Atom URLs to add outlets no pack anticipates

Google News scraper inputs

InputWhat it does
searchTopic or keywords, e.g. "electric cars". Empty = top headlines.
sourcesWhich sources: google_news, publisher_rss, user_feeds.
localeGoogle News edition: US · UK · Vietnam · Germany · France · Spain/LatAm · Japan.
feedUrlsYour own RSS/Atom feed URLs.
languageKeep only one language, or any.
excludeKeywordsDrop articles containing these words, e.g. "opinion, sponsored".
publishedWithinDaysRecency cutoff. Articles with no date are kept.
maxItemsHard cap, so a run can't produce an unexpected bill.

Daily news brief — get only the new articles

Turn on onlyNew and schedule the Actor. The first run returns everything matching your search; every run after that returns only what was published since. A topic you track every morning becomes a short brief instead of the same headlines again.

Because you are billed per article returned, a daily brief costs a fraction of a full run.

RunWith onlyNew offWith onlyNew on
Monday98 articles98 articles
Tuesdaymostly the same 98the 11 published overnight
Wednesdaymostly the same 98the 9 published since

This also side-steps the ceiling described above: you are no longer trying to pull a large corpus in one run, you are collecting it a day at a time.

History is kept on your own account for 30 days. If storage is ever unavailable the run returns everything rather than silently returning nothing — an empty brief and a quiet news day look identical, and only one of them is a bug.

Send it to Slack every morning

  1. Schedule → new schedule, 0 8 * * *, pointing at this Actor with onlyNew: true.
  2. In n8n, Make or Zapier, add an Apify → Actor run finished trigger.
  3. Map title, source, url and published_at into a Slack message.

url is already the real publisher link rather than a news.google.com redirect, so the message links straight to the article.

News Scraper pricing

Tiered by your Apify plan — bigger plans pay less per article:

Your Apify planPer article
Free$0.004
Bronze$0.0035
Silver$0.003
Gold / Platinum / Diamond$0.002

Actor start: $0.00005 — effectively free.

RunArticlesFree planGold+
Default50$0.20$0.10
Narrow search, everything available~100$0.40$0.20
Top headlines, everything available~310$1.24$0.62

You are charged per article returned, not per source read. A run pulls from every selected source and bills you only for what it delivers — so a query with little coverage costs little.

How many articles can one run actually return?

maxItems is a cap, not a target. Setting it to 1,000 does not produce 1,000 articles; it only stops the run from exceeding that. The real ceiling is set by the sources, and it is worth knowing before you plan a job around it. Measured:

RunArticles returned
search: "artificial intelligence"~100
search: "technology" (broad)~170
no search — top headlines~310

Two limits stack:

  • Google News RSS returns at most 100 results per query. That is Google's own cap. No input changes it, and it applies per query — not per run.
  • Publisher feeds are general news feeds. They carry ~280 articles between them, but when you search a narrow topic, only the articles that happen to mention it survive. "artificial intelligence" matched 1 of 281; "technology" matched 84.

To go beyond ~310, supply your own feeds. feedUrls accepts up to 25 feeds at 200 items each, so a run built on your own sources can reach several thousand articles. The built-in sources alone cannot.

What people build with news data

  • Media monitoring — track a company, product or topic across many outlets at once.
  • Newsletter & digest automation — feed a daily brief from Google News + your chosen feeds.
  • Research & sentiment datasets — one normalised, deduped, multilingual news corpus.
  • LLM/RAG pipelines — clean article metadata with real URLs, ready to enrich downstream.

Google News scraper FAQ

Which news sources does this scraper cover?

Google News (any topic, six language editions), a curated pack of nine publishers — BBC, Guardian, NYT, TechCrunch, The Verge, Ars Technica, Wired, Al Jazeera and CNBC — and any RSS or Atom feed you supply yourself. All three are read in one run and merged into a single schema.

Does it return the real article URL or a Google redirect?

The real publisher URL. Google News hands out news.google.com/rss/articles/CBMi... redirect links that are useless for downstream fetching; this Actor decodes them. If a decode fails it returns the Google URL with url_decoded: false rather than guessing, so you always know which you have.

Can I scrape news in Vietnamese?

Yes — set locale to vn and language to vi. Language is detected from the script itself rather than assumed from the locale, so Vietnamese diacritics aren't confused with French accents and Japanese kana isn't misread as Chinese.

Can I use this for media monitoring?

That's the main use. Search a company, product or topic and get every outlet that covered it in one pass, with also_seen_in naming the other sources carrying the same story so you can measure pickup instead of counting the same article twice.

Does it return the full article text?

No — headlines, summaries, links and metadata only. Full article bodies are copyrighted, so redistributing them isn't something this Actor does. The real URL is there if you have your own licence to fetch the body.

Can I add my own RSS feeds?

Yes — pass them in feedUrls. They're read alongside the built-in sources and deduped against them, so an outlet you add that also appears in Google News collapses into one row.

How much does it cost to scrape 1,000 news articles?

You're charged per article returned, not per source read. A run queries Google News plus every publisher feed and bills only for what it delivers. See the pricing table above.

Notes and limitations

  • News articles are public data; this actor returns headlines, summaries and links, not full article bodies — no copyrighted text is redistributed.
  • Google News redirect URLs are decoded to real publisher links where possible; if a decode fails, the row keeps the Google URL and url_decoded: false rather than guessing.
  • One source failing degrades coverage, never the run — the log names what was skipped.