# Google News Scraper & API — Headlines, Topics & Local News (`aaronoptimus/google-news-scraper`) Actor Google News scraper and API for top headlines, topic sections and local news in 50+ editions: the real publisher URL on every article, source, publish time and image, plus new-only monitoring. Pay per article plus a small start fee, no platform fees. - **URL**: https://apify.com/aaronoptimus/google-news-scraper.md - **Developed by:** [Aaron Tuttle](https://apify.com/aaronoptimus) (community) - **Categories:** News, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.80 / 1,000 articles This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README Get Google News articles with the publisher's real URL on every row, at no extra cost. **$1 per 1,000 articles, from $0.80 on higher Apify plans**, plus a small start fee and no platform fees. Built for **top headlines, topic sections and local news monitoring** in **50+ country and language editions**: World, Business, Technology, Sports and more, any city or region, and any news.google.com section, publication or "Full coverage" page you paste. Many Google News scrapers return Google's own redirect links (`news.google.com/read/CBMi…`) or charge extra to turn them into real ones. Here `url` is the article on the publisher's site (reuters.com, bbc.com…) on every row, read straight from the Google News page, ready to open, store or feed to an AI pipeline. ### Why use this Google News scraper - **Real article links, included.** No redirect hops and no extra "URL resolving" fee. - **You only pay for useful rows.** Duplicates, articles outside your dates, articles already delivered (monitoring), pages Google refuses and the rare article without a publisher link are free. - **Front page, topics, local news and URLs** in one run, across as many editions as you like (US, UK, Germany, India, Brazil, Japan…). - **No duplicates.** An article listed by several topics, places or editions is delivered and charged once (you can turn this off). - **Monitoring mode.** Turn on *Only new articles* and schedule the run: each run returns only articles that earlier runs haven't delivered, and you never pay twice for the same article. - **Runs finish cleanly.** Refused pages are retried from new IPs automatically, at no extra cost to you. Progress is saved before every charge, so a restarted run never charges an article twice. *Maximum cost per run* is respected to the cent. > **What this tool doesn't do** > > - **No keyword search.** It's built for topic and local news monitoring. Google News refuses automated keyword searches, and this scraper doesn't try to work around that. To follow a company or subject, paste its Google News topic page. > - **No article text or author names.** Google News pages show headlines; the text belongs to the publishers. > - **No archive.** Pages show what Google lists now; dates filter by publish time but can't reach back in time. ### What Google News data can you scrape? | Field | Example | |---|---| | `title` | Nvidia backs startup Reactor as buzz grows for world models | | `url` | https://fortune.com/2026/10/05/nvidia-backs-startup-reactor-buzz-grows-world-models/ | | `source` | Fortune | | `sourceDomain` | fortune.com | | `publishedAt` | 2026-10-06T00:42:00.000Z | | `imageUrl` | The article's image on the publisher's site | | `googleNewsUrl` | The article's Google News link | | `position` | Position on the Google News page (1 = top) | | `inputType`, `input` | What found it: `topic` BUSINESS, `location` Austin, or the URL you pasted | | `edition`, `language`, `country` | US:en, en-US, US | | `urlResolved` | `true` when `url` is the publisher link (only these are charged) | | `articleId`, `scrapedAt` | Google's article id, time of scraping | The scraper does not download article text (it belongs to the publishers) or author names. #### Example item ```json { "title": "Nvidia, Broadcom shielded as AI power crunch hits chip supply chain, says Morgan Stanley", "url": "https://www.reuters.com/business/nvidia-broadcom-shielded-ai-power-crunch-hits-chip-supply-chain-says-morgan-2026-10-05/", "source": "Reuters", "sourceDomain": "reuters.com", "publishedAt": "2026-10-05T14:15:59.000Z", "imageUrl": "https://www.reuters.com/resizer/v2/KQU627XS3RJSHG6LS57LGGOYKY.jpg?auth=d24d786dbfc8cadc9f4e0bcd6270a73f3ae949f0a264b95614f033f2bf9ce3fb&width=1920&quality=80", "googleNewsUrl": "https://news.google.com/read/CBMivAFBVV95cUxOMF9lcTkx…?hl=en-US&gl=US&ceid=US%3Aen", "position": 2, "inputType": "topic", "input": "BUSINESS", "edition": "US:en", "language": "en-US", "country": "US", "day": null, "urlResolved": true, "articleId": "CBMivAFBVV95cUxOMF9lcTkx…", "scrapedAt": "2026-10-06T06:10:00.000Z" } ``` ### How much does it cost to scrape Google News? You pay per article delivered with its publisher link, plus a $0.005 start fee per run. Compute and proxies are included; there are no platform-usage fees. The per-article price depends on your Apify plan: | | Free | Starter | Scale | Business | |---|---|---|---|---| | Per article | $0.0012 | $0.001 | $0.0009 | $0.0008 | | Prefilled example: front page + Business, 30 per section (40 articles in 9 seconds on 2026-10-07) | $0.053 | $0.045 | $0.041 | $0.037 | | Front page + all 8 topic sections, one edition (~700 articles) | $0.85 | $0.71 | $0.64 | $0.57 | | Local news for 10 cities (~700 articles) | $0.85 | $0.71 | $0.64 | $0.57 | | Hourly front-page monitor, new articles only (~8 per run) | $0.015 per run | $0.013 per run | $0.012 per run | $0.011 per run | Apify's $5 free plan covers about 4,000 articles. Use *Maximum cost per run* to cap any run; the scraper stops cleanly at the limit. ### How to scrape Google News 1. Pick **topics**, add **places** for local news, or paste **Google News links** (topic, publication, local or "Full coverage" pages). Any mix works. 2. Pick one or more **editions** (default: United States, English). 3. Optionally set a **time range** (past hour, day, week, month or year) or **From / To dates**; articles are filtered by publish time. 4. Optionally set **Max articles per source** (up to about 100, Google's limit per page) or **Max articles in total**. 5. For scheduled monitoring, turn on **Only new articles** and give the schedule a **Monitor name**. 6. Click **Start**, then download the results as JSON, CSV or Excel, or read them through the API. #### Input example ```json { "topics": ["TOP_STORIES", "BUSINESS", "TECHNOLOGY"], "locations": ["Austin"], "editions": ["US:en", "GB:en"], "timeRange": "1d", "maxArticlesPerSource": 100 } ``` #### Hourly monitoring of local news (schedule this every hour) ```json { "locations": ["Austin", "Houston", "Dallas"], "topics": ["BUSINESS"], "timeRange": "1d", "onlyNewArticles": true, "monitorName": "texas" } ``` ### Google News API: Python, JavaScript, Zapier, Make and AI agents (MCP) Every run is also an API call. With the [Apify API client](https://docs.apify.com/api/client/python): ```python from apify_client import ApifyClient client = ApifyClient("") run = client.actor("aaronoptimus/google-news-scraper").call(run_input={"topics": ["BUSINESS"], "maxArticlesPerSource": 30}) for article in client.dataset(run["defaultDatasetId"]).iterate_items(): print(article["title"], article["url"]) ``` ```javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: '' }); const run = await client.actor('aaronoptimus/google-news-scraper').call({ topics: ['BUSINESS'], maxArticlesPerSource: 30 }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); ``` - **Zapier, Make, n8n, Google Sheets:** use Apify's "Run Actor" step with the input above, then read the dataset. - **AI agents (Claude, Cursor, ChatGPT and other MCP clients):** add `https://mcp.apify.com?tools=aaronoptimus/google-news-scraper` as an MCP server. ### Run summary Besides the dataset, each run writes an `OUTPUT` record with articles per source, duplicates skipped, articles outside your dates, articles delivered by earlier runs (monitoring), pages with no articles, pages that failed (with the reason) and network statistics, including how much went through residential IPs. ### FAQ **How fresh is the data?** It's what Google News shows at the moment of the run. Schedule the Actor (for example hourly with *Only new articles*) to monitor a section or a city. **Can I search by keyword?** No. This scraper is built for topic and local news monitoring. Google News refuses automated keyword searches, and the scraper doesn't try to work around that. To follow a company or subject, open its Google News topic page in your browser and paste that link under *Google News URLs*. **Why are there fewer than 100 articles for a place?** Google lists fewer for small towns, and a short time range filters out older articles. Pages with no articles are free. **Can I get the full article text?** No. Article text belongs to the publishers, so the scraper returns the link, headline, source, time and image only. **How does "Only new articles" work?** Each run stores the articles it delivered in a key-value store on your Apify account named `google-news-monitor-`, and later runs with the same monitor name skip them (free). Articles are remembered for 120 days. Use different monitor names for different schedules; delete the store to start over. **What does "Remove duplicates" compare?** The publisher URL. With it on, an article listed by two topics or two editions appears once, under the first source that found it. **Do I pay for residential proxies?** No. Google News sometimes refuses pages from datacenter IPs, so refused pages are retried through Apify's residential proxy, and the price per article stays the same. You can turn this off under *Advanced*. **Which editions are supported?** The list in the input form covers 50+ editions. Any other Google News edition code (`ceid`, like `LU:fr`) in a pasted link works too. **Is it legal to scrape Google News?** The scraper reads only public pages that anyone can open without logging in, and collects no personal data. Check that your use of the data complies with Google's terms, publishers' rights and the laws that apply to you. ### Related tools **Related tools** by the same developer: [Google Trends Scraper](https://apify.com/aaronoptimus/google-trends-scraper) for what is trending and search interest over time, [Google Ads Transparency Scraper](https://apify.com/aaronoptimus/google-ads-transparency-scraper) for the ads a company runs alongside its headlines, [Google Autocomplete Scraper](https://apify.com/aaronoptimus/google-autocomplete-scraper) for what people ask about a topic, [Google Jobs Scraper](https://apify.com/aaronoptimus/google-jobs-scraper) for hiring signals, [Google Analytics 4 Exporter](https://apify.com/aaronoptimus/google-analytics-4-exporter) for your newsroom's GA4 reports, [PageSpeed Insights Bulk Audit](https://apify.com/aaronoptimus/pagespeed-insights-bulk-audit) for Core Web Vitals on article pages, [Google Hotels Scraper](https://apify.com/aaronoptimus/google-hotels-scraper) and [Google Flights Scraper](https://apify.com/aaronoptimus/google-flights-scraper) for travel prices. ### Support Found a problem or need a field? Open an issue on the Issues tab. If the Actor saves you time, a short review helps others find it. This Actor is an independent tool and is not affiliated with, endorsed by or sponsored by Google. # Changelog This Actor's version history is a separate document: https://apify.com/aaronoptimus/google-news-scraper/changelog.md # Actor input Schema ## `topics` (type: `array`): Google News topic sections, read once per edition. TOP_STORIES is the front page. Each section lists up to about 100 articles. ## `locations` (type: `array`): Towns, cities, states or countries for Google News local headlines, e.g. Austin, Manchester, Bavaria. One per line. ## `startUrls` (type: `array`): Links copied from news.google.com: topic pages, publication pages, local pages or "Full coverage" story pages. The edition in the link (ceid=...) is kept. RSS feed links are read as the matching web page. Search links and single-article links are not supported. ## `editions` (type: `array`): Which Google News editions to read. Each topic and place is read once per edition. Default: United States (English). ## `timeRange` (type: `string`): Only articles published within this time, judged by each article's publish time. Ignored when dates are set. ## `dateFrom` (type: `string`): Only articles published on or after this day (YYYY-MM-DD). Google News pages show what is listed now, so this filters by publish time; it can't reach back in time. ## `dateTo` (type: `string`): Only articles published on or before this day (YYYY-MM-DD, inclusive). ## `maxArticlesPerSource` (type: `integer`): Upper limit per topic, place or URL in each edition. Google lists up to about 100 articles per page. ## `maxArticles` (type: `integer`): Upper limit for the whole run. 0 = no limit. You can also set a maximum cost per run in the run options. ## `deduplicate` (type: `boolean`): Deliver each article once per run, even if several topics, places or editions list it. Duplicates are never charged. Turn off to get the full list for every source. ## `onlyNewArticles` (type: `boolean`): Skip articles this monitor already delivered in earlier runs, so a scheduled run returns only what is new. Skipped articles are free. Articles are remembered for 120 days in a key-value store on your account named google-news-monitor-. ## `monitorName` (type: `string`): Keeps separate memories for different schedules, e.g. brand-a or competitors. Letters, digits and dashes. Default: default. ## `proxyConfiguration` (type: `object`): Apify Proxy (datacenter) is used by default. Refused pages are retried from new IPs automatically. ## `useResidentialFallback` (type: `boolean`): Google News sometimes refuses pages from datacenter IPs. When a page is refused twice, it's retried through Apify's residential proxy, and later pages of the same kind go there straight away. Your price per article doesn't change. Turn off to use only the proxy above. ## `maxConcurrency` (type: `integer`): How many Google News pages to read at the same time. ## `maxRetries` (type: `integer`): How many times a refused page is retried from a new IP before it is reported as failed (failed pages are free). ## Actor input object example ```json { "topics": [ "TOP_STORIES", "BUSINESS" ], "editions": [ "US:en" ], "timeRange": "any", "maxArticlesPerSource": 30, "maxArticles": 0, "deduplicate": true, "onlyNewArticles": false, "proxyConfiguration": { "useApifyProxy": true }, "useResidentialFallback": true, "maxConcurrency": 4, "maxRetries": 6 } ``` # Actor output Schema ## `results` (type: `string`): No description ## `runSummary` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "topics": [ "TOP_STORIES", "BUSINESS" ], "maxArticlesPerSource": 30, "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("aaronoptimus/google-news-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "topics": [ "TOP_STORIES", "BUSINESS", ], "maxArticlesPerSource": 30, "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("aaronoptimus/google-news-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "topics": [ "TOP_STORIES", "BUSINESS" ], "maxArticlesPerSource": 30, "proxyConfiguration": { "useApifyProxy": true } }' | apify call aaronoptimus/google-news-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,aaronoptimus/google-news-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/bSWodckXU9zdsv9mE/builds/wWLXgEgXvyL304GSG/openapi.json