# Google News Scraper — Headlines by Keyword & Topic (`hipersoft/google-news-scraper`) Actor Scrape Google News for any search keyword or topic section (Business, Technology, Sports…). Returns headline, source, publish time, article link and snippet for any language and country. Public RSS feeds — no login, no API key. - **URL**: https://apify.com/hipersoft/google-news-scraper.md - **Developed by:** [hiper soft](https://apify.com/hipersoft) (community) - **Categories:** News, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.0032 / article scraped This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Google News Scraper — Headlines by Keyword & Topic Monitor the news at scale. Give the Actor any set of **search keywords** or **topic sections** and it returns fresh Google News articles — **headline, source, publish time, link and snippet** — for any language and country edition. Powered by Google News's public RSS feeds, so **no login and no API key**. Great for **media monitoring, brand/competitor tracking, PR, research datasets, and news alerting**. ### What you get per article | Field | Notes | |---|---| | `title` | Clean headline (Google's trailing " - Source" is stripped out). | | `source` | Publisher name (e.g. Reuters, BBC). | | `publishedAt` | Publish time (RFC-822). | | `link` | Google News article link. | | `snippet` | Short text snippet when the feed provides one. | | `query` / `topic` | Which search term or section the article came from. | | `language` / `country` | The edition used (`hl` / `gl`). | Results are **de-duplicated** across overlapping queries/topics within a run. ### Input ```json { "queries": ["artificial intelligence", "electric vehicles"], "topics": ["TECHNOLOGY", "BUSINESS"], "language": "en-US", "country": "US", "maxItemsPerFeed": 0 } ```` - **queries** — search terms, one per line. - **topics** — sections: `WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH`. - **language** (`hl`) / **country** (`gl`) — the Google News edition, e.g. `en-GB`/`GB`, `de`/`DE`. - **maxItemsPerFeed** — cap per feed (0 = all, ~100). - **maxConcurrency** — feeds fetched in parallel. - **proxyConfiguration** — optional; only if you hit rate limits. ### Output (one row per article) ```json { "query": "artificial intelligence", "title": "The Case for Nationalizing Artificial Intelligence", "source": "Jacobin", "link": "https://news.google.com/rss/articles/CBMi...", "publishedAt": "Thu, 09 Jul 2026 14:47:17 GMT", "snippet": "…", "language": "en-US", "country": "US" } ``` ### FAQ **Do I need an account or API key?** No. The Actor pulls from [Google News](https://news.google.com)'s public RSS feeds, so it needs no login, API key, or Google account. **How many articles can I get per run?** Each individual Google News feed returns up to ~100 of the most relevant recent items. Combine several queries, topics, and country editions to widen coverage; `maxItemsPerFeed` caps how many are kept per feed (0 = all). **Is scraping Google News legal?** The Actor collects only publicly available headline metadata (title, source, publish time, link, snippet). Use it responsibly and in line with Google's terms; the `link` opens the original publisher's page. **What's the output format?** A JSON dataset with one row per article, de-duplicated across overlapping queries and topics within a run. Export as JSON, CSV, or Excel from the Apify Console or API. **Can I filter or limit results?** Yes. Scope results with `queries`, `topics` (sections like TECHNOLOGY or BUSINESS), `language`/`country` editions, and `maxItemsPerFeed`. ### Related Actors Round out your media-monitoring stack with: - [Reddit Scraper](https://apify.com/hipersoft/reddit-scraper) — posts, comments, users, and subreddits without login. - [Telegram Channel Scraper](https://apify.com/hipersoft/telegram-scraper) — public posts from Telegram channels, no login. - [Hacker News Scraper](https://apify.com/hipersoft/hacker-news-scraper) — stories, comments, and users from Hacker News. - [Website Content Crawler](https://apify.com/hipersoft/website-content-crawler) — crawl article pages into clean text for analysis or RAG. ### Notes Each Google News feed returns up to ~100 of the most relevant recent items. Use several keywords/topics (and country editions) for broader coverage. `link` is the Google News article link (opens the publisher's page). Only publicly available headline data is collected. # Actor input Schema ## `queries` (type: `array`): Search terms to pull news for (e.g. "artificial intelligence", "Tesla stock"). One per line. ## `topics` (type: `array`): Google News sections to pull. Allowed: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH. ## `language` (type: `string`): Interface/content language, e.g. en-US, en-GB, es-419, de, fr, pt-BR. ## `country` (type: `string`): Two-letter country/edition code, e.g. US, GB, DE, FR, IN, BR. ## `maxItemsPerFeed` (type: `integer`): Cap articles per query/topic (0 = all the feed returns, up to ~100). ## `maxConcurrency` (type: `integer`): How many feeds to fetch in parallel. ## `proxyConfiguration` (type: `object`): Optional. Google News RSS works from datacenter IPs; enable a proxy only if you hit rate limits. ## Actor input object example ```json { "queries": [ "artificial intelligence" ], "topics": [], "language": "en-US", "country": "US", "maxItemsPerFeed": 0, "maxConcurrency": 5, "proxyConfiguration": { "useApifyProxy": false } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "queries": [ "artificial intelligence" ], "topics": [] }; // Run the Actor and wait for it to finish const run = await client.actor("hipersoft/google-news-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "queries": ["artificial intelligence"], "topics": [], } # Run the Actor and wait for it to finish run = client.actor("hipersoft/google-news-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "queries": [ "artificial intelligence" ], "topics": [] }' | apify call hipersoft/google-news-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=hipersoft/google-news-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Google News Scraper — Headlines by Keyword & Topic", "description": "Scrape Google News for any search keyword or topic section (Business, Technology, Sports…). Returns headline, source, publish time, article link and snippet for any language and country. Public RSS feeds — no login, no API key.", "version": "1.0", "x-build-id": "iJYa9LBkhYa9YjVgB" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/hipersoft~google-news-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-hipersoft-google-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/hipersoft~google-news-scraper/runs": { "post": { "operationId": "runs-sync-hipersoft-google-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/hipersoft~google-news-scraper/run-sync": { "post": { "operationId": "run-sync-hipersoft-google-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "queries": { "title": "Search keywords", "type": "array", "description": "Search terms to pull news for (e.g. \"artificial intelligence\", \"Tesla stock\"). One per line.", "items": { "type": "string" } }, "topics": { "title": "Topic sections", "type": "array", "description": "Google News sections to pull. Allowed: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH.", "items": { "type": "string" } }, "language": { "title": "Language (hl)", "type": "string", "description": "Interface/content language, e.g. en-US, en-GB, es-419, de, fr, pt-BR.", "default": "en-US" }, "country": { "title": "Country (gl)", "type": "string", "description": "Two-letter country/edition code, e.g. US, GB, DE, FR, IN, BR.", "default": "US" }, "maxItemsPerFeed": { "title": "Max articles per feed", "minimum": 0, "type": "integer", "description": "Cap articles per query/topic (0 = all the feed returns, up to ~100).", "default": 0 }, "maxConcurrency": { "title": "Concurrency", "minimum": 1, "maximum": 20, "type": "integer", "description": "How many feeds to fetch in parallel.", "default": 5 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Optional. Google News RSS works from datacenter IPs; enable a proxy only if you hit rate limits.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```