# Google News Scraper (`brilliant_gum/google-news-scraper`) Actor Scrapes Google News RSS feeds for search queries and topic categories. Returns articles with decoded URLs, sentiment analysis, reading time, full-text extraction, and deduplication across queries. - **URL**: https://apify.com/brilliant\_gum/google-news-scraper.md - **Developed by:** [Yuliia Kulakova](https://apify.com/brilliant_gum) (community) - **Categories:** News, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $30.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Google News Scraper — Search, Topics & Full Articles [![Google News Scraper](https://i.imgur.com/yAyCDTa.png)](https://apify.com/store) Scrape Google News at scale. Search by keywords, browse topic categories, filter by country, language, and date range. Extract full article text, sentiment analysis, and structured data — all at lightning speed. ### What can this scraper do? - **Search news by keywords** — find articles on any topic with title, source, date, and direct links - **Browse topic categories** — scrape curated feeds: World, Business, Technology, Sports, Science, Health, Entertainment - **Full article extraction** — fetch complete article text with word count, reading time, and author info - **Sentiment analysis** — automatic positive/negative/neutral classification for every article - **Multi-language & multi-country** — 25 languages and 35 countries supported out of the box - **Flexible date filters** — last hour, 24h, 7 days, 30 days, or custom date range ### Why use Google News Scraper? | Use case | How it helps | |----------|-------------| | Media monitoring | Track brand mentions and industry news in real time | | Competitive intelligence | Monitor competitors' press coverage across countries | | Market research | Analyze news trends and sentiment for any market or region | | Academic research | Collect large news datasets with full text for analysis | | Content curation | Build automated news feeds for newsletters or dashboards | | PR & communications | Measure press coverage and media sentiment | | Financial analysis | Monitor news sentiment for stocks, crypto, or sectors | ### Output data #### Article data Each article includes all available metadata: | Field | Description | |-------|-------------| | Title | Article headline | | Source | Publisher name | | Published date | ISO 8601 timestamp | | Link | Direct URL to the article | | Snippet | Article preview text from Google News | | Image URL | Thumbnail image from the article | | Sentiment | Positive, Negative, or Neutral with confidence score | | Sentiment score | Numerical score from -1.0 to +1.0 | | Query / Topic | Which search query or topic category produced this result | | Full text | Complete article body (when enabled) | | Word count | Article length in words (with full text) | | Reading time | Estimated reading time in minutes (with full text) | | Author | Article author when available (with full text) | #### Topic summary When scraping topic categories, get an overview of each topic: | Field | Description | |-------|-------------| | Topic name | Category (Business, Technology, etc.) | | Article count | Number of articles found | | Top sources | Most frequent publishers | | Avg sentiment | Average sentiment across the topic | | Date range | Earliest to latest article | #### Run statistics Every run includes a summary with total articles, processing speed, top sources, average sentiment, and error count. ### Supported countries & languages | Region | Countries | |--------|-----------| | Americas | US, Canada, Mexico, Argentina, Brazil | | Europe | UK, Germany, France, Spain, Italy, Netherlands, Poland, Sweden, Norway, Denmark, Finland, Czech Republic, Romania, Hungary, Turkey, Ukraine | | Middle East | Israel, Saudi Arabia, UAE, Egypt | | Asia Pacific | Japan, China, South Korea, India, Indonesia, Vietnam, Australia | | Africa | South Africa, Nigeria | 25 languages supported including English, Spanish, French, German, Russian, Chinese, Japanese, Arabic, and more. ### Filters & sorting | Filter | Options | |--------|---------| | Date range | Last 1 hour, 24 hours, 7 days, 30 days, or custom range | | Country | 35 country editions | | Language | 25 languages | | Sort by | Publication date (newest first) or relevance | | Deduplication | Automatic removal of duplicate articles across queries | | Output format | Articles only, Topics summary only, or Both | ### How much does it cost? Google News Scraper uses a **pay-per-result** model at **$0.03 per result**. No monthly fees — you only pay for the data you collect. | Results | Cost | |---------|------| | 100 articles | $3.00 | | 500 articles | $15.00 | | 1,000 articles | $30.00 | | 10,000 articles | $300.00 | Platform costs (compute + proxy) are included in the per-result price. ### Input examples #### Search news by keyword ```json { "queries": ["artificial intelligence"], "maxArticlesPerQuery": 50, "language": "en", "country": "US", "dateRange": "7d" } ```` #### Browse multiple topic categories ```json { "topics": ["technology", "science", "business"], "maxArticlesPerQuery": 30, "country": "US", "outputFormat": "both" } ``` #### Full article extraction with date filter ```json { "queries": ["climate change"], "includeFullText": true, "maxArticlesPerQuery": 20, "dateRange": "1d", "country": "GB", "language": "en" } ``` #### Multi-keyword research with custom date range ```json { "queries": ["bitcoin", "ethereum", "crypto regulation"], "maxArticlesPerQuery": 50, "dateRange": "custom", "startDate": "2026-05-01", "endDate": "2026-05-18", "sortBy": "relevance" } ``` #### Media monitoring in a specific country ```json { "queries": ["Tesla", "SpaceX"], "maxArticlesPerQuery": 100, "country": "DE", "language": "de", "dateRange": "30d" } ``` ### Tips for best results 1. **Start small** — test with 10-20 articles to verify your filters before scaling up 2. **Use specific queries** — "electric vehicle sales Europe 2026" yields better results than just "cars" 3. **Combine queries + topics** — use `outputFormat: "both"` to get articles plus topic-level analytics 4. **Full text wisely** — enable `includeFullText` only when you need article bodies; it's slower but gives you word count, reading time, and author data 5. **Country + language** — match these for best results (e.g., country: "DE" with language: "de") 6. **Custom date range** — perfect for researching a specific event or time period ### Limitations - Only publicly available articles from Google News are accessible - Some publishers behind paywalls may return incomplete full text - Google News RSS feeds return up to 100 articles per query - Sentiment analysis uses keyword-based classification (not AI/ML models) - Run statistics are included as the last record in the dataset (field `type: "stats"`) # Actor input Schema ## `queries` (type: `array`): List of search queries to scrape from Google News. Each query fetches up to maxArticlesPerQuery results. Example: \["artificial intelligence", "climate change 2024"] ## `query` (type: `string`): Convenience field for a single query string. Use 'queries' for multiple queries. Ignored if 'queries' is provided. ## `language` (type: `string`): Language for news results. Uses BCP 47 language tag. ## `country` (type: `string`): Target country for news edition. ## `maxArticlesPerQuery` (type: `integer`): Maximum number of articles to collect per search query. Google News RSS returns up to 100 per request. For more, the actor rotates query variants. ## `dateRange` (type: `string`): Filter articles by publication date. Use 'custom' to specify startDate and endDate. ## `startDate` (type: `string`): Start date for custom date range. Format: YYYY-MM-DD. Only used when dateRange is 'custom'. ## `endDate` (type: `string`): End date for custom date range. Format: YYYY-MM-DD. Only used when dateRange is 'custom'. ## `topics` (type: `array`): Scrape top stories for specific Google News topic categories. These use Google's curated topic feeds. ## `includeDuplicates` (type: `boolean`): If false (default), articles found in multiple queries are deduplicated by URL. If true, the same article may appear multiple times. ## `includeFullText` (type: `boolean`): Fetch and extract the full text of each article from its source URL. Significantly increases run time and may fail for paywalled sources. ## `outputFormat` (type: `string`): Control what is saved to the dataset. ## `sortBy` (type: `string`): How to order results in the dataset. ## `maxConcurrency` (type: `integer`): Maximum number of concurrent HTTP requests. Lower values are more polite. Default is 5. ## `requestTimeoutSecs` (type: `integer`): Timeout for each HTTP request in seconds. ## `retryCount` (type: `integer`): Number of times to retry failed requests before skipping. ## Actor input object example ```json { "queries": [ "artificial intelligence" ], "language": "en", "country": "US", "maxArticlesPerQuery": 100, "dateRange": "7d", "includeDuplicates": false, "includeFullText": false, "outputFormat": "articles", "sortBy": "date", "maxConcurrency": 5, "requestTimeoutSecs": 30, "retryCount": 3 } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "queries": [ "artificial intelligence" ] }; // Run the Actor and wait for it to finish const run = await client.actor("brilliant_gum/google-news-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "queries": ["artificial intelligence"] } # Run the Actor and wait for it to finish run = client.actor("brilliant_gum/google-news-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "queries": [ "artificial intelligence" ] }' | apify call brilliant_gum/google-news-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=brilliant_gum/google-news-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Google News Scraper", "description": "Scrapes Google News RSS feeds for search queries and topic categories. Returns articles with decoded URLs, sentiment analysis, reading time, full-text extraction, and deduplication across queries.", "version": "1.0", "x-build-id": "d6X19AYuDWYyWlQ5O" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/brilliant_gum~google-news-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-brilliant_gum-google-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/brilliant_gum~google-news-scraper/runs": { "post": { "operationId": "runs-sync-brilliant_gum-google-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/brilliant_gum~google-news-scraper/run-sync": { "post": { "operationId": "run-sync-brilliant_gum-google-news-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "queries": { "title": "Search Queries", "type": "array", "description": "List of search queries to scrape from Google News. Each query fetches up to maxArticlesPerQuery results. Example: [\"artificial intelligence\", \"climate change 2024\"]", "items": { "type": "string" } }, "query": { "title": "Single Search Query", "type": "string", "description": "Convenience field for a single query string. Use 'queries' for multiple queries. Ignored if 'queries' is provided." }, "language": { "title": "Language", "enum": [ "en", "ru", "de", "fr", "es", "it", "pt", "nl", "pl", "ja", "zh", "ar", "ko", "sv", "no", "da", "fi", "cs", "ro", "hu", "tr", "uk", "he", "id", "vi" ], "type": "string", "description": "Language for news results. Uses BCP 47 language tag.", "default": "en" }, "country": { "title": "Country", "enum": [ "US", "GB", "AU", "CA", "IN", "DE", "FR", "ES", "IT", "BR", "RU", "JP", "CN", "KR", "MX", "AR", "NL", "PL", "SE", "NO", "DK", "FI", "CZ", "RO", "HU", "TR", "UA", "IL", "ID", "VN", "ZA", "NG", "EG", "SA", "AE" ], "type": "string", "description": "Target country for news edition.", "default": "US" }, "maxArticlesPerQuery": { "title": "Max Articles Per Query", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of articles to collect per search query. Google News RSS returns up to 100 per request. For more, the actor rotates query variants.", "default": 100 }, "dateRange": { "title": "Date Range", "enum": [ "1h", "1d", "7d", "30d", "custom" ], "type": "string", "description": "Filter articles by publication date. Use 'custom' to specify startDate and endDate.", "default": "7d" }, "startDate": { "title": "Start Date", "pattern": "^\\d{4}-\\d{2}-\\d{2}$", "type": "string", "description": "Start date for custom date range. Format: YYYY-MM-DD. Only used when dateRange is 'custom'." }, "endDate": { "title": "End Date", "pattern": "^\\d{4}-\\d{2}-\\d{2}$", "type": "string", "description": "End date for custom date range. Format: YYYY-MM-DD. Only used when dateRange is 'custom'." }, "topics": { "title": "Topic Categories", "uniqueItems": true, "type": "array", "description": "Scrape top stories for specific Google News topic categories. These use Google's curated topic feeds.", "items": { "type": "string", "enum": [ "world", "nation", "business", "technology", "sports", "entertainment", "health", "science" ] } }, "includeDuplicates": { "title": "Include Duplicates", "type": "boolean", "description": "If false (default), articles found in multiple queries are deduplicated by URL. If true, the same article may appear multiple times.", "default": false }, "includeFullText": { "title": "Include Full Article Text", "type": "boolean", "description": "Fetch and extract the full text of each article from its source URL. Significantly increases run time and may fail for paywalled sources.", "default": false }, "outputFormat": { "title": "Output Format", "enum": [ "articles", "topics", "both" ], "type": "string", "description": "Control what is saved to the dataset.", "default": "articles" }, "sortBy": { "title": "Sort Results By", "enum": [ "relevance", "date" ], "type": "string", "description": "How to order results in the dataset.", "default": "date" }, "maxConcurrency": { "title": "Max Concurrency", "minimum": 1, "maximum": 20, "type": "integer", "description": "Maximum number of concurrent HTTP requests. Lower values are more polite. Default is 5.", "default": 5 }, "requestTimeoutSecs": { "title": "Request Timeout (seconds)", "minimum": 5, "maximum": 120, "type": "integer", "description": "Timeout for each HTTP request in seconds.", "default": 30 }, "retryCount": { "title": "Retry Count", "minimum": 0, "maximum": 5, "type": "integer", "description": "Number of times to retry failed requests before skipping.", "default": 3 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```