Google News Scraper

Scrape Google News by keyword, topic or top stories across 20+ countries and get headlines, publishers, dates and links as clean JSON/CSV for media monitoring and news datasets. No login, no API key.

What does Google News Scraper do?

• Search with Google operators (site:, "exact phrase", intitle:, OR) or use topic feeds (BUSINESS, TECHNOLOGY, SPORTS...).
• Fetch each query for several countries and languages in one run.
• Choose a time range from the last hour to any time; use splitByDay to go past ~100 results.
• Optionally resolve Google redirect links to the real publisher URL (decodeUrls).
• Optionally extract full article text, author and image (extractContent).
• Optionally add Bing News as a second engine; dedupe across queries, countries and engines.

Why use it

• Multi-country, multi-query in one run.
• Two engines (Google and Bing) with an engine field.
• Only-new mode (onlyNew) for scheduled alerts without duplicates.
• Low price: $1.00 per 1,000 articles, platform usage included.
• No login, no API key, no proxy.

Use cases

• Brand and PR monitoring with scheduled daily runs.
• Competitor and industry news alerts into Slack or email.
• Market research and trend analysis from headline streams.
• SEO and content ideas from what publishers cover.
• News datasets for LLM training, RAG and summarisation.

How to use

1. Open the Actor on Apify and click Try for free (or call it through the API).
2. Add search queries and/or topics, pick countries and a time range.
3. Click Start, then download the dataset as JSON, CSV, Excel or HTML, or read it through the API.

Input example

{
  "queries": ["artificial intelligence", "site:reuters.com oil"],
  "topics": ["TECHNOLOGY"],
  "countries": ["us", "vn"],
  "timeRange": "7d",
  "maxArticlesPerQuery": 100,
  "splitByDay": false,
  "decodeUrls": false,
  "dedupe": true
}

maxArticlesPerQuery applies per query and country. Default input finishes in well under a minute.

Output example

{
  "query": "artificial intelligence",
  "country": "vn",
  "title": "AI: Ai muốn mua?",
  "source": "Công an Nhân dân",
  "sourceUrl": "https://cand.vn",
  "publishedAt": "2026-10-21T02:04:07+00:00",
  "googleUrl": "https://news.google.com/rss/articles/CBMiWkFV...?oc=5",
  "articleUrl": "https://cand.vn/ai-ai-muon-mua-post825422.html",
  "snippet": null
}

articleUrl is filled only when decodeUrls is on (otherwise null). snippet is whatever extra text Google puts in the feed description; for most results it is empty (Google News does not publish article summaries).

Decoding original URLs

Google News links (news.google.com/rss/articles/...) are redirects. With decodeUrls the Actor resolves each one through Google's own web endpoint (2 requests per article, throttled, about 1.5 s per article). Use it for a few hundred articles per run, not thousands. If Google changes the endpoint or throttles, articleUrl stays null and the googleUrl still works in a browser.

Content extraction

Off by default. When on, Google results are decoded first (2 extra requests), then each article page is fetched (max 1 request/s per host, 20 s timeout). Expect about 55% of pages to yield text; paywalls, consent walls and JS-only pages return no content and are not charged the content event. A 40-article run takes about 1.5 minutes.

Pricing

Pay per event, no subscription. You pay only for what is returned:

Event	Price per 1,000	1,000	10,000	100,000
article	$1.00	$1.00	$10.00	$100.00

Example: 1,000 articles cost $1.00; 10,000 cost $10.00.

Optional full-text extraction (extractContent) adds $2.00 per 1,000 articles whose text was actually extracted (e.g. 1,000 articles with text: $1.00 + $2.00 = $3.00). Pages that return no text are not charged for it. Platform usage is included.

Integrations & API

Run it from code with the Apify API. Replace <APIFY_TOKEN> with your API token.

Python (pip install apify-client)

from apify_client import ApifyClient

client = ApifyClient("<APIFY_TOKEN>")
run = client.actor("bachiembmt/google-news-rss-scraper").call(run_input={"queries": ["artificial intelligence"], "countries": ["us"], "timeRange": "7d", "maxArticlesPerQuery": 30})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

cURL (run synchronously and get dataset items)

curl -X POST "https://api.apify.com/v2/acts/bachiembmt~google-news-rss-scraper/run-sync-get-dataset-items?token=<APIFY_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"queries": ["artificial intelligence"], "countries": ["us"], "timeRange": "7d", "maxArticlesPerQuery": 30}'

Works with:

• Make and Zapier: use the Apify app/module to run this Actor and pass the dataset on.
• n8n: use the Apify node or an HTTP Request node with the API call above.
• Google Sheets: export the dataset as CSV, or use the Apify integration to append rows automatically.
• Webhooks: trigger your own endpoint when a run finishes; combine with Apify schedules for recurring jobs.
• AI agents: expose the Actor as a tool through the Apify MCP server.

FAQ

Does it give article summaries? Google News does not publish summaries, so snippet is usually empty. Turn on extractContent for the main text of the article page.

Why are original URLs null? articleUrl is only filled when decodeUrls is on; otherwise you get the Google redirect link in googleUrl.

How do I get only fresh articles? Schedule the Actor with onlyNew: true.

Do I need an account or API key for the source? No. The Actor needs no login or source API key. You only need an Apify account to run it.

Is it legal to scrape this data? The Actor collects public feed metadata (headlines, links). Respect Google's terms and the publishers' copyright, especially if you enable full-text extraction. This is general information, not legal advice.

Limitations

• Bing returns only ~10-15 items per query and country (no paging).
• Google RSS returns up to ~100 items per request; splitByDay multiplies requests (1 per day) and is for keyword queries only.
• The feed shows what Google News ranks, not a full archive; very old dates are patchy.
• Requests are throttled to about 1 per second; large multi-country runs take time.
• Respect Google's terms and the publishers' copyright; this Actor only collects public feed metadata.