Google News Scraper + Full Article Text (Markdown for AI) avatar

Google News Scraper + Full Article Text (Markdown for AI)

Pricing

from $2.00 / 1,000 articles

Go to Apify Store
Google News Scraper + Full Article Text (Markdown for AI)

Google News Scraper + Full Article Text (Markdown for AI)

Google News search, top stories and topics in any country and language, with the real article URL and the full article text as clean Markdown for LLMs and RAG: title, source, date, author, image. Over 100 results per search, only-new-articles mode for schedules. Pay per article.

Pricing

from $2.00 / 1,000 articles

Rating

0.0

(0)

Developer

Fernando Guiraud

Fernando Guiraud

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 hours ago

Last modified

Share

What does Google News Scraper + Full Article Text do?

Google News Scraper collects news from Google News searches, top stories and topics (Business, Technology, Sports…) in any country and language, and goes one step further than other Google News tools: it decodes each Google News link to the real article URL and extracts the full article text as clean Markdown, ready for LLMs, RAG pipelines, summaries and sentiment analysis. You also get the title, publisher, publication date, author, main image and description.

Google limits each search to 100 results; this Actor automatically splits long periods into date windows to collect up to 5,000 articles per query, removes duplicates across queries, and can return only articles that are new since the last run. No API key needed, and you pay per article.

It runs on the Apify platform, so you also get an API, scheduling (e.g. an hourly news feed), integrations (Google Sheets, Slack, Make, Zapier, n8n) and access for AI agents through the Apify MCP server.

Why use it?

  • πŸ“° Media monitoring: track your brand, competitors, executives or industry across thousands of publishers.
  • πŸ€– AI pipelines and RAG: full article text in Markdown, not just headlines, so an LLM can actually read and summarize the news.
  • πŸ“Š Market and financial research: collect everything written about a company, product or market over months.
  • πŸ”” Alerts: schedule it with Only new articles and send each new story to Slack, email or a spreadsheet.
  • 🌍 Any country and language: US, UK, India, Germany, Brazil, Mexico, Japan and every other Google News edition.

How to scrape Google News with full article text

  1. Click Try for free.
  2. Enter search queries (Google operators like "exact phrase", site:reuters.com or -exclude work) and/or pick topics such as Top stories or Technology.
  3. Choose the time period, country and language.
  4. Click Start. About 20 articles with full text take 10 to 20 seconds.
  5. Open the Full text view, or download the results as JSON, CSV or Excel.

Input

FieldDescriptionDefault
queriesGoogle News searches, one per linequeries or topics required
topicsTOP, WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH-
timeRangePast hour, 24 hours, 7 days, 30 days, year, or any timepast 7 days
dateFrom / dateToExact date range for searches (YYYY-MM-DD)-
maxArticlesPerQueryUp to 5,000; above 100 the search is split into date windows100
fullTextExtract the full article text, author, image and descriptiontrue
textFormatmarkdown or txtmarkdown
country / languageGoogle News edition, e.g. US/en, GB/en, MX/es-419, BR/pt-BR, DE/deUS / en
onlyNewArticlesScheduled runs: skip articles returned by previous runsfalse
failOnErrorMark the run as FAILED if a feed cannot be read, a link cannot be decoded or no articles are found (paywalls do not count)false
{
"queries": ["solar energy", "\"artificial intelligence\" regulation site:reuters.com"],
"topics": ["BUSINESS"],
"timeRange": "7d",
"country": "US",
"language": "en",
"maxArticlesPerQuery": 100
}

Output

One record per article. You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

{
"title": "Why some farmers are pairing crops and grazing sheep with solar panels",
"source": "DW.com",
"sourceUrl": "https://www.dw.com",
"publishedAt": "2026-09-25T10:24:13Z",
"url": "https://www.dw.com/en/why-farmers-are-pairing-crops-with-solar-panels/a-79233970",
"googleNewsUrl": "https://news.google.com/rss/articles/CBMihwFBVV95cUxP…",
"foundBy": ["search: solar energy"],
"author": "Josh Axelrod",
"image": "https://static.dw.com/image/79235972_6.jpg",
"description": "From cooler soil to paid grazing land, farmers in the US are finding that solar panels can do more than generate power.",
"text": "Traditionally, solar panel farms are quiet β€” save for the faint hum of the inverter. But on about one in 10 of American solar farms, there's a new sound reverberating through fields: baaaa. …",
"wordCount": 1056,
"fullTextStatus": "ok",
"textFormat": "markdown"
}

Data fields

FieldDescription
title, source, publishedAtHeadline, publisher and publication time from Google News
urlThe real article URL on the publisher's site
text, wordCountFull article text (Markdown or plain) and its length
fullTextStatusok, partial (free part of a paywalled article), paywall, blocked (the site refuses automated access), not-found or failed
author, image, description, articleDateMetadata from the article page
foundByWhich queries or topics found the article (duplicates are merged)
googleNewsUrlThe original news.google.com link

How much does it cost to scrape Google News?

EventPrice
Run start (per GB of memory, default 512 MB)$0.001
Article (title, source, date, real URL)$0.002
Full article text (only when extracted)$0.002

100 articles with full text cost about $0.40; headlines only, about $0.20. The full-text fee is not charged when a site blocks access, is paywalled or has no readable text. Set Max cost per run and the Actor stops cleanly at that limit.

Use it with AI agents (MCP)

Add https://mcp.apify.com?tools=fguiraud/google-news-scraper to Claude, Cursor or any MCP client and ask:

  • "Find this week's news about Tesla's robotaxi and summarize what analysts say."
  • "What are today's top business stories in the UK? Give me the key points of each."

Smallest useful input for an agent: {"queries": ["tesla robotaxi"], "timeRange": "7d", "maxArticlesPerQuery": 10}.

Tips

  • How many articles get full text? In our tests about 80%. Some large publishers (for example Reuters) block automated access; for those you still get the title, source, date and real URL.
  • Use Google operators to focus searches: "exact phrase", site:bbc.co.uk, intitle:earnings, -sports.
  • For alerts, schedule the Actor every hour or day with Only new articles on: you pay only for new stories.
  • Set Extract full article text off when you only need headlines: it is faster and costs half.
  • Long runs are safe: if the platform restarts the run, finished articles are skipped and never charged twice.
  • Want to measure how much interest a story creates? Google Trends Scraper returns search interest over time, by country and city, plus rising related searches and what is trending today.
  • Researching a competitor? Google Ads Transparency Scraper returns every Google Search, Display and YouTube ad of any advertiser or domain, with previews, dates and countries.

FAQ and limitations

  • Why not 100% full text? Paywalls and bot protection on some news sites; those articles are marked paywall or blocked and the full-text fee is not charged.
  • Can I get articles older than a year? Use dateFrom / dateTo; Google News coverage of older news varies by publisher.
  • Copyright: article texts belong to their publishers. Use them for analysis, monitoring and internal research, and check each publisher's terms before republishing.
  • Found a problem or need a feature? Open an issue on the Issues tab. Replies within 48 hours.