Google News Scraper

Pull live Google News results by keyword, topic, or top headlines and get them back as clean, structured rows. Built on the public Google News RSS feed, so there is no login, no API key, and no captcha. Route it through Apify Proxy and run it on a schedule, via API, or from your own code.

What it does

Give it a search term and it returns the matching news articles: headline, source, publish time, article link, and a short snippet. Skip the search term and pick a topic (technology, business, sports, and the rest) to get that section's headlines, or leave both empty for the top headlines of the day.

Input

• query: keyword or phrase to search. Supports Google News operators like when:7d, site:reuters.com, and OR.
• additionalQueries: extra search terms to fetch in the same run, one feed each.
• topic: section headlines (World, Nation, Business, Technology, Entertainment, Sports, Science, Health). Used only when no query is set.
• language: interface language, for example en-US, fr, de.
• country: edition country, for example US, GB, IN.
• maxItemsPerQuery: cap per feed. Google News RSS returns up to about 100 items per feed. 0 means no cap.
• proxyConfiguration: Apify Proxy settings.

Default run: searches artificial intelligence and returns up to 50 recent articles.

Output

One row per article:

• title: headline with the trailing source name removed
• fullTitle: original headline as Google returns it
• source: publisher name
• sourceUrl: publisher homepage
• link: Google News article link
• guid: stable article id
• publishedAt: ISO 8601 timestamp
• publishedRaw: original RFC 822 date string
• snippet: short text description
• query, topic, feedTitle: what produced the row

Notes

Google News RSS caps each feed at roughly 100 items. To gather more, split your work across several queries (use additionalQueries) or narrow with date operators such as when:1d. The scraper retries failed fetches and rotates the proxy IP between attempts.