Google News Scraper avatar

Google News Scraper

Try for free

7 days trial then $20.00/month - No credit card required now

Go to Store
Google News Scraper

Google News Scraper

lhotanova/google-news-scraper
Try for free

7 days trial then $20.00/month - No credit card required now

Gets featured articles from Google News with title, link, source, publication date and image.

What data does Google News Scraper collect?

Google News Scraper allows you to extract news metadata such as title, link, source, publication date or image. The search is query-based but you can also extract general news by using an empty query.

The actor has a simple interface where you can specify your query as well as the language you want to use for news titles. Google News Scraper doesn't limit the number of results you can view which is a significant advantage when compared to manual browsing using Google News website. While using a regular Google News search, you'll only get approximately 100 results for your query. This scraper can utilize automatic filtering by date ranges so whenever you specify maxItems greater than 100, it will search for the news by individual days up to the maxItems limit.

You can also specify your custom date range using dateFrom and dateTo input fields in the format YYYY-MM-DD.

Example output

Extracted news for web scraping search query are stored in a following format:

1[
2  {
3    "title": "A win at last: Big blow to AI world in training data copyright scrap",
4    "link": "https://www.theregister.com/2025/02/12/thomson_reuters_wins_ai_copyright/",
5    "guid": "CBMifkFVX3lxTFByV0JDX09JaDR4bmNfX3AzWVFRbjMwdWNKcmtWQ255MEVGa2lCTHBpTE5JbFFWMG5nVFE1T2M0alVfY0N2N3ZFdFJDV3FrUjhVeDZ2dkQxQUNwb1FPcm9kMV9KYXk0ZUNnN1BDNDlZUXZtY3ktemgwWkpNU3Nxd9IBgwFBVV95cUxPc2tobXlKUmcwR0wyR0podklDS2MzMDhpQTd6N2NVbnRqYndPSVVmckV1Tk82TkNDck1JbmFuUU0yUjByTDE4VFRGVC1jTUc2M0VPOE1wX1RUZWpfOG9DamVmX21lWERuU0JGcHJyVDZQdEFDTHNNZjFQV1BQNkN0SjhaSQ",
6    "source": "The Register",
7    "sourceUrl": "https://www.theregister.com",
8    "publishedAt": "2025-02-12T01:45:00.000Z",
9    "loadedUrl": "https://www.theregister.com/2025/02/12/thomson_reuters_wins_ai_copyright/",
10    "rssLink": "https://news.google.com/rss/articles/CBMifkFVX3lxTFByV0JDX09JaDR4bmNfX3AzWVFRbjMwdWNKcmtWQ255MEVGa2lCTHBpTE5JbFFWMG5nVFE1T2M0alVfY0N2N3ZFdFJDV3FrUjhVeDZ2dkQxQUNwb1FPcm9kMV9KYXk0ZUNnN1BDNDlZUXZtY3ktemgwWkpNU3Nxd9IBgwFBVV95cUxPc2tobXlKUmcwR0wyR0podklDS2MzMDhpQTd6N2NVbnRqYndPSVVmckV1Tk82TkNDck1JbmFuUU0yUjByTDE4VFRGVC1jTUc2M0VPOE1wX1RUZWpfOG9DamVmX21lWERuU0JGcHJyVDZQdEFDTHNNZjFQV1BQNkN0SjhaSQ?oc=5",
11    "image": "https://regmedia.co.uk/2021/08/02/shutterstock_robot_justice.jpg"
12  },
13  {
14    "title": "Web Scraping Optimization: Tips for Faster, Smarter Scrapers",
15    "link": "https://hackernoon.com/web-scraping-optimization-tips-for-faster-smarter-scrapers",
16    "guid": "CBMiiAFBVV95cUxQUXh5WVZ2RkNpNG9ndjF6V3hMRHBRTGRSVnNkelpwZDY2TWJzejBSMGZrRC1rSm5DZ1BxanpoeFFGdDRjWGpZR0tOUG9FY0kyeWFXOE9MSzBobTg1ajRiZzVhSWhtbm5nSVNJVWExSDBSaEFjUUJkT1JRRDJHSDBrMU9jU2ZZN3RN",
17    "source": "hackernoon.com",
18    "sourceUrl": "https://hackernoon.com",
19    "publishedAt": "2024-11-15T08:00:00.000Z",
20    "loadedUrl": "https://hackernoon.com/web-scraping-optimization-tips-for-faster-smarter-scrapers",
21    "rssLink": "https://news.google.com/rss/articles/CBMiiAFBVV95cUxQUXh5WVZ2RkNpNG9ndjF6V3hMRHBRTGRSVnNkelpwZDY2TWJzejBSMGZrRC1rSm5DZ1BxanpoeFFGdDRjWGpZR0tOUG9FY0kyeWFXOE9MSzBobTg1ajRiZzVhSWhtbm5nSVNJVWExSDBSaEFjUUJkT1JRRDJHSDBrMU9jU2ZZN3RN?oc=5",
22    "image": "https://hackernoon.imgix.net/images/0FC9YtxD4fbD3T7mPipOt4HSxY42-7y034nb.png"
23  }
24]

To get detailed output with decoded article links and image URLs, fetchArticleDetails input field must be set to true. If you switch fetchArticleDetails to false, the run will be significantly faster and cheaper but you will only get URLs in the format of RSS feed, such as: "https://news.google.com/rss/articles/CBMiiAFBVV95cUxQUXh5WVZ2RkNpNG9ndjF6V3hMRHBRTGRSVnNkelpwZDY2TWJzejBSMGZrRC1rSm5DZ1BxanpoeFFGdDRjWGpZR0tOUG9FY0kyeWFXOE9MSzBobTg1ajRiZzVhSWhtbm5nSVNJVWExSDBSaEFjUUJkT1JRRDJHSDBrMU9jU2ZZN3RN?oc=5". The output will then change into this simple format:

1[
2  {
3    "title": "How I used Scrapy and Scrapy Playwright to take screenshot",
4    "link": "https://news.google.com/rss/articles/CBMigAFBVV95cUxQRDJDNW1ONklDTlhJN3lsWlIwdTEzV050d284bnZ4YWo2TnQ3MU1XcUZkdHNZTTMxSTZ4NjkwRnh0UFloa0ZsZ0d5Qmx0NjRFd25qMXdBTmN6TVBmcHdKdXhGWnRCSDVMdjVJZlJkTlRTMjZSZXZwdGNYM28xbE9uTA?oc=5",
5    "guid": "CBMigAFBVV95cUxQRDJDNW1ONklDTlhJN3lsWlIwdTEzV050d284bnZ4YWo2TnQ3MU1XcUZkdHNZTTMxSTZ4NjkwRnh0UFloa0ZsZ0d5Qmx0NjRFd25qMXdBTmN6TVBmcHdKdXhGWnRCSDVMdjVJZlJkTlRTMjZSZXZwdGNYM28xbE9uTA",
6    "source": "substack.com",
7    "sourceUrl": "https://substack.com",
8    "publishedAt": "2024-06-09T07:00:00.000Z"
9  },
10  {
11    "title": "Beyond the Buzz: Making AI Work for Large-Scale Web Data Collection",
12    "link": "https://news.google.com/rss/articles/CBMisgFBVV95cUxPVXVJeGNPTWI0bXVmOWdSc1B5MVpDRWVnX1R3QV8wdzRmb2VNU1hneU9wNEZrMGdOT2Fqc1Rremg1R0lmM1NBdjZJa3llOXc2bDVzN3RwNVppZnJ3Q1FTS1NsRUVxOTlwWl9QNlJYMUpPYUxKeFVRSWpCYXNaOVU2aFZ0RWNzd200cmRRQlJoUE8tcnU2bXNIQkZNOXUxRDBzTXAxSEMtMG5lLTRsdlVWZFRB?oc=5",
13    "guid": "CBMisgFBVV95cUxPVXVJeGNPTWI0bXVmOWdSc1B5MVpDRWVnX1R3QV8wdzRmb2VNU1hneU9wNEZrMGdOT2Fqc1Rremg1R0lmM1NBdjZJa3llOXc2bDVzN3RwNVppZnJ3Q1FTS1NsRUVxOTlwWl9QNlJYMUpPYUxKeFVRSWpCYXNaOVU2aFZ0RWNzd200cmRRQlJoUE8tcnU2bXNIQkZNOXUxRDBzTXAxSEMtMG5lLTRsdlVWZFRB",
14    "source": "GeekWire",
15    "sourceUrl": "https://www.geekwire.com",
16    "publishedAt": "2024-11-26T08:00:00.000Z"
17  }
18]

NOTE: Image URLs are fetched directly from target websites so they may not be necessarily the same as the ones you see on Google News website. The scraper uses Google News RSS API which doesn't provide any image links. On the other hand, using RSS API instead of browsing the website enables the scraper to get all the data by using just HTTP requests which is the fastest and most economical way. It is also a reason why the scraper can extract unlimited number of results.

How much will it cost to scrape Google News?

You'll get $5 to spend on Apify platform for free every month while being on Apify Free plan. You can get 40,000 results per month from Google News for that, so those 40,000 results will be completely free!

If you need to scrape data from Google News regularly, you should get an Apify subscription. We recommend our $49/month Personal plan which you can use to scrape up to 400,000 news each month.

And when you're in need of a bigger scale, we got you covered with our $499 Team plan.

Developer
Maintained by Community

Actor Metrics

  • 154 monthly users

  • 25 stars

  • >99% runs succeeded

  • 2.5 days response time

  • Created in Oct 2022

  • Modified 2 days ago

Categories