Google News Scraper

What data does Google News Scraper collect?

Our Google News Scraper allows you to extract news metadata such as title, link, source, publication date or image. The search is query-based but you can also extract general news by using an empty query.

The actor has a simple interface where you can specify your query as well as the language you want to use for news titles. Google News Scraper doesn't limit the number of results you can view which is a significant advantage when compared to manual browsing using Google News website. While using a regular Google News search, you'll only get approximately 100 results for your query. Our scraper can utilize automatic filtering by date ranges so whenever you specify maxItems greater than 100, it will search for the news by individual days up to the maxItems limit.

Example output

Extracted news for web scraping search query are stored in a following format:

1[
2    {
3      "title": "What is Web Scraping and What are Its Advantages?",
4      "link": "https://techreport.com/blog/3477873/what-is-web-scraping-and-advantages/",
5      "source": "The Tech Report",
6      "publishedAt": "2022-06-02T07:00:00.000Z",
7      "image": "https://techreport.com/wp-content/uploads/2022/06/pexels-markus-spiske-177598.jpg"
8    },
9    {
10      "title": "Web Scrapers And Their Targets Beware. Regulators Are Zeroing In On Privacy Implications",
11      "link": "https://www.jdsupra.com/legalnews/web-scrapers-and-their-targets-beware-5025499/",
12      "source": "JD Supra",
13      "publishedAt": "2021-11-18T08:00:00.000Z",
14      "image": "https://jdsupra-static.s3.amazonaws.com/profile-images/og.15069_1440.jpg"
15    }
16]

To get this more detailed output with image URLs, extractImages input field must be set to true. If you don't need any image links, definitely set extractImages to false as it makes actor's run much faster. You'll really see the difference as you can get around 10K results per 1 minute with extractImages disabled whereas you'll only get approximately 250 results within the same period when extracting images.

NOTE: Image URLs are fetched directly from target websites so they may not be necessarily the same as the ones you see on Google News website. The scraper uses Google News RSS API which doesn't provide any image links. On the other hand, using RSS API instead of browsing the website enables the scraper to get all the data by using just HTTP requests which is the fastest and most economical way. It is also a reason why the scraper can extract unlimited number of results.

How much will it cost to scrape Google News?

You'll get $5 to spend on Apify platform for free every month while being on Apify Free plan. You can get 40,000 results per month from Google News for that, so those 40,000 results will be completely free!

If you need to scrape data from Google News regularly, you should get an Apify subscription. We recommend our $49/month Personal plan which you can use to scrape up to 400,000 news each month.

And when you're in need of a bigger scale, we got you covered with our $499 Team plan.