Google News Scraper

What does Google News Scraper do?

Google News scraper is designed to scrape news data based on given keywords. It fetches and returns the news title, URL, source, and the date of publication. Some of its features include:

Keyword-based Search: The actor searches news based on the provided keywords. Language Selection: You can specify the language for the search, ensuring relevancy in news from different regions. Time-specific Search: Option to add a specific date or time range for the search.

Why should I scrape Google News?

Automated News Collection: Instead of manually searching for news, get all relevant news articles programmatically. Time-saving: Get news articles from various sources in one place, saving time. Tailored Search: The flexibility to specify keywords, language, and time ensures that the search is tailored to your needs.

How much will it cost to scrape Google News?

When it comes to scraping, it can be challenging to estimate the resources needed to extract data as use cases may vary significantly. That's why the best course of action is to run a test scrape with a small sample of input data and limited output. You’ll get your price per scrape, which you’ll then multiply by the number of scrapes you intend to do.

Watch this video for a few helpful tips. And don't forget that choosing a higher plan will save you money in the long run.

Is it legal to scrape Google News?

Our scrapers are ethical and do not extract any private user data, such as email addresses, gender, or location. They only extract what the user has chosen to share publicly. We therefore believe that our scrapers, when used for ethical purposes by Apify users, are safe. However, you should be aware that your results could contain personal data. Personal data is protected by the GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. You can also read Apify blog post on the legality of web scraping.

Input

Google News Scraper has the following input options:

1{
2    "keyword_list": [
3        "jeff bezos",
4        "iphone 14"
5    ],
6    "language": "en-US",
7    "date": "Last 1 day"
8}

You can remove date part if you don't want to specify a specific date range. Default language is "en-US". You can change this to search in any language you want.

Output

You can download the dataset extracted by Google News Scraper in various formats such as JSON, HTML, CSV, or Excel. A sample result for each news will be as following:

1{
2  "keyword": "rare beauty",
3  "title": "Selena Gomez's new Rare Beauty tinted lip oil is selling out fast",
4  "source": "USA TODAY",
5  "link": "https://www.usatoday.com/story/money/reviewed/2023/03/27/selena-gomezs-rare-beauty-launches-tinted-lip-oil/11548961002/",
6  "date": "2023-03-27 00:00:00"
7}