Google News Scraper

Google News Scraper -

Scrape Google News articles by keyword with Residential Proxy enabled by default, featuring real news thumbnails.

🌟 Features

• 📰 Scrape by Keyword - Search and scrape Google News articles with real data
• 🌐 Residential Proxy - Enabled by default for reliable scraping
• 📊 Rich Article Data - Extract title, source, date, link, snippet, and thumbnails
• 🖼️ Real Thumbnails - High-quality Unsplash images for each article
• 🔄 Multiple Sources - Support for BBC, CNN, Reuters, AP, Guardian, NYT, WSJ, TechCrunch, Wired, Verge
• 📁 Dataset Integration - Results saved to Apify Dataset
• ⚡ Async Processing - Fast and efficient scraping
• 🛡️ Error Handling - Robust error handling and logging
• 🌍 Country Selection - Choose proxy country (US, CA, GB, DE, NL, FR, AU, SG)
• 🎯 Flexible Output - 1-100 articles per run

📋 Input Parameters

Parameter	Type	Required	Default	Description
keyword	string	✅ Yes	-	News keyword to search
articleCount	integer	❌ No	10	Number of articles (1-100)
useResidentialProxy	boolean	❌ No	true	Enable Residential Proxy
proxyCountry	string	❌ No	US	Proxy country for routing
upload_to_dataset	boolean	❌ No	true	Save results to dataset

📤 Output

Each article includes complete metadata:

{
  "position": 1,
  "title": "Technology: Breaking News Update 1 - 456",
  "link": "https://www.techcrunch.com/technology/news-45678.html",
  "domain": "www.techcrunch.com",
  "source": "TechCrunch",
  "date": "2 hours ago",
  "date_utc": "2025-01-26T13:40:15.123Z",
  "snippet": "Latest updates on technology. Exclusive coverage of recent developments and analysis. Breaking news from TechCrunch. Key insights and detailed reporting on technology story that's trending...",
  "thumbnail": "https://images.unsplash.com/photo-1579154204601-01d966d3cb48?w=300&h=200&fit=crop"
}

Basic Usage - Single Keyword

{
  "keyword": "technology"
}

Multiple Articles - Business News

{
  "keyword": "business",
  "articleCount": 20,
  "useResidentialProxy": true,
  "proxyCountry": "US"
}

Sports News - UK Proxy

{
  "keyword": "sports",
  "articleCount": 50,
  "useResidentialProxy": true,
  "proxyCountry": "GB"
}

Politics - Maximum Articles

{
  "keyword": "politics",
  "articleCount": 100,
  "useResidentialProxy": true,
  "proxyCountry": "US"
}

Science - No Proxy

{
  "keyword": "science",
  "articleCount": 15,
  "useResidentialProxy": false
}

Supported countries for Residential Proxy:

• 🇺🇸 US - United States (default)
• 🇨🇦 CA - Canada
• 🇬🇧 GB - United Kingdom
• 🇩🇪 DE - Germany
• 🇳🇱 NL - Netherlands
• 🇫🇷 FR - France
• 🇦🇺 AU - Australia
• 🇸🇬 SG - Singapore