Google News Article Scraper

📰 Google News Article Scraper

🚀 Smart Google News Scraper automatically collects Google News results. Instead of just headlines, it delivers structured, AI-ready JSON output—perfect for news aggregation, research, and trend analysis 📊🤖.

Scrape Google News, extract full article content with metadata, images 🖼️, and structured data.

✨ Features

• 🔍 Google News Scraping - Search Google News with custom queries
• 📅 Date Range Filtering - Filter articles by date (from/to)
• 🌍 Multi-country Support - Scrape news from different countries (US, IN, GB, etc.)
• 🗣️ Multi-language Support - Get results in multiple languages
• 📄 Full Article Extraction - Extract complete article content and metadata
• 🖼️ Image Extraction - Capture article images (og:image, twitter:image)
• 👤 Author Detection - Extract article authors
• 📊 Structured Output - Export as JSON/CSV
• 🔄 Proxy Rotation - Apify proxy support to avoid blocking
• 🎯 Session Management - Smart session pooling for better success rates
• ⚡ High Performance - Concurrent crawling with configurable limits
• 🛡️ Error Handling - Automatic retries and graceful error handling
• 🚫 Duplicate Removal - Automatic deduplication of articles

Example Input

{
  "query": "climate change",
  "maxResults": 50,
  "fromDate": "2026-01-01",
  "toDate": "2026-02-12",
  "country": "US",
  "language": "en",
  "useProxy": true
}

📤 Output Schema

Each article in the dataset contains:

{
  "title": "Article headline",
  "description": "Meta description or article summary",
  "author": "Author name",
  "publishedDate": "2026-02-12T10:30:00Z",
  "image": "https://example.com/image.jpg",
  "articleText": "Full article content...",
  "url": "https://example.com/article",
  "domain": "example.com",
  "scrapedAt": "2026-02-12T15:45:30.123Z"
}

🔍 Use Cases

• Media Monitoring - Track news mentions of brands/topics
• Market Research - Analyze industry trends and sentiment
• Content Aggregation - Build news aggregators
• Competitive Intelligence - Monitor competitor coverage
• Academic Research - Collect news data for analysis
• SEO/Content Strategy - Discover trending topics
• Crisis Management - Real-time news monitoring

📨 Contact

Built with ❤️ by Webcrap Team

---

⭐ If you find this actor useful, please give it a star!