News Archive Aggregator

Overview

Aggregates news articles from multiple free APIs: GNews (100/day), NewsData. io (200/day), and HackerNews (unlimited). Supports keyword search, date filtering, and deduplication.

Features

• Search by keywords to find specific results
• Filter results by category or type
• Export data in JSON, CSV, or Excel formats
• Control output volume with configurable result limits

Use Cases

• Track - Track entertainment listings and reviews
• Build - Build media databases for content analysis
• Monitor - Monitor entertainment industry trends and ratings
• Aggregate - Aggregate entertainment data for recommendation engines

Input Parameters

Parameter	Type	Description	Default
keywords	array	Keywords to search for in news articles. Leave empty to get latest news.	[]
sources	array	Which APIs to fetch news from	["hackernews"]
dateFrom	string	Start date for news articles (YYYY-MM-DD format)
dateTo	string	End date for news articles (YYYY-MM-DD format)
language	string	Language code for articles (e.g., en, es, fr, de)	en
category	string	News category filter	``
maxItems	integer	Maximum number of articles to return (after deduplication)	100
includeContent	boolean	Attempt to include full article content when available	true

Output Example

Each result contains structured data like this:

{
  "title": "Sample Entertainment Result",
  "rating": 4.5,
  "genre": "Drama",
  "releaseDate": "2025-01-15",
  "description": "Detailed description of the item...",
  "cast": [
    "Actor 1",
    "Actor 2"
  ],
  "url": "https://example.com/item/12345"
}

Pricing

This actor uses pay-per-result pricing:

• $0.001 per result
• $1.00 per 1,000 results

No monthly fees. You only pay for what you scrape. Apify Free plan includes $5/month in platform credits.

How to Run

Apify Console

1. Go to the News Archive Aggregator actor page
2. Configure your input parameters
3. Click Start and wait for the results
4. Download data in JSON, CSV, or Excel format

API

curl -X POST "https://api.apify.com/v2/acts/fortuitous_pirate~news-archive-scraper/runs?token=YOUR_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"maxItems": 10}'

Python SDK

from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("fortuitous_pirate/news-archive-scraper").call(
    run_input={"maxItems": 10}
)

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

Integration

Connect News Archive Aggregator with your existing tools and workflows:

• API access - Programmatic access via Apify API
• Webhooks - Get notified when scraping completes
• Scheduling - Set up recurring runs on any schedule
• Zapier / Make - Connect with 5,000+ apps via Apify integrations
• Python / Node.js SDKs - Native client libraries for easy integration