📰 Feed Extractor

Extract and normalize RSS/ATOM/JSON feed data from any URL using the powerful @extractus/feed-extractor library. Fast, reliable, and comprehensive feed parsing for content aggregation and news monitoring.

🚀 Why Feed Extractor?

• 📰 Complete Feed Parsing: Extracts feed metadata and all feed entries with normalized data
• 📡 Multiple Formats: Supports RSS, ATOM, and JSON feed formats
• 🔌 Simple API: Single URL input with optional customization parameters
• 💰 Cost Effective: No API keys required, works with any public feed URL
• 📂 Persistent Storage: Feed data is automatically saved to your Apify Key-Value store
• ⚡ Fast Processing: Quick extraction with configurable timeouts and options

📦 What You Get

✅ Complete Feed Data: Title, description, link, generator, language, publication date
✅ All Feed Entries: Normalized array of feed entries with titles, links, descriptions, and dates
✅ Structured Output: All feed data directly in dataset for immediate use
✅ Flexible Options: Customizable extraction parameters for different feed formats
✅ Error Handling: Robust error handling for various feed structures

🛠️ How It Works

Simply provide a feed URL (RSS/ATOM/JSON), and the actor will return structured feed data with all feed metadata and entries.

Input Example

{
  "url": "https://feeds.bbci.co.uk/news/rss.xml",
  "normalization": true,
  "useISODateFormat": true,
  "descriptionMaxLen": 250,
  "userAgent": "Mozilla/5.0 (compatible; FeedExtractor/1.0)"
}

Output Example

{
  "url": "https://feeds.bbci.co.uk/news/rss.xml",
  "title": "BBC News - World",
  "link": "https://www.bbc.co.uk/news/world/",
  "description": "BBC News - World",
  "generator": "BBC News",
  "language": "en-gb",
  "published": "2024-12-19T12:30:00.000Z",
  "entries": [
    {
      "id": "https://www.bbc.co.uk/news/world-europe-68678901",
      "title": "Ukraine war: Zelenskyy says victory is 'inevitable' despite Russian advances",
      "link": "https://www.bbc.co.uk/news/world-europe-68678901",
      "description": "President Zelenskyy has said Ukraine will win the war despite Russian gains near Avdiivka.",
      "published": "2024-12-19T12:30:00.000Z"
    },
    {
      "id": "https://www.bbc.co.uk/news/world-middle-east-68678902",
      "title": "Middle East crisis: Israel-Hamas talks continue as Gaza ceasefire hopes rise",
      "link": "https://www.bbc.co.uk/news/world-middle-east-68678902",
      "description": "Negotiators from Israel, Hamas and other parties are discussing a potential ceasefire deal.",
      "published": "2024-12-19T11:45:00.000Z"
    }
  ],
  "entryCount": 50,
  "normalization": true,
  "useISODateFormat": true,
  "descriptionMaxLen": 250
}

📋 Input Parameters

• url (required): The URL of the RSS/ATOM/JSON feed to extract
• normalization (optional): Normalize feed data or keep original (default: true)
• useISODateFormat (optional): Convert dates to ISO format (default: true)
• descriptionMaxLen (optional): Max characters for descriptions (default: 250, 0 = no truncation)
• baseUrl (optional): Base URL to absolutify relative links in feed content
• userAgent (optional): Custom User-Agent string for requests
• headers (optional): Additional HTTP headers as key-value pairs

💡 Top Use Cases

• News Aggregation: Build news aggregators and content feeds
• Content Monitoring: Track updates from RSS feeds automatically
• Social Media Bots: Generate posts from RSS feed updates
• Newsletter Tools: Extract content for email newsletters
• Research Tools: Gather data from multiple RSS sources
• Content Syndication: Distribute content across multiple platforms

---

Built for feed extraction at scale on the Apify platform.