RSS Feed Scraper & Reader — RSS, Atom, RDF, JSON Feed & Sitemap to Clean JSON

The universal RSS feed parser for AI agents and no-code automation. Turn any RSS 2.0, Atom, RDF, JSON Feed or XML sitemap into clean, structured JSON — with title, link, author, date, content, categories, media and full article text. Built for LLM/RAG pipelines, news aggregation, podcast monitoring and n8n / Make / Zapier workflows.

Works on millions of blogs, news sites, podcasts, Substacks, Medium publications and YouTube channels. No API keys required to start.

Why this RSS scraper

• 5 feed formats, one actor — RSS 2.0, Atom, RDF (RSS 1.0), JSON Feed and XML sitemaps, auto-detected.
• Full article text for AI — feeds usually give only a short excerpt. Enable fullText to fetch clean, LLM-ready markdown of the whole article (ads and boilerplate removed).
• Feed auto-discovery — give a plain site URL (e.g. https://example.com) and it finds the RSS/Atom/JSON feed for you.
• Bulk multi-feed — fetch hundreds of feeds in parallel, then deduplicate and merge them into one chronological stream.
• Change monitoring (delta) — return only items that are new since the last run. Perfect for scheduled monitoring.
• Keyword & date filters — keep only items matching your keywords or published in the last N days.
• OPML import — migrate hundreds of feeds from Feedly / Inoreader in one field.
• Podcast-aware — extracts iTunes tags (duration, episode, season, explicit) and enclosures (audio/MP3, images, attachments).
• Datacenter proxy by default — feed requests are routed through Apify Proxy to avoid IP blocks.

Supported formats

Format	Example source
RSS 2.0	https://techcrunch.com/feed/
Atom	https://xkcd.com/atom.xml
RDF / RSS 1.0	https://rss.slashdot.org/Slashdot/slashdotMain
JSON Feed	https://daringfireball.net/feeds/json
XML Sitemap	https://example.com/sitemap.xml
Site URL (auto-discover)	https://techcrunch.com

Quick start

Single feed

{ "feedUrls": ["https://hnrss.org/frontpage"] }

Bulk news aggregator (dedup + newest first)

{
  "feedUrls": [
    "https://techcrunch.com/feed/",
    "https://www.theverge.com/rss/index.xml",
    "https://feeds.arstechnica.com/arstechnica/index"
  ],
  "maxItems": 50,
  "deduplicate": true,
  "sortByDate": true
}

Full article text for AI / LLM

{
  "feedUrls": ["https://techcrunch.com/feed/"],
  "maxItems": 25,
  "fullText": true
}

Keyword monitoring on a schedule

{
  "feedUrls": ["https://hnrss.org/frontpage"],
  "keywords": ["AI", "python", "startup"],
  "maxAgeDays": 7,
  "onlyNew": true
}

Import your Feedly / Inoreader OPML

{ "opmlUrl": "https://example.com/feedly-export.opml" }

Input parameters

Field	Type	Description
feedUrls	string[]	RSS/Atom/RDF/JSON Feed/sitemap URLs, or plain site URLs (feed auto-discovered)
maxItems	int	Limit items per feed (0 = all). Default: 100
stripHtml	bool	Return plain text (true) or original HTML (false). Default: true
extractFeedMetadata	bool	Include feed title/description/language on each item. Default: true
deduplicate	bool	Remove duplicate items across feeds. Default: true
sortByDate	bool	Merge all feeds into one newest-first stream. Default: false
onlyNew	bool	Return only items not seen in previous runs (delta monitoring). Default: false
keywords	string[]	Keep only items containing any of these keywords
maxAgeDays	int	Keep only items from the last N days (0 = no limit)
fullText	bool	Fetch clean full article text (ads/boilerplate removed). Default: false
fullTextApiKey	string	Optional API key for the full-text reader — improves reliability at high volume
opmlUrl	string	URL of an OPML file to import (Feedly/Inoreader export)
maxConcurrency	int	Parallel fetches. Default: 5
timeout	int	HTTP timeout per feed in seconds. Default: 20
proxyConfiguration	object	Apify Proxy settings (datacenter by default)

Output

One dataset row per item:

{
  "feedUrl": "https://techcrunch.com/feed/",
  "feedTitle": "TechCrunch",
  "title": "Example article title",
  "link": "https://techcrunch.com/2026/...",
  "guid": "https://techcrunch.com/?p=123",
  "pubDate": "Mon, 13 Jul 2026 18:22:10 +0000",
  "datePublished": "2026-07-13T18:22:10+00:00",
  "author": "Jane Doe",
  "description": "Short summary...",
  "content": "Article content from the feed...",
  "categories": "AI, Startups",
  "enclosures": [{ "url": "https://.../audio.mp3", "type": "audio/mpeg", "length": "12345" }],
  "fullText": "Full clean article text (when fullText is enabled)..."
}

Every item gets a normalized ISO-8601 datePublished so dates from RSS (RFC-822) and Atom/JSON (ISO) are consistent — ideal for sorting and feeding LLMs.

Use cases

• AI agents / LLM & RAG pipelines — clean full-text JSON to summarize, embed or monitor industry news.
• News aggregation — build a niche news site or a Slack/Discord digest bot from dozens of sources.
• Content monitoring — track keywords across feeds and get only new matches on a schedule (onlyNew).
• Podcast pipelines — pull episodes with audio enclosures and iTunes metadata.
• Medium / Substack / YouTube tracking — follow newsletters and channels via their RSS feeds.
• SEO & competitive research — analyze competitor publishing frequency and topics.

Full-text extraction notes

fullText fetches each article and returns clean, LLM-ready text with ads and boilerplate removed.

• Works out of the box for roughly up to ~75 articles per run; beyond that some items may return a fullTextError instead of fullText (the item is still returned with its feed excerpt).
• Requests are spread across rotating datacenter proxy IPs to maximize throughput.
• For reliable high-volume full-text, set the optional fullTextApiKey.

Pricing

• $0.001 per item ($1 per 1,000 items).
• Broken or unreachable feeds are skipped cleanly.

How it works

1. Route the request through Apify datacenter proxy (avoids IP blocks).
2. Fetch the URL and auto-detect the format (RSS / Atom / RDF / JSON Feed / sitemap), or discover a feed from an HTML page.
3. Parse items with namespace-aware stdlib XML / JSON — no heavy dependencies, fast cold starts.
4. Deduplicate, filter (keywords / age), apply delta, and optionally sort by date.
5. Optionally fetch clean full article text (ads/boilerplate removed).
6. Push structured JSON to the dataset.

Tips

• YouTube as RSS: https://www.youtube.com/feeds/videos.xml?channel_id=<id> (free, no API quota).
• Substack: append /feed to any Substack URL.
• Medium: https://medium.com/feed/@user or medium.com/feed/publication-name.
• Scheduling: Apify Scheduler + onlyNew: true = a real-time change monitor with no duplicates.