RSS Feed Reader: Dedup News, Changes & Full Text

Parse RSS and Atom news feeds into clean JSON with UTC dates, categories and enclosures. Remove duplicate stories across feeds, track new and changed items and optionally fetch the full article text. $0.50 per 1,000 items.

Store page: https://apify.com/nexo_data/rss-atom-news-changes-and-dedup

What can you do with this RSS/Atom feeds scraper?

• Aggregate news from many feeds into one deduplicated dataset
• Get only new articles on each scheduled run
• Extract full article text for summarization
• Power news alerts, newsletters and LLM digests

How to monitor RSS feeds with deduplication

1. Open the Actor on Apify Store and click Try for free.
2. Paste your input (see the example below) in the Input tab.
3. Click Start and wait for the run to finish.
4. Download results as JSON, CSV, Excel or HTML, or fetch them via the Apify API.

How to monitor RSS feeds with deduplication via API

curl -X POST "https://api.apify.com/v2/acts/nexo_data~rss-atom-news-changes-and-dedup/run-sync-get-dataset-items?token=YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"feedUrls": ["https://feeds.bbci.co.uk/news/world/rss.xml"], "maxItems": 10}'

You can also call it from Python/JS with the apify-client, schedule it, or connect it to Make, Zapier, n8n or an MCP-enabled AI agent.

How to schedule it for monitoring

Create an Apify Schedule (e.g. daily) with the same input. Combine with webhooks or integrations to get alerts in Slack, email or Google Sheets.

Input example

{
  "feedUrls": [
    "https://feeds.bbci.co.uk/news/world/rss.xml"
  ],
  "maxItems": 10
}

Output example

Each item in the dataset is one result. Typical fields are listed in the Output tab; export to JSON/CSV/Excel.

Pricing (pay per event)

You only pay for what you get — no monthly rental. Apify platform usage is included in the event prices below.

Event	What it is	Price
run-start	Run initialization (including invalid inputs) — One initialization event per run, including runtime input-validation failures.	$0.003 ($3.0 / 1,000)
source-check	Bounded public-source check — One bounded public-source request attempt; charged also when access fails or filters match nothing.	$0.001 ($1.0 / 1,000)
article-check	Optional linked article check — One bounded public-source request attempt; charged also when access fails or filters match nothing.	$0.002 ($2.0 / 1,000)
result	Delivered news item — One delivered usable news item. Error rows do not trigger this event.	$0.0005 ($0.5 / 1,000)

Tip: set Maximum cost per run in run options to cap spend. New Apify accounts get free monthly credits, so your first runs are effectively free.

FAQ

Is it legal to scrape RSS/Atom feeds? This Actor collects only publicly available data. Make sure your use complies with the site's terms and data protection laws (e.g. GDPR).

Do I need an API key or login? No. Only an Apify account.

What if a source fails? Failed or empty sources are reported in the output for diagnosis; you are not charged the result event for them.

Can I use it with AI agents / LLMs? Yes — output is structured JSON, ready for RAG, LangChain, LlamaIndex or the Apify MCP server.

Found a bug or need a feature? Open an issue in the Issues tab — we usually respond within 24 hours.