Website to RSS / Change Monitor avatar

Website to RSS / Change Monitor

Pricing

from $15.00 / 1,000 new feed items

Go to Apify Store
Website to RSS / Change Monitor

Website to RSS / Change Monitor

Turn public websites into RSS, Atom, and JSON Feed. Auto-detects articles, obeys robots.txt, optional Playwright, and monitors for new items across runs with webhooks. Pay $0.015 per new item. No login or paywall bypass.

Pricing

from $15.00 / 1,000 new feed items

Rating

0.0

(0)

Developer

Jerry Lin

Jerry Lin

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

6 days ago

Last modified

Features

Limited permissions

Share

Turns public website listing pages into RSS 2.0, Atom 1.0, and JSON Feed 1.1, with optional stateful change detection and webhooks.

Always obeys robots.txt. No login / paywall bypass. Identifying User-Agent. Polite rate limits.

What it does

CapabilityDetails
Multi-URL inputProcess a list of public index / listing pages in one run
Auto-detectHeuristics: <article> cards, heading links, repeated link blocks, dates
Manual selectorsOptional CSS: item, title, link, date, summary
Fetch modesDefault: plain HTTP + Cheerio. Optional: Playwright for JS-rendered pages
FeedsRSS 2.0, Atom, JSON Feed written to the run key-value store
Change monitorNamed KV store keyed by source URL; emit / charge only new items
WebhookOptional POST when new items appear
robots.txtAlways enforced. Disallowed URLs → blocked_by_robots, never charged

Inputs (summary)

FieldDefaultNotes
urlsrequiredPublic http(s) listing URLs
maxItemsPerUrl30Cap per source
outputFormatsrss, atom, jsonKV feed files
usePlaywrightfalseEnable for JS-heavy sites
itemSelector etc.emptyManual CSS overrides
stateStoreNamewebsite-rss-monitor-stateCross-run memory
emitOnlyNewtrueDataset + PPE only for new items
webhookUrlemptyJSON POST on new items
requestDelayMs1000Polite delay
maxConcurrency1Keep low

Output

Dataset items

{
"sourceUrl": "https://www.example.gov/news",
"url": "https://www.example.gov/news/123",
"title": "Announcement title",
"summary": "…",
"date": "2026-11-01T00:00:00.000Z",
"isNew": true,
"status": "ok",
"detectedAt": "2026-11-09T13:00:00.000Z"
}

status may also be blocked_by_robots, fetch_error, or no_items.

Key-value store

  • feed_<host>_<hash>.xml — RSS 2.0
  • feed_<host>_<hash>.atom — Atom 1.0
  • feed_<host>_<hash>.json — JSON Feed 1.1
  • OUTPUT_SUMMARY — run summary JSON

On the Apify platform, KV records get public URLs you can subscribe to from feed readers (re-run on a schedule to refresh).

How much does it cost?

Pay-per-event pricing – no subscription, no separate compute bill:

EventPrice
feed-item – one new feed item in the dataset$0.015
Actor start (per GB of memory; default 1 GB = 1 event)$0.005

Never charged as feed-item: blocked_by_robots rows, fetch errors, empty extracts, or previously seen items (when emitOnlyNew is true).

Example run costs

ScenarioEventsApprox. cost
Monitor tick, 0 new postsstart only$0.005
First snapshot, 1 new itemstart + 1$0.02
First snapshot, 10 new itemsstart + 10$0.155
Daily delta, 3 new itemsstart + 3$0.05

Formula: 0.005 + 0.015 × N new items (at the default 1 GB memory).

  • This Actor only fetches publicly reachable pages you supply.
  • It checks and obeys robots.txt. Disallowed URLs are skipped and never billed.
  • It does not log in, solve CAPTCHAs, or bypass paywalls / access controls.
  • You (the run operator) are responsible for ensuring your use of extracted public content complies with the target site’s terms, copyright, and applicable law.
  • Prefer official feeds / open data APIs when a site already provides them.

Use with AI agents (MCP)

Add this Actor as a tool in any MCP client (Claude, Cursor, VS Code, ChatGPT connectors) through the official Apify MCP server:

https://mcp.apify.com?tools=rationalistic_tail/website-to-rss-monitor

Example agent request: "What's new on blog.cloudflare.com since last time?" → the agent calls the tool with {"urls": ["https://blog.cloudflare.com/"]} and reads the new items from the dataset (or OUTPUT_SUMMARY). Keep stateStoreName the same between runs to get only new items. The Actor runs with limited permissions, so it also works with prepaid agent tokens from Apify AGI (x402 / Skyfire).


繁體中文(簡短)

網站轉 RSS / 更新監控 — 把公開網頁列表轉成 RSS、Atom、JSON Feed;可自動偵測文章區塊,也可自訂 CSS;預設用 HTTP+Cheerio,需要時才開 Playwright。會遵守 robots.txt(禁止則標記 blocked_by_robots 且不收費),不做登入或付費牆繞過。跨 run 用命名 KV store 做變更偵測,只對新項目計費。

計費採 pay-per-event:每筆新項目 feed-item USD 0.015,每次執行起始費 USD 0.005;被 robots.txt 擋下、抓取失敗或已看過的項目不收費。

法律/責任聲明: 僅抓取你提供的公開網址;請自行確認目標網站條款與著作權是否允許此用途。官方已有 RSS/開放資料時請優先使用官方來源。