Website to RSS / Change Monitor
Pricing
from $15.00 / 1,000 new feed items
Website to RSS / Change Monitor
Turn public websites into RSS, Atom, and JSON Feed. Auto-detects articles, obeys robots.txt, optional Playwright, and monitors for new items across runs with webhooks. Pay $0.015 per new item. No login or paywall bypass.
Pricing
from $15.00 / 1,000 new feed items
Rating
0.0
(0)
Developer
Jerry Lin
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
6 days ago
Last modified
Categories
Features
Share
Turns public website listing pages into RSS 2.0, Atom 1.0, and JSON Feed 1.1, with optional stateful change detection and webhooks.
Always obeys
robots.txt. No login / paywall bypass. Identifying User-Agent. Polite rate limits.
What it does
| Capability | Details |
|---|---|
| Multi-URL input | Process a list of public index / listing pages in one run |
| Auto-detect | Heuristics: <article> cards, heading links, repeated link blocks, dates |
| Manual selectors | Optional CSS: item, title, link, date, summary |
| Fetch modes | Default: plain HTTP + Cheerio. Optional: Playwright for JS-rendered pages |
| Feeds | RSS 2.0, Atom, JSON Feed written to the run key-value store |
| Change monitor | Named KV store keyed by source URL; emit / charge only new items |
| Webhook | Optional POST when new items appear |
| robots.txt | Always enforced. Disallowed URLs → blocked_by_robots, never charged |
Inputs (summary)
| Field | Default | Notes |
|---|---|---|
urls | required | Public http(s) listing URLs |
maxItemsPerUrl | 30 | Cap per source |
outputFormats | rss, atom, json | KV feed files |
usePlaywright | false | Enable for JS-heavy sites |
itemSelector etc. | empty | Manual CSS overrides |
stateStoreName | website-rss-monitor-state | Cross-run memory |
emitOnlyNew | true | Dataset + PPE only for new items |
webhookUrl | empty | JSON POST on new items |
requestDelayMs | 1000 | Polite delay |
maxConcurrency | 1 | Keep low |
Output
Dataset items
{"sourceUrl": "https://www.example.gov/news","url": "https://www.example.gov/news/123","title": "Announcement title","summary": "…","date": "2026-11-01T00:00:00.000Z","isNew": true,"status": "ok","detectedAt": "2026-11-09T13:00:00.000Z"}
status may also be blocked_by_robots, fetch_error, or no_items.
Key-value store
feed_<host>_<hash>.xml— RSS 2.0feed_<host>_<hash>.atom— Atom 1.0feed_<host>_<hash>.json— JSON Feed 1.1OUTPUT_SUMMARY— run summary JSON
On the Apify platform, KV records get public URLs you can subscribe to from feed readers (re-run on a schedule to refresh).
How much does it cost?
Pay-per-event pricing – no subscription, no separate compute bill:
| Event | Price |
|---|---|
feed-item – one new feed item in the dataset | $0.015 |
| Actor start (per GB of memory; default 1 GB = 1 event) | $0.005 |
Never charged as feed-item: blocked_by_robots rows, fetch errors, empty extracts, or previously seen items (when emitOnlyNew is true).
Example run costs
| Scenario | Events | Approx. cost |
|---|---|---|
| Monitor tick, 0 new posts | start only | $0.005 |
| First snapshot, 1 new item | start + 1 | $0.02 |
| First snapshot, 10 new items | start + 10 | $0.155 |
| Daily delta, 3 new items | start + 3 | $0.05 |
Formula: 0.005 + 0.015 × N new items (at the default 1 GB memory).
Legal / responsibility
- This Actor only fetches publicly reachable pages you supply.
- It checks and obeys
robots.txt. Disallowed URLs are skipped and never billed. - It does not log in, solve CAPTCHAs, or bypass paywalls / access controls.
- You (the run operator) are responsible for ensuring your use of extracted public content complies with the target site’s terms, copyright, and applicable law.
- Prefer official feeds / open data APIs when a site already provides them.
Use with AI agents (MCP)
Add this Actor as a tool in any MCP client (Claude, Cursor, VS Code, ChatGPT connectors) through the official Apify MCP server:
https://mcp.apify.com?tools=rationalistic_tail/website-to-rss-monitor
Example agent request: "What's new on blog.cloudflare.com since last time?" → the agent calls the tool with {"urls": ["https://blog.cloudflare.com/"]} and reads the new items from the dataset (or OUTPUT_SUMMARY). Keep stateStoreName the same between runs to get only new items. The Actor runs with limited permissions, so it also works with prepaid agent tokens from Apify AGI (x402 / Skyfire).
繁體中文(簡短)
網站轉 RSS / 更新監控 — 把公開網頁列表轉成 RSS、Atom、JSON Feed;可自動偵測文章區塊,也可自訂 CSS;預設用 HTTP+Cheerio,需要時才開 Playwright。會遵守 robots.txt(禁止則標記 blocked_by_robots 且不收費),不做登入或付費牆繞過。跨 run 用命名 KV store 做變更偵測,只對新項目計費。
計費採 pay-per-event:每筆新項目 feed-item USD 0.015,每次執行起始費 USD 0.005;被 robots.txt 擋下、抓取失敗或已看過的項目不收費。
法律/責任聲明: 僅抓取你提供的公開網址;請自行確認目標網站條款與著作權是否允許此用途。官方已有 RSS/開放資料時請優先使用官方來源。