RSS, Atom & JSON Feed Reader with Feed Discovery avatar

RSS, Atom & JSON Feed Reader with Feed Discovery

Pricing

$2.00 / 1,000 feed items

Go to Apify Store
RSS, Atom & JSON Feed Reader with Feed Discovery

RSS, Atom & JSON Feed Reader with Feed Discovery

Read RSS, Atom and JSON Feed sources into clean dataset rows: title, link, published date (ISO), author, categories, summary, optional full content, enclosure. Paste a website and it finds the feed for you. Dedupes across feeds, filters by keyword and date. Public feeds only.

Pricing

$2.00 / 1,000 feed items

Rating

0.0

(0)

Developer

Northpine Studio

Northpine Studio

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

17 days ago

Last modified

Share

RSS, Atom & JSON Feed Reader

Turn any public RSS, Atom or JSON Feed into clean dataset rows. Paste a website and it finds the feed for you.

What it does

  • Reads RSS 0.9x/2.0, RSS 1.0 (RDF), Atom and JSON Feed 1.x.
  • If a URL is a web page, it reads the feeds the page advertises (<link rel="alternate">), falling back to /feed, /rss, /rss.xml, /feed.xml, /atom.xml, /index.xml.
  • Output fields: title, link, guid, published (ISO 8601), author, categories, summary (plain text, 500 chars), enclosure (podcast/media URL), feedTitle, feedUrl, feedFormat, plus content (HTML) when includeContent is on.
  • Dedupes across feeds, filters by keyword and publish date. Key-value store SUMMARY lists feeds read, counts and per-URL errors.

Input

FieldMeaning
startUrlsFeed URLs or website pages
maxItemsPerFeed / maxItemsCaps per feed / in total (defaults 50 / 1000)
keywordsKeep items matching any keyword (title, summary, categories)
publishedAfterYYYY-MM-DD
includeContentInclude full HTML content
discoverLook for feeds on web pages (default true)
delayMsDelay between requests (default 300)

Example: { "startUrls": ["https://hnrss.org/frontpage"], "keywords": ["rust"], "maxItems": 20 }

Terms and scope

Fetches only feeds that sites publish for machine consumption, sequentially, with a declared user agent. It does not scrape page content. Feed content remains the publisher's; check their terms before reusing it commercially.

Develop

npm install && npm test (offline tests), apify push to deploy.