Sitemap & RSS to JSON — URL inventory and feed items
Pricing
$1.00 / 1,000 urls
Sitemap & RSS to JSON — URL inventory and feed items
Turn sitemap.xml or any RSS/Atom feed into clean JSON. Point it at a site: it finds the sitemap via robots.txt, follows sitemap indexes, and returns one item per URL with lastmod and priority. Point it at a feed: normalised entries with titles, links, dates and authors.
Pricing
$1.00 / 1,000 urls
Rating
0.0
(0)
Developer
Andy Wang
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
9 hours ago
Last modified
Categories
Share
Point it at a website and get its whole URL inventory as JSON. Point it at a feed and get normalised RSS/Atom items. No proxies, no browser, pay per URL.
This is the unglamorous part of SEO, RAG ingestion and content monitoring: finding out what a site publishes, when each page changed, and what its feed says. Most scrapers skip sitemaps entirely and miss pages that are never linked.
What you get
For a site:
For a feed:
How it finds the sitemap
- Reads
/robots.txtand uses everySitemap:directive — the polite way, and the only way to find sitemaps that are not at the default path. - Falls back to
/sitemap.xmlif robots.txt lists none. - Follows a
<sitemapindex>one level deep (configurable) and merges children.
Input
| Field | Default | What it does |
|---|---|---|
startUrls | — | A site URL, a sitemap URL, or an RSS/Atom URL. Mixed lists are fine |
maxUrls | 1000 | Hard cap on emitted items (max 20,000) |
followSitemapIndex | true | Fetch child sitemaps of an index |
tryDefaultSitemap | true | Fall back to /sitemap.xml |
Notes and limits
- Sitemaps only list what the site declares. Pages behind a sitemap you cannot reach (404, auth, robots-blocked) come back as an error item with the status code.
- One level of sitemap index nesting; deeper trees need a second run.
- No JavaScript execution — feeds and sitemaps are XML, so this is not a problem in practice.
- Respects
robots.txtfor discovery, sends a descriptive user-agent, and never hammers a host: requests are sequential per source.
Pricing
One charge per emitted URL or feed item. A 5,000-page site costs a few dollars; a single feed costs a fraction of a cent.
