Sitemap URL Extractor: All Pages, lastmod & New-URL Monitor
Pricing
from $0.25 / 1,000 url extracteds
Sitemap URL Extractor: All Pages, lastmod & New-URL Monitor
Every URL from a site's XML sitemaps with lastmod, priority and image count. Auto-discovers via robots.txt, follows nested indexes and .gz, filters by regex or date, and can return only URLs new since the last run. For RAG, SEO and monitoring. By Apizap.
Pricing
from $0.25 / 1,000 url extracteds
Rating
0.0
(0)
Developer
ApiZap
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
13 minutes ago
Last modified
Categories
Features
Share
Get every page URL of a website in seconds, straight from its XML sitemaps. Enter a domain or a sitemap URL; the Actor discovers sitemaps via robots.txt and common paths, follows nested sitemap indexes and .xml.gz files, and returns each URL with lastmod, changefreq, priority and image count. Filter by regex or date, or switch on monitor mode to output only URLs that are new since your last run.
Use cases
- RAG / AI ingestion: get the exact list of docs pages to feed into a crawler or vector DB.
- Content & competitor monitoring: schedule daily and get only newly published pages (blogs, products, docs, changelogs).
- SEO: audit sitemap coverage, find stale pages by
lastmod, count URLs per section. - Agents via MCP: "list all pages under /docs on example.com updated this week".
Input
{"startUrls": ["https://developer.mozilla.org", "https://blog.cloudflare.com/sitemap.xml"],"includePatterns": ["/docs/"], "excludePatterns": ["/tag/"],"lastmodAfter": "7 days", "onlyNewSinceLastRun": false,"maxUrlsPerSite": 0, "maxItems": 10000}
Output (one item per URL)
{ "url": "https://blog.cloudflare.com/…", "lastmod": "2026-11-12T14:00:00.000Z", "changefreq": null, "priority": null,"imageCount": 1, "site": "blog.cloudflare.com", "sitemap": "https://blog.cloudflare.com/sitemap-posts.xml","isNew": null, "extractedAt": "2026-11-14T07:21:55.404Z" }
A run summary (sitemap files read, URLs read/output per site) is saved as SUMMARY.
Pricing (pay per result)
Suggested: $0.25 per 1,000 URLs (event url, $0.00025) + $0.005 per run start. Monitor runs that find nothing new cost almost nothing.
FAQ
No sitemap found? Some sites don't publish one; try their sitemap URL directly if you know it. Does it crawl pages? No – it only reads sitemap files, so it's fast, cheap and light on the target site.
Made by Apizap – small, reliable, pay-per-result data tools for developers and AI agents. See all our tools at tools.apizap.com or email support@apizap.com for custom data feeds.