Sitemap URL Extractor: All Pages, lastmod & New-URL Monitor avatar

Sitemap URL Extractor: All Pages, lastmod & New-URL Monitor

Pricing

from $0.25 / 1,000 url extracteds

Go to Apify Store
Sitemap URL Extractor: All Pages, lastmod & New-URL Monitor

Sitemap URL Extractor: All Pages, lastmod & New-URL Monitor

Every URL from a site's XML sitemaps with lastmod, priority and image count. Auto-discovers via robots.txt, follows nested indexes and .gz, filters by regex or date, and can return only URLs new since the last run. For RAG, SEO and monitoring. By Apizap.

Pricing

from $0.25 / 1,000 url extracteds

Rating

0.0

(0)

Developer

ApiZap

ApiZap

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

13 minutes ago

Last modified

Features

Limited permissions

Share

Get every page URL of a website in seconds, straight from its XML sitemaps. Enter a domain or a sitemap URL; the Actor discovers sitemaps via robots.txt and common paths, follows nested sitemap indexes and .xml.gz files, and returns each URL with lastmod, changefreq, priority and image count. Filter by regex or date, or switch on monitor mode to output only URLs that are new since your last run.

Use cases

  • RAG / AI ingestion: get the exact list of docs pages to feed into a crawler or vector DB.
  • Content & competitor monitoring: schedule daily and get only newly published pages (blogs, products, docs, changelogs).
  • SEO: audit sitemap coverage, find stale pages by lastmod, count URLs per section.
  • Agents via MCP: "list all pages under /docs on example.com updated this week".

Input

{
"startUrls": ["https://developer.mozilla.org", "https://blog.cloudflare.com/sitemap.xml"],
"includePatterns": ["/docs/"], "excludePatterns": ["/tag/"],
"lastmodAfter": "7 days", "onlyNewSinceLastRun": false,
"maxUrlsPerSite": 0, "maxItems": 10000
}

Output (one item per URL)

{ "url": "https://blog.cloudflare.com/…", "lastmod": "2026-11-12T14:00:00.000Z", "changefreq": null, "priority": null,
"imageCount": 1, "site": "blog.cloudflare.com", "sitemap": "https://blog.cloudflare.com/sitemap-posts.xml",
"isNew": null, "extractedAt": "2026-11-14T07:21:55.404Z" }

A run summary (sitemap files read, URLs read/output per site) is saved as SUMMARY.

Pricing (pay per result)

Suggested: $0.25 per 1,000 URLs (event url, $0.00025) + $0.005 per run start. Monitor runs that find nothing new cost almost nothing.

FAQ

No sitemap found? Some sites don't publish one; try their sitemap URL directly if you know it. Does it crawl pages? No – it only reads sitemap files, so it's fast, cheap and light on the target site.


Made by Apizap – small, reliable, pay-per-result data tools for developers and AI agents. See all our tools at tools.apizap.com or email support@apizap.com for custom data feeds.