Sitemap URL Diff API
Pricing
from $0.30 / 1,000 sitemap url results
Sitemap URL Diff API
Expand public XML sitemaps and compare URLs with a previous snapshot. Return added and removed URLs with source sitemap and lastmod evidence; fail on incomplete crawls.
Pricing
from $0.30 / 1,000 sitemap url results
Rating
0.0
(0)
Developer
Salih Can Kurnaz
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Share
Fetch a public XML sitemap or sitemap index, normalize its URLs, and compare them with a previous URL list. The dataset marks URLs as ADDED, REMOVED, or optionally UNCHANGED. Without a previous list, rows are marked CURRENT so you can save a baseline. Each row carries the source sitemap and any supplied lastmod value; lastmod is not treated as proof that a page changed.
Input
| Field | Purpose |
|---|---|
sitemapUrl | Public sitemap URL or site root. Root URLs use robots.txt declarations when available, otherwise /sitemap.xml. |
previousUrls | Exact URL list from an earlier snapshot; omit it for a baseline. |
includeUnchanged | Include unchanged URLs during comparison. |
maxUrls, maxSitemaps | Safety caps. Exceeding either fails the run rather than producing false removal alerts. |
Example comparison input:
For repeat monitoring, export the current URLs from one run and pass them as previousUrls on the next scheduled/API run. A baseline run does not silently claim changes. Results are available through Apify's dataset API in JSON, CSV, and Excel; counts and completeness are saved in the OUTPUT record.
Limits and billing
Only public HTTP(S) hosts are fetched. XML, gzip, redirects, file size, URL count, and sitemap count are bounded. The Actor is billed per emitted result row; a run that exceeds a completeness limit fails before emitting or charging rows. The Actor does not crawl the pages listed in a sitemap. A missing URL can indicate a sitemap editorial change rather than a removed web page.
