Sitemap URL Extractor & SEO Freshness Audit (XML, .gz, lastmod)
Pricing
$0.40 / 1,000 results
Sitemap URL Extractor & SEO Freshness Audit (XML, .gz, lastmod)
Extract every URL from any website's XML sitemaps (auto-discovered via robots.txt, sitemap indexes, .gz) with lastmod freshness stats.
Pricing
$0.40 / 1,000 results
Rating
0.0
(0)
Developer
Zachary Vorsteg
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
12 days ago
Last modified
Categories
Share
Sitemap URL Extractor & Freshness Audit
Extract every URL from a website's XML sitemaps and see how fresh the content is. Auto-discovers sitemaps from robots.txt (falls back to /sitemap.xml and /sitemap_index.xml), follows sitemap indexes, and reads .xml.gz files.
Output fields
url, sitemap, lastmod, lastmodAgeDays, changefreq, priority. A SUMMARY record in the key-value store gives per-site counts and lastmod age buckets (<30d, 30-180d, 180d-1y, >1y).
Data source & compliance
Only fetches public sitemap and robots.txt files, which sites publish so crawlers can read them. Waits 300 ms between files.
Pricing (proposal)
Pay per result: $0.0004 per result ($0.40 per 1,000), plus Apify's default start event. See .actor/pricing.proposal.json. Competitor prices are in ../../evidence/apify_competitor_pricing.json (fetched 2026-10-09).
Example
See samples/sample-output-first5.json (the full test run is in samples/sample-output.json).
Local test
Tested 2026-10-09: docs.apify.com gave 300 URLs (capped at 300). python.org gave 0 URLs because it publishes no sitemap; this is recorded in SUMMARY.sitemapErrors.
Run again with: ../_test.sh sitemap-url-extractor-audit '<input json>'
