Sitemap URL Extractor: All Page URLs, lastmod & Priority
Pricing
$0.30 / 1,000 url results
Sitemap URL Extractor: All Page URLs, lastmod & Priority
Extract every URL from any website's XML sitemaps. Auto-discovers sitemaps via robots.txt and common paths, follows nested sitemap indexes, supports .gz and text sitemaps, regex filters. Returns lastmod, changefreq, priority, hreflang alternates and image counts.
Pricing
$0.30 / 1,000 url results
Rating
0.0
(0)
Developer
Hansol Jung
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
8 days ago
Last modified
Categories
Share
Get a complete list of a website's page URLs from its XML sitemaps in seconds. Give it a homepage and it finds the sitemaps for you (robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml…), follows nested sitemap indexes, unpacks .xml.gz, reads plain-text sitemaps, and returns one clean row per URL.
Use cases
- SEO audits & migrations: export every indexable URL with
lastmodto compare before/after a redesign. - Crawler seeding: feed URLs to Website Content Crawler, screenshot or price-monitoring actors instead of blind crawling.
- Content monitoring: schedule it and diff
lastmodto detect new or updated pages (blog posts, products, docs). - Competitor research: count products, categories or articles a competitor publishes.
Output fields
url, lastmod, changefreq, priority, imageCount, alternates (hreflang), sitemapUrl, domain, startUrl, scrapedAt
{"url": "https://example.com/blog/post-1","lastmod": "2026-09-30","changefreq": "weekly","priority": 0.8,"imageCount": 2,"alternates": [{"hreflang": "de", "href": "https://example.com/de/blog/post-1"}],"sitemapUrl": "https://example.com/post-sitemap.xml","domain": "example.com"}
Input
| Field | Description |
|---|---|
| startUrls | Homepages (auto-discovery) or direct sitemap URLs |
| maxUrls | Hard cap on total URLs (and cost) |
| maxSitemaps | Max sitemap files downloaded per site |
| includePatterns / excludePatterns | Regex filters, e.g. /blog/ |
Pricing
Pay-per-event: $0.0003 per URL (10,000 URLs = $3). No start fee. Duplicates are removed before charging.
Notes
- Fast HTTP-only (no browser), so runs are cheap and quick.
- Reads only public sitemap files that site owners publish for crawlers. No login, no personal data.
- If a site has no sitemap, the run logs a warning and returns no rows for that site (you are not charged).