Sitemap URL Extractor
Under maintenancePricing
Pay per usage
Sitemap URL Extractor
Under maintenanceExtract every URL from any website's sitemap, including nested sitemap indexes (recursive). Auto-discovers sitemaps from robots.txt. Returns URLs with lastmod, changefreq, priority.
Pricing
Pay per usage
Rating
0.0
(0)
Developer
Mehmet Kut
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 hours ago
Last modified
Categories
Share
Extract every URL from any website's sitemap — including nested sitemap indexes, expanded recursively. Just give it a domain and it auto-discovers sitemaps from robots.txt.
Perfect as the first step in any large-scale scraping or SEO project: get the complete URL inventory of a site, then feed those URLs into your scraper of choice.
🎯 What it does
- Auto-discovers sitemaps from
robots.txt(or falls back to/sitemap.xml) - Recursively expands sitemap index files into their child sitemaps
- Extracts every URL with
lastmod,changefreq, andpriority - Handles huge sitemaps (100,000+ URLs) with configurable limits
💡 Use cases
- Seed URL lists for large scraping jobs
- Site inventory / content audits — see every published page
- Change monitoring — track
lastmodto find recently updated pages - SEO analysis — audit priority & changefreq configuration
📥 Input
| Field | Type | Description |
|---|---|---|
startUrls | array | Website domains or direct sitemap URLs |
maxSitemaps | integer | Max sitemap files to fetch (default 200) |
maxUrls | integer | Stop after this many URLs (default 100,000) |
useProxy | boolean | Route via Apify Proxy (default true) |
Example input
{"startUrls": ["https://example.com"],"maxUrls": 50000}
You can pass either a domain (https://example.com → auto-discovers sitemaps) or a direct sitemap URL (https://example.com/sitemap.xml).
📤 Output
{"url": "https://example.com/some-page","lastmod": "2026-06-01","changefreq": "weekly","priority": "0.8","sourceSitemap": "https://example.com/sitemap/pages.xml"}
🔗 Tip
Chain this with the SEO Meta & Schema Extractor to run a full-site SEO audit: extract all URLs here, then extract metadata from each.