Sitemap to URL List Extractor 🗺️

Extract every URL from any website's sitemap as clean structured JSON, with last-modified dates, priority, and change frequency. Handles sitemap indexes (recursing into nested sitemaps) and gzipped sitemaps (.xml.gz) automatically — the parts most lazy sitemap scrapers get wrong.

Perfect for SEO audits, content inventories, building crawl lists, monitoring site changes, and feeding URL lists into other tools.

Why use it

• 🔁 Recursive sitemap indexes — point it at sitemap_index.xml and it'll follow every nested sitemap automatically
• 📦 Gzipped sitemaps handled — many large sites ship .xml.gz, decompressed transparently
• 🗓️ Full metadata — lastmod, priority, changefreq, plus image URLs from the Google image sitemap extension
• 🛡️ Guardrails — configurable caps on total URLs and nested sitemaps so a giant site can't run away
• 🌐 Works on any website — news sites, e-commerce stores, blogs, documentation, public web apps

Use cases

• SEO audits — list every indexed URL on a site, sort by lastmod, find stale content
• Crawl seed lists — generate URL lists for downstream scrapers or archival tools
• Content inventories — see what a competitor or partner site is actually publishing
• Change monitoring — schedule it and detect newly added pages
• Site migrations — get the full URL set before redirect mapping

Input

Field	Description
Sitemap URLs	One or more sitemap URLs (sitemap.xml, sitemap_index.xml, or .xml.gz).
Follow indexes	If a URL points to an index, recurse and process each nested sitemap.
Maximum URLs	Total URL cap across all sitemaps.
Maximum nested sitemaps	Cap on number of sitemap files fetched when following indexes.

Output

{
  "url": "https://example.com/page1",
  "lastModified": "2025-05-10",
  "changeFrequency": "weekly",
  "priority": "0.8",
  "images": ["https://example.com/img1.jpg"],
  "sourceSitemap": "https://example.com/sitemap-products.xml",
  "sourceRoot": "https://example.com/sitemap_index.xml"
}

Export to JSON, CSV, or Excel, or pull via the Apify API.

Notes

• Supports the standard sitemaps.org protocol, sitemap index files, and the Google image-sitemap extension.
• Always respects each site's robots.txt policy on access — please use responsibly.
• Independent tool; sitemaps remain the property of their publishers.