XML Sitemap Checker, Validator & URL Extractor

Turn any website into a clean list of its URLs. Finds the sitemap from robots.txt, follows nested sitemap indexes, unpacks .xml.gz, reads RSS/Atom feeds, and can return only pages changed since a date — the cheap way to re-crawl just what is new.

XML Sitemap URL Extractor

andok/sitemap-extractor

Recursively crawl and extract every single URL from a website’s sitemap.xml. Automate your SEO audits and scraping queues.

Sitemap Extractor - Hardened URL Inventory

8tp/sitemap-url-extractor-coverage-api

Extract URL inventories from public HTTPS sitemap XML and gzip files with robots.txt discovery, bounded index traversal, and machine-readable coverage receipts. No page crawling, login, browser, proxy, or private-network access.

Audit sitemap URLs, lastmod dates, stale content signals, index coverage, and sitemap health.

Extract every URL from any website's XML sitemaps, including sitemap indexes, gzip sitemaps, and robots.txt discovery. Returns lastmod, changefreq, and priority.

Extract every URL a website publishes. Reads robots.txt, discovers sitemaps, walks sitemap indexes recursively and returns URL, path, last modified date, change frequency, priority and hreflang. Optional robots.txt rule parsing. For SEO audits, content inventory and migration planning.

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.

High-speed sitemap and link crawler. Recursively parses XML/GZ sitemaps, verifies HTTP status codes (200, 301, 404, 500), maps redirect chains, and exports clean sitemaps.

XML Sitemap Validator

automation-lab/xml-sitemap-validator

Validate public XML sitemaps and sitemap indexes. Export syntax, nesting, duplicate and malformed locations, page HTTP status, redirects, response times, and aggregate health records.