Sitemap URL Extractor — All Page URLs from a Website

Turn any website into a clean list of its URLs. Finds the sitemap from robots.txt, follows nested sitemap indexes, unpacks .xml.gz, reads RSS/Atom feeds, and can return only pages changed since a date — the cheap way to re-crawl just what is new.

Extract every URL from a website's sitemaps: indexes, .gz, plain-text and RSS/Atom, with lastmod filtering.

Extract every URL a website publishes. Reads robots.txt, discovers sitemaps, walks sitemap indexes recursively and returns URL, path, last modified date, change frequency, priority and hreflang. Optional robots.txt rule parsing. For SEO audits, content inventory and migration planning.

Turn any site's sitemap.xml, sitemap index, or robots.txt Sitemap directive into a clean URL dataset with loc, lastmod, changefreq and priority per row. Recursively expands sitemap indexes (bounded depth), follows redirects, and decompresses .xml.gz automatically.

Extract every URL from any website's XML sitemaps, including sitemap indexes, gzip sitemaps, and robots.txt discovery. Returns lastmod, changefreq, and priority.

Sitemap Extractor: All URLs from Any Website, $0.50/1K

conserving_celerytop/sitemap-url-extractor

Get every page URL of a website from its XML sitemaps: sitemaps are found through robots.txt, sitemap indexes are followed, and each URL comes with last modified date, change frequency and priority. Filter by text. $0.50 per 1,000 URLs.

Sitemap URL Extractor

lost.fany/sitemap-url-extractor

Extract every URL from a website's sitemap.xml, sitemap index and robots.txt in seconds — with lastmod, changefreq, priority and hreflang. No crawling, no browser: fast, cheap, reliable.

Sitemap URL Exporter — Nested Sitemaps & Robots Discovery

gertner-data/sitemap-url-exporter

Export up to 3,000 deduplicated URLs per website from robots.txt and nested XML sitemaps, with lastmod and source sitemap. Feed crawlers, migrations and ETL from one JSON report. Launch price: $1/1,000 website reports; all exported URLs included.

Get every URL of any website from its sitemap.xml: nested sitemap indexes, .xml.gz, text sitemaps, robots.txt discovery. Export to CSV, JSON or Excel. Track new and removed pages between runs. Optional 404 status check. Streams millions of URLs. Pay per URL, no proxy needed.

Sitemap XML URL Extractor

automation-lab/sitemap-xml-url-extractor

Extract deduplicated URLs and metadata from public XML sitemaps and nested sitemap indexes for crawl planning, migrations, and content audits.