Sitemap URL Extractor (index, gzip, robots.txt discovery)
Pricing
from $0.20 / 1,000 url extracteds
Go to Apify Store
Sitemap URL Extractor (index, gzip, robots.txt discovery)
Give it domains or sitemap URLs. It finds sitemaps through robots.txt and common paths, follows sitemap indexes (including .xml.gz), and returns every page URL with lastmod, changefreq and priority. Optional filters by path pattern and lastmod date.