Pricing

from $0.30 / 1,000 urls

Try for free

Go to Apify Store

Sitemap URL Extractor: robots.txt, gzip, Changes

Try for free

Extract every URL from a website's XML sitemaps: found through robots.txt, sitemap indexes and .gz files followed, lastmod and date filters, URL patterns, and new, changed or removed URLs since your last run. Reads sitemap files only, never the pages.

Pricing

from $0.30 / 1,000 urls

Rating

0.0

(0)

Developer

Alexandre Bobichon

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Sitemap URL Extractor & Change Monitor

webdatatools/sitemap-extractor

Sitemap URL extractor that reads robots.txt, sitemap indexes, .xml.gz and plain-text sitemaps and returns one row per URL with lastmod, changefreq, priority — plus a new/removed diff between runs.

Murat Uzun

Sitemap Scraper

clintsa/sitemap-scraper

Extract all URLs from any website's sitemap.xml with robots.txt discovery, gzip support, full metadata, and automatic retries

Andy Besos

Sitemap URL Extractor: All Website URLs from Sitemaps

pavel.tashev/sitemap-url-extractor

Extract every URL from a website's sitemaps with lastmod, changefreq, priority, images and hreflang. Finds sitemaps automatically (robots.txt, WordPress, Yoast, gzip), handles broken XML, optional HTTP status checks.

Pavel Tashev

Sitemap Extractor & URL Change Monitor

automa-flow/sitemap-extractor-monitor

Extract every URL from XML, gzip, text and nested sitemaps, with robots.txt discovery. Compare repeat checks for added URLs, publisher lastmod updates and confirmed removals. An incomplete sitemap tree never produces false removals. Export for SEO audits and incremental crawlers.

Vadim Bezrukov

Sitemap URL Extractor & Monitor — Recursive

hipersoft/sitemap-extractor

Extract every URL from any website's sitemaps: loc, lastmod, changefreq and priority. Follows sitemap indexes recursively, discovers sitemaps from robots.txt, handles gzipped sitemaps, and can return only URLs changed since a date. No setup.

hiper soft

Sitemap URL Extractor

seemuapps/sitemap-extractor

Extract every URL from a website's sitemap.xml. Recursively walks nested sitemap indexes and returns loc, lastmod, changefreq, and priority for each page.

Andrew

Sitemap URL Finder

thescrapelab/sitemap-target-url-extractor

Find and export URLs from any website’s robots.txt and sitemaps. Enter a domain or website URL, optionally filter matching URLs by text, and get clean dataset rows with the URL, domain, path, source sitemap, and match details.

Inus Grobler

Sitemap URL Auditor - Free Beta

rex-law/sitemap-url-auditor-free-beta

Discover and audit public XML and GZIP sitemaps with robots.txt, recursion, data-quality, and SSRF safeguards.

Rex Law

XML Sitemap Health Validator

maximedupre/sitemap-validator

Validate XML sitemaps and sitemap indexes. Check listed URLs for HTTP status, redirects, response time, errors, and sitemap metadata.

Maxime Dupré

Website Sitemap Extractor - Find Sitemaps & Extract URLs

clearfetch/website-sitemap-extractor

Give it a domain and it finds the sitemaps itself, from robots.txt, the homepage or the usual paths, follows sitemap index files, unpacks gzipped ones, and returns every URL with lastmod, priority, hreflang alternates and images. No proxy, no login.