Sitemap Content Radar

XML Sitemap URL Extractor & Checker

scrapesignal_labs/sitemap-url-extractor

Extract URLs from XML sitemaps, sitemap indexes, robots.txt, and gzip files. Filter pages and optionally check HTTP status codes for SEO audits.

Sitemap URLs: every URL of a website from its XML sitemaps

steadydata/sitemap-urls

Sitemap URL extractor: every URL a website lists in its XML sitemaps, up to 100 sites per run: sitemaps are found through robots.txt and the usual paths, sitemap indexes and gzip are followed, and each URL comes with its sitemap, last modification date, change frequency and priority. Pay per URL.

Sitemap URL Extractor: robots.txt, gzip, Changes

succinct_glider/sitemap-urls

Extract every URL from a website's XML sitemaps: found through robots.txt, sitemap indexes and .gz files followed, lastmod and date filters, URL patterns, and new, changed or removed URLs since your last run. Reads sitemap files only, never the pages.

Sitemap URL Extractor

sootesting/sitemap-url-extractor

Extract URLs from XML sitemaps in bulk. Supports sitemap indexes, auto-discovers nested sitemaps, and outputs structured JSON. Pay-per-event: per 1,000 URLs extracted.

Extract and parse XML sitemaps from any website. Discovers sitemaps via robots.txt and common paths. Outputs structured URL data with metadata.

Sitemap URL Extractor & Monitor — Recursive

hipersoft/sitemap-extractor

Extract every URL from any website's sitemaps: loc, lastmod, changefreq and priority. Follows sitemap indexes recursively, discovers sitemaps from robots.txt, handles gzipped sitemaps, and can return only URLs changed since a date. No setup.

Robots.txt & Sitemap Analyzer 🕷️

perryay/robots-txt-sitemap-analyzer

Fetch, parse, and analyze robots.txt and sitemap.xml for any domain. Extract crawl directives, test URL compliance against robots.txt rules, and discover all URLs from sitemaps including nested sitemap indexes. Supports batch analysis with structured JSON output.

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Watch up to 10 sitemaps on a schedule and get only what moved since the last run: brand-new URLs, and pages whose lastmod changed. Sitemaps are found from robots.txt or given directly, index files and gzip included, and removed pages are counted in the run summary.

Sitemap XML URL Extractor

automation-lab/sitemap-xml-url-extractor

Extract deduplicated URLs and metadata from public XML sitemaps and nested sitemap indexes for crawl planning, migrations, and content audits.