Sitemap URL Extractor (all pages of a website, with lastmod)

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Website URL Crawler & Link Extractor

maged120/get-urls-pro

Crawl any website and extract every URL with its depth, parent page and anchor text. Build a sitemap or audit internal links. Works on static and JavaScript sites.

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Sitemap URL Extractor

sootesting/sitemap-url-extractor

Extract URLs from XML sitemaps in bulk. Supports sitemap indexes, auto-discovers nested sitemaps, and outputs structured JSON. Pay-per-event: per 1,000 URLs extracted.

Sitemap URL Extractor: All Pages of Any Website

jtpalms/sitemap-url-extractor

Get every URL of a website from its XML sitemaps. Auto-discovers sitemaps from robots.txt, follows sitemap indexes and .gz files, and returns lastmod, changefreq, priority and image counts. Filter by URL pattern or last-modified date. USD 0.50 per 1,000 URLs.

Sitemap URL Extractor

tidyrow/sitemap-url-extractor

Extract every URL from any website's sitemaps. Finds sitemaps via robots.txt or common paths, follows sitemap indexes, reads gzip, RSS/Atom and text sitemaps, and returns lastmod, priority, hreflang, images and news. Optional HTTP status checks.

Find a website's sitemaps (from robots.txt or common paths), extract every URL with its lastmod, changefreq and priority, follow nested sitemap indexes, and optionally check each URL's live status and redirects. Falls back to the homepage's internal links when there's no sitemap.