Sitemap URL Intelligence

Expired Domains Scraper - SEO Domain Data

benthepythondev/expired-domains-scraper

Scrape ExpiredDomains.net listing pages for domains, backlinks, archive age, related domains, drops and TLD status.

Scan robots.txt files in bulk to extract sitemap URLs and verify crawler directives for technical SEO compliance.

Sitemap to URL Crawler — Extract Sitemap.xml URLs

logiover/sitemap-to-url-crawler

Extract all URLs from any sitemap.xml recursively. Export sitemap URLs to CSV/JSON for RAG pipelines, SEO audits, and LLM training datasets.

SEO Intelligence Suite - Complete Analysis with AI

viralanalyzer/seo-intelligence-suite

Complete SEO audit: meta tags, headings, links, structured data, AI recommendations.

Sitemap Url Extractor

scrapers-hub/sitemap-url-extractor

Sitemap URL extractor to extract all URLs from XML sitemaps quickly and efficiently 🌐📄 Ideal for SEO audits, site analysis, and indexing workflows. Fast, accurate, and easy to use.

Extract, filter, and export URLs from sitemap.xml files for SEO audits, crawler seeding, RAG pipelines, and site intelligence.

Discover every URL a site exposes via its public sitemap chain. Reads robots.txt, follows Sitemap declarations, recursively descends sitemap-index files, extracts URLs with lastmod, changefreq, priority.

Sitemap Intelligence API

s3nafps/sitemap-intelligence-api

Classify public sitemap URLs into pricing, docs, blog, changelog, product, legal, support, and other page types.

Find Sitemap From Url

scrapers-hub/find-sitemap-from-url

🔎 Find Sitemap From Url tool instantly locates a website’s sitemap from its URL, helping you discover indexable pages faster. ⚡ Perfect for SEO audits, crawling, indexing analysis & link research. 🚀 Boost efficiency with accurate sitemap detection.

Extract every URL from any website's sitemap.xml with lastmod, changefreq, priority. Recursively expands sitemap index files, reads robots.txt, handles gzipped sitemaps. SEO audits, content migration, site inventory, competitor research.

Turn company domains into structured website, tech stack, DNS, SPF, DMARC, RDAP, TLS certificate, robots.txt, and sitemap audit records. Public, keyless sources only: the company's own website plus public registries. Pay per audited domain.