Sitemap URL Extractor & Broken Link Checker

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Get every URL a website publishes in its XML sitemaps, with lastmod, changefreq and priority. Finds sitemaps via robots.txt, follows sitemap indexes and gzipped sitemaps. Pay only per URL returned.

Check the website traffic of a list of domains: estimated monthly Google search traffic (organic and paid) and ranking keywords, plus optional traffic value and top 10 rankings. 1,000 domains per request, 94 countries. Not total visits. $4 per 1,000 domains + $0.025 per run; no data is free.

Lists every URL from a site's robots.txt and nested or gzipped sitemaps with lastmod, a changed-since filter, per-section counts and optional HTTP status checks.

Sitemap extractor that lists every URL a website publishes, with lastmod, images and hreflang. Finds sitemaps via robots.txt; handles nested indexes, gzip and text sitemaps. Compare runs to see new, updated and removed pages, and optionally check HTTP status.

SEO Duplicate Content Detector

gr_59017/seo-duplicate-content-detector

Detects duplicate or identical content across multiple webpages by analyzing visible page text. Helps identify SEO duplicate content issues, content reuse, and potential ranking risks using simple content comparison and scoring.

Answer Engine Optimization & GEO Audit - ChatGPT Fix Plan

tidytools/geo-readiness-audit

AEO with a fix plan, not just a score: for each buyer question, see which page ChatGPT, Perplexity or Google AI Overviews would quote, why competitors win, and what to add. Plus a GEO audit of AI crawler access and firewalls. $0.01/question, $0.03/site.