Sitemap Scraper - Find the Sitemap and Watch for New URLs

YouTube Most Replayed Scraper - Heatmap Peaks & Timestamps

neverempty/youtube-most-replayed-scraper

Find the most replayed moments of any YouTube video: the top peaks of YouTube's own Most replayed heatmap as timestamped links, the chapter each peak falls in and the caption line spoken there, plus the raw heatmap segments. Videos without a heatmap are listed free.

Extract every URL from any website's XML sitemaps, including sitemap indexes, gzip sitemaps, and robots.txt discovery. Returns lastmod, changefreq, and priority.

Sitemap URL Extractor

lost.fany/sitemap-url-extractor

Extract every URL from a website's sitemap.xml, sitemap index and robots.txt in seconds — with lastmod, changefreq, priority and hreflang. No crawling, no browser: fast, cheap, reliable.

Extract every URL from a website's sitemaps: indexes, .gz, plain-text and RSS/Atom, with lastmod filtering.

Turn any website into a clean list of its URLs. Finds the sitemap from robots.txt, follows nested sitemap indexes, unpacks .xml.gz, reads RSS/Atom feeds, and can return only pages changed since a date — the cheap way to re-crawl just what is new.

Sitemap URL Extractor — robots.txt, Sitemap Index, gzip

chorelet/sitemap-url-extractor

Every URL of a website from its sitemaps: robots.txt discovery, sitemap indexes, gzip, lastmod, changefreq, priority, hreflang alternates, image/video/news extensions. Include/exclude patterns and date filter, CSV/JSON export and API.

Sitemap Indexability & Change Monitor

produkdigitalali/sitemap-indexability-change-monitor

Audit XML sitemap URLs for HTTP status, robots directives, canonical targets, indexability, and added, removed, or changed pages across repeat runs.

Compare XML sitemap snapshots for new URLs, metadata edits and entries absent from the latest document. Keep persistent history, return the current inventory and deduplicatable change IDs, and distinguish URL sets from sitemap indexes.

Extract the exact sitemap file you name, or discover a domain's sitemaps. Deduplicated URL, lastmod and source rows with explicit partial/error reports. No page crawl or proxy; empty runs are free.

Sitemap URL Exporter — Nested Sitemaps & Robots Discovery

gertner-data/sitemap-url-exporter

Export up to 3,000 deduplicated URLs per website from robots.txt and nested XML sitemaps, with lastmod and source sitemap. Feed crawlers, migrations and ETL from one JSON report. Launch price: $1/1,000 website reports; all exported URLs included.