Sitemap Extractor & Broken Link Checker: All URLs of a Site

Get every URL a website lists in its sitemaps, then optionally check each one for broken pages, redirects and slow responses.

• Finds sitemaps for you: reads robots.txt, then tries the usual addresses (/sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml…)
• Follows sitemap indexes, .gz files and plain-text sitemaps
• For each URL: last modified date, change frequency, priority, number of images and hreflang alternates
• Include / exclude filters, e.g. only /blog/
• Status check (optional): HTTP status, redirect target and response time for each URL. Turn on "Only show problems" to get just the broken and redirected ones.

Who it's for

• SEO: audit what a site submits to search engines, find 404s and redirect chains in the sitemap, spot stale pages by last-modified date.
• Site migrations: list all old URLs before a redesign and check them afterwards.
• Scraping and AI pipelines: a clean list of a site's pages to feed into the next tool.
• Competitor research: see how many product, blog or landing pages a competitor has, and when they last changed.

Input

Option	Default	What it does
Websites or sitemap URLs	–	apify.com or https://example.com/sitemap.xml
Max URLs per site	1,000	Stop after this many
Only URLs containing	–	Text or regular expressions to keep
Skip URLs containing	–	Text or regular expressions to drop
Check each URL's status	off	HTTP status, redirects, response time
Only show problems	off	With status checks, output only non-200 URLs

Output

Listing only:

{
  "input": "https://github.blog/sitemap.xml",
  "url": "https://github.blog/news-insights/the-library/benchmarking-github-enterprise/",
  "sitemap": "https://github.blog/post-sitemap.xml",
  "lastmod": "2015-07-22T07:00:00+00:00",
  "changefreq": null,
  "priority": null,
  "images": 10
}

With status checks, each row also has httpStatus, ok, redirectTo and responseMs.

Sources without a sitemap get one free row with status: "no_sitemap_found".

Pricing

• Listing: per URL returned.
• Status check: per URL checked (a higher price, since each URL is requested). With "Only show problems", you pay for every URL checked, even the ones that are fine and not shown.

See the Pricing tab.

Limits, honestly

• It only knows the URLs the site puts in its sitemaps. Pages left out of the sitemap won't appear. For a full crawl you need a crawler.
• Status checks use a HEAD request (GET when a site refuses HEAD) and don't follow redirects, so you see the first hop. Some sites answer bots differently than browsers.
• Checks run a few at a time per site, to stay polite.

More tools from SwiftKit

• Lighthouse Audit: bulk page speed, SEO and Core Web Vitals scores
• Website Screenshot Tool: bulk full-page and mobile screenshots, PNG/JPEG/PDF
• Tech Stack Detector: what a website is built with: CMS, analytics, ecommerce, hosting
• Website to Markdown for AI: clean page content as Markdown, with token counts and RAG chunks
• SEO Audit Crawler: score every page for SEO basics and find broken links

Questions?

Open an issue on the Issues tab.