Sitemap Extractor & Broken Link Checker avatar

Sitemap Extractor & Broken Link Checker

Pricing

from $0.70 / 1,000 urls

Go to Apify Store
Sitemap Extractor & Broken Link Checker

Sitemap Extractor & Broken Link Checker

Get every URL from a website's XML sitemaps (auto-discovered via robots.txt, sitemap indexes and .gz files) with lastmod, priority and hreflang, and optionally check each page for 404s, redirects and response time.

Pricing

from $0.70 / 1,000 urls

Rating

0.0

(0)

Developer

Ivan Popov

Ivan Popov

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Security

Limited permissions

Share

Enter a website and get every URL listed in its XML sitemaps: lastmod, change frequency, priority, image count and hreflang languages. Turn on status checking to find broken pages (404/5xx), redirects and slow URLs in the same run.

  • 🔎 Automatic sitemap discovery: reads Sitemap: lines from robots.txt, then tries /sitemap.xml, /sitemap_index.xml and /wp-sitemap.xml
  • 🗂️ Follows sitemap indexes (any depth) and reads gzip (.xml.gz) and plain-text sitemaps
  • 🌍 hreflang and image data: language alternates and image counts per URL
  • 🚦 Broken link check: HTTP status, redirect count, final URL, response time. HEAD first, GET fallback
  • 🧹 "Only problems" mode: save just the broken and redirected URLs as a ready-made fix list
  • ⚡ No browser, no proxy, so it's fast and cheap

Use cases

  • SEO audits: find sitemap URLs that 404, redirect or are slow. Google flags these in Search Console.
  • Site migrations: export the full URL list before and after, and check every old URL still resolves.
  • Content inventory: list all blog posts or product pages (Only URLs containing: /blog/) with their last-modified dates.
  • Competitor research: see how many pages a site has and how often they're updated.

Example output

{
"site": "https://docs.apify.com",
"url": "https://docs.apify.com/platform/actors",
"lastmod": "2026-10-28",
"changefreq": "weekly",
"priority": 0.5,
"sitemap": "https://docs.apify.com/sitemap.xml",
"status": 200,
"broken": false,
"redirects": 0,
"finalUrl": "https://docs.apify.com/platform/actors",
"responseTimeMs": 169
}

A SUMMARY record per site lists the sitemap files found, sitemap errors, and the counts of URLs, broken and redirected pages.

Tips

  • Start with Max URLs per site = 100 to preview, then raise it.
  • Keep Parallel checks low (default 5) on small sites. The checker identifies itself with a clear User-Agent.
  • Pass a direct sitemap URL (e.g. https://example.com/post-sitemap.xml) to process just that file.

Pricing

Pay per URL saved.