Sitemap URL Extractor – All URLs, Changes & Redirects

Enter a domain and get every URL from its sitemaps as a clean table: lastmod, images, videos, news, hreflang, plus what's new or removed since your last run. Optionally check each URL's status code, redirects and canonical.

What can you use it for?

• SEO audits: find 404s, redirects and canonical mismatches listed in a sitemap.
• Competitor monitoring: schedule daily and get only the new pages (products, blog posts, landing pages).
• Crawler/RAG input: feed a clean URL list into other scrapers, AI pipelines or the PageSpeed Checker.
• Site migrations: compare URL inventories before and after.
• News & media tracking: read Google News sitemaps with titles, publication dates and keywords.

Features

Feature	This Actor	Typical sitemap Actors
Domain-only input: robots.txt + common-path discovery	✅	Sometimes
Sitemap index recursion, .xml.gz	✅	✅ / sometimes
Image, video and news extensions	✅	❌
hreflang alternates	✅	❌
lastmod date filter, include/exclude regex	✅	Rarely
New / removed URL diff between runs	✅	❌
Status checks with GET fallback, redirect chain, canonical, meta robots	✅	HEAD only
Proxy support for sites that block cloud IPs	✅	Varies
Failures are free	✅	❌

How to use

1. Enter one or more domains (e.g. apify.com) or sitemap URLs.
2. Optionally set a lastmod range, URL patterns, or enable status checks.
3. Click Start. Schedule it and enable Output only new URLs for monitoring.

Example input

{ "startUrls": [{ "url": "https://apify.com" }], "maxUrls": 1000, "lastmodFrom": "2026-01-01", "checkStatus": true }

Example output (real run)

{ "url": "https://www.theguardian.com/world/live/2026/oct/13/...", "lastmod": "2026-10-13T08:50:00Z", "types": ["page", "image", "news"],
  "news": { "title": "Two ships hit by drones of unknown origin off Bulgarian coast – Europe live", "publicationName": "The Guardian", "language": "en" },
  "diffStatus": "new", "discoveredVia": "input" }

{ "url": "https://apify.com/about", "status": 200, "redirected": false, "finalUrl": "https://apify.com/about",
  "canonical": "https://apify.com/about", "canonicalMatches": true, "responseTimeMs": 182 }

The SUMMARY record gives per-site totals, how sitemaps were found, and counts and samples of new and removed URLs.

Pricing

Pay per URL returned, with no platform usage fees on top. See the Pricing tab for the current price.

• 1,000 URLs ≈ $2 · 10,000 URLs ≈ $20 · 100,000 URLs ≈ $200
• With Output only new URLs, daily monitoring costs only for new pages.
• Unreadable sitemaps and sites without a sitemap are free. They're listed in FAILED.

Integrations

• API: run via the Apify API or the JavaScript/Python clients, and get results as JSON, CSV, Excel or XML.
• No-code: native Apify integrations for Make, Zapier and n8n, plus Google Sheets, Slack, webhooks and schedules.
• AI agents: available through the Apify MCP server, so Claude, ChatGPT and other agents can call it as a tool.

FAQ

The site has no sitemap in robots.txt. The Actor also tries common paths (/sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml, …). You can also pass the sitemap URL directly. I get HTTP 403. Some publishers block cloud IPs. Enable the Proxy option. How does the diff work? The URL list is saved per site + filter set in a named store. The next run marks URLs as new or existing. Removed URLs are reported only when the run wasn't capped by Max URLs, so the comparison is complete. Does it crawl pages? No, it reads sitemaps only (fast and cheap). Status checks are optional.

Related Actors from the same developer

• 📸 Website Screenshot API: full-page, mobile and PDF screenshots of any URL.
• ⚡ Bulk PageSpeed & Lighthouse Checker: Core Web Vitals and Lighthouse scores for many URLs.

Workflow tip: extract URLs with the Sitemap Extractor → audit them with the PageSpeed Checker → screenshot the flagged pages.

Keywords: sitemap extractor, sitemap.xml parser, sitemap URL list, sitemap to CSV, website URL list, new pages monitor, broken links in sitemap, redirect checker, canonical checker, hreflang.