Sitemap URL Extractor – Get All URLs of Any Website

Extract every URL from any website’s XML sitemaps: auto-discovery via robots.txt, sitemap indexes, .gz files, lastmod, priority, hreflang and images. Filter by regex or date. Fast, cheap and crawl-free.

What does it do?

Get all URLs of any website from its XML sitemaps – no crawling needed. The Actor auto-discovers sitemaps (robots.txt, /sitemap.xml, /sitemap_index.xml, WordPress), follows sitemap indexes recursively, unzips .xml.gz, supports plain-text sitemaps and returns lastmod, changefreq, priority, image count, hreflang alternates and news titles for every URL. Filter with include/exclude regex or by last-modified date.

Why use it?

• SEO audits and migrations: get the full URL inventory in seconds.
• Feed other scrapers: start any crawler from the sitemap URL list (much cheaper than crawling).
• Content monitoring: schedule with modifiedAfter to get only new/updated pages.
• Competitor research: see how many pages, products or articles a site publishes.

Quick start

1. Click Try for free / Start.
2. Paste your list (the example input already works – just press Start).
3. Download results as JSON, CSV, Excel or HTML, or use the API, schedules and integrations (Make, Zapier, n8n, Slack, Google Sheets…).

Input example

{
  "startUrls": [{ "url": "https://apify.com" }],
  "maxUrls": 1000,
  "includePattern": "/blog/"
}

Output example

{
  "url": "https://example.com/blog/post-1",
  "lastmod": "2026-09-14",
  "changefreq": "weekly",
  "priority": 0.8,
  "imageCount": 1,
  "alternates": [{ "hreflang": "fr", "href": "https://example.com/fr/blog/post-1" }],
  "sitemapUrl": "https://example.com/post-sitemap.xml"
}

Pricing

Pay only for results: $0.50 per 1,000 URLs (pay-per-event). No subscription. Platform usage is included in the price. You can set a maximum cost per run and the Actor stops before exceeding it.

FAQ

The site has no sitemap?

Then the run reports it in SUMMARY. Pass the sitemap URL directly if it lives at a non-standard path.

How many URLs can it extract?

Up to 1,000,000 per run; large sitemaps are streamed efficiently.

Legal & responsible use

This Actor only accesses publicly available data and official public APIs, respects robots.txt where applicable and paces its requests. You are responsible for using the results in line with applicable laws (e.g. GDPR/CCPA) and the terms of the data sources.

Support

Found a bug or need a feature? Open an issue on the Actor’s Issues tab – we usually reply within 24 hours. Check our other tools: Website SEO & Broken Link Auditor, B2B Lead & Tech Stack Intelligence, Shopify Product Scraper and ATS Jobs Scraper.