Sitemap URL Extractor – All URLs from XML Sitemaps

Sitemap URL Extractor gives you every page URL listed in a website's XML sitemaps, with lastmod, changefreq and priority. Give it a domain and it finds the sitemaps for you: it reads Sitemap: lines in robots.txt, then tries /sitemap.xml, /sitemap_index.xml, /sitemap-index.xml and /wp-sitemap.xml. It follows nested sitemap indexes and unzips .xml.gz sitemaps automatically.

You can also pass a sitemap URL directly, filter URLs with include / exclude regex, and cap the number of URLs per site. No browser, so it is fast and very cheap.

What can you use it for?

Extract all URLs from a sitemap

Get a clean list of every page of a website for an SEO audit, content inventory or migration mapping.

Get all pages of a website (without crawling)

A sitemap is the fastest way to list a site's pages. Feed the URLs into a scraper, link checker or LLM pipeline.

Monitor new pages on competitor sites

Schedule a run and compare lastmod dates to see which pages were added or updated.

Sitemap index and .gz support

Large sites split sitemaps into indexes and gzip files. This Actor follows all of them.

Filter to one section

Use includePattern like /blog/ or /products/ to export only the URLs you need.

How to use it

1. Click Try for free (or Start).
2. Enter your input (see the example below) and click Save & Start.
3. Download results as JSON, CSV, Excel or HTML, or read them via the API.

Input

• startUrls — Domains (example.com), homepages, or direct sitemap URLs.
• maxUrls — Stop after this many URLs per site (default 100; 0 = no limit).
• maxSitemaps — Max sitemap files fetched per site, including nested ones (default 500).
• includePattern — Optional regex; only output matching URLs.
• excludePattern — Optional regex; skip matching URLs.

Example input:

{
  "startUrls": [
    "apify.com"
  ],
  "maxUrls": 100
}

Output example

url	lastmod	sitemap	site
https://apify.com/		https://apify.com/sitemap/pages.xml	https://apify.com
https://apify.com/about		https://apify.com/sitemap/pages.xml	https://apify.com

All output fields: url, lastmod, changefreq, priority (number), sitemap (the file it came from), site. If no sitemap is found you get one row with error: "No sitemap found" (not charged).

How much does it cost?

This Actor uses pay-per-event pricing. You pay only for results, not for servers or subscriptions:

• $0.0005 per URL extracted, which is $0.50 per 1,000 URLs
• plus Apify's standard Actor start event of $0.00005 per run (per GB of memory; the default 512 MB memory = one event)

You process	You pay (approx.)
100 URLs	$0.05
1,000 URLs	$0.50
10,000 URLs	$5.00
100,000 URLs	$50.00

Apify's free plan includes monthly platform credit, which is enough to try this Actor at no cost.

Run it via API, schedule or AI agents

Run from your own code with the Apify API, JavaScript or Python client, schedule it in Apify Console, connect it to Make, Zapier, n8n or Google Sheets, or let an AI agent call it through the Apify MCP server (https://mcp.apify.com).

curl -X POST "https://api.apify.com/v2/acts/quillbit-tools~sitemap-url-extractor/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"startUrls": ["apify.com"], "maxUrls": 100}'

FAQ

Why did I only get 100 URLs? maxUrls defaults to 100 so a test run stays cheap (about $0.05). Set it higher, or to 0 for no limit.

What if a site has no sitemap? You get one row with error: "No sitemap found" and are not charged for URLs. Use the Broken Link Checker to crawl such sites instead.

Does it crawl the website? No. It reads only the sitemap files, which is why it is fast and cheap. Pages missing from the sitemap won't appear.

Are duplicates removed? Yes, each URL is output once per site, even if it appears in several sitemaps.

Can I pass a sitemap URL directly? Yes. Any URL ending in .xml, .xml.gz or containing sitemap in its path is read directly.

Related tools by Quillbit Tools

• Bulk URL Status & Redirect Chain Checker
• Broken Link Checker – crawl a site for 404s
• Domain Expiry, DNS & SSL Certificate Checker
• Website Tech Stack Detector
• Webpage to Markdown for LLMs & RAG
• RSS & Atom Feed to JSON Reader

Questions or a feature request? Open an issue on the Actor's Issues tab.