Sitemap URL Extractor - Get All URLs from sitemap.xml avatar

Sitemap URL Extractor - Get All URLs from sitemap.xml

Pricing

Pay per event

Go to Apify Store
Sitemap URL Extractor - Get All URLs from sitemap.xml

Sitemap URL Extractor - Get All URLs from sitemap.xml

Extract every URL from a website's XML sitemaps. Auto-finds sitemaps via robots.txt, follows sitemap index files, reads .xml.gz, returns lastmod, changefreq, priority, hreflang and image counts. Fast, no browser, cheap per URL.

Pricing

Pay per event

Rating

0.0

(0)

Developer

凡 方

凡 方

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

10 days ago

Last modified

Security

Limited permissions

Share

What does Sitemap URL Extractor do?

Sitemap URL Extractor gets all URLs from a website's sitemap.xml in seconds. Enter a homepage and it automatically finds the sitemaps in robots.txt (or at /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml), follows sitemap index files, unpacks gzipped .xml.gz sitemaps, and returns one clean row per page URL with lastmod, changefreq, priority, hreflang alternates and image counts.

Use it as a sitemap scraper / sitemap parser API to list every page of a site before crawling, to feed URLs into other Actors (like Webpage to Markdown), or to monitor which pages were added or updated.

Why use it?

  • 🔍 Automatic sitemap discovery – robots.txt Sitemap: lines plus the common default locations, including WordPress, Shopify, Yoast and Next.js sitemaps.
  • 🗂️ Sitemap index support – recursively follows nested sitemap indexes (news, image, video, product, blog sitemaps).
  • 🗜️ .xml, .xml.gz and .txt sitemaps – handles compressed and plain-text sitemaps and tolerates broken XML.
  • 🎯 Include / exclude regex filters – e.g. only /blog/ or /products/ URLs. Filtered URLs are free.
  • ⚡ Fast and cheap – plain HTTP, no browser: 10,000 URLs in about 6 seconds.
  • 📊 Summary per site – which sitemaps were found and parsed, and which failed, in the SUMMARY record.

How to use it

  1. Add website homepages (e.g. https://apify.com) or direct sitemap URLs to URLs.
  2. Optionally set Max URLs per site and an include / exclude pattern.
  3. Click Start and export the URL list as JSON, CSV, Excel or via the API.

Input example

{
"startUrls": [{ "url": "https://apify.com" }],
"maxUrlsPerSite": 10000,
"includePattern": "/blog/"
}

Output example

{
"url": "https://apify.com/blog/web-scraping-guide",
"lastmod": "2026-10-01",
"changefreq": "weekly",
"priority": 0.8,
"imageCount": 1,
"alternates": [{ "hreflang": "de", "href": "https://example.com/de/page" }],
"sitemapUrl": "https://apify.com/sitemap/blog.xml",
"site": "https://apify.com"
}

How much does it cost?

This Actor uses pay-per-event (PPE) pricing: you pay only for results, and the Apify platform compute it uses is already included.

EventPricePer 1,000
URL extracted$0.0002 per URL$0.20 per 1,000 URLs
Actor start$0.0005 per run–

Duplicate URLs and URLs removed by your include/exclude filters are not charged. Use Max URLs per site to cap the cost. For example, 1,000 URLs cost about $0.20. The Actor start fee is charged once per run (one event per GB of memory; the default memory setting counts as one). You can set a maximum cost per run in the run options and the Actor stops cleanly when it is reached. Apify's free plan includes $5 of monthly credit, enough to try it at no cost.

Use cases

  • SEO audits – count indexable pages, find stale lastmod dates, check hreflang coverage.
  • Crawl seeding – get a full URL list before scraping, instead of crawling link by link.
  • Content monitoring – schedule daily runs and compare lastmod to detect new or updated pages on competitor sites.
  • AI / RAG ingestion – list every docs page, then convert them with Webpage to Markdown.

FAQ

What if a site has no sitemap? The run summary lists it under "No sitemap found". You can then crawl it with a link crawler instead.

Can I pass a sitemap URL directly? Yes – any URL ending in .xml, .xml.gz or .txt is parsed directly.

Can I use it from the API, Make, Zapier or an AI agent? Yes. Call it through the Apify API, integrations or the Apify MCP server.

Other tools by Digital-Tools

Questions or feature requests? Open an issue in the Issues tab.