Sitemap URL Extractor avatar

Sitemap URL Extractor

Pricing

Pay per event

Go to Apify Store
Sitemap URL Extractor

Sitemap URL Extractor

Get every URL a website lists in its XML sitemaps. Finds sitemaps through robots.txt and common locations, follows sitemap indexes and .gz files, and returns each URL with lastmod, changefreq, priority, image count and hreflang languages. Filter by regex. Pay per URL.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Ian McCann

Ian McCann

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

9 days ago

Last modified

Security

Limited permissions

Share

What does Sitemap URL Extractor do?

It collects every URL a website publishes in its XML sitemaps, without crawling the site page by page.

  • Finds sitemaps automatically from robots.txt and common locations (/sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml)
  • Follows sitemap indexes to any depth and reads gzipped (.xml.gz) sitemaps
  • Returns each URL with lastmod, changefreq, priority, image count, video flag and hreflang languages
  • Include / exclude regex filters so you only get, for example, /blog/ or /product/ URLs
  • De-duplicates URLs per site

Use cases

  • SEO audits: get the full list of indexable pages, find stale pages by lastmod, compare the sitemap with what is actually ranking
  • Content inventories and site migrations: export every URL before you move a site
  • Monitoring: schedule it and compare runs to see which pages a competitor added
  • Feeding other tools: pass the URLs to a status checker, SEO audit, or your own scraper

How to use it

  1. Enter websites (like apify.com) or direct sitemap URLs.
  2. Optional: set a regex in Only URLs matching, such as /blog/.
  3. Run and export as CSV, JSON or Excel.

Input example

{ "startUrls": ["apify.com"], "maxUrlsPerSite": 200, "includePattern": "/store/" }

Output example

{
"url": "https://apify.com/store/categories/ai",
"lastmod": "2026-10-20",
"changefreq": null,
"priority": null,
"imageCount": 0,
"alternateLanguages": [],
"sitemapUrl": "https://apify.com/sitemap/pages.xml",
"domain": "apify.com"
}

How much does it cost?

EventPrice
Actor start$0.001 per run
URL extracted$0.0005 per URL

1,000 URLs cost about $0.50. Filtered-out URLs are not charged. Use Maximum URLs per site or a run cost limit to stay in budget.

Notes

  • Only sitemap files are downloaded, not the pages themselves, so runs are fast and light on the target site.
  • Sitemaps disallowed by robots.txt are skipped by default.
  • If a site has no sitemap, the run summary says so and nothing is charged for that site.