Sitemap URL Extractor – All URLs from Any Website avatar

Sitemap URL Extractor – All URLs from Any Website

Pricing

from $0.20 / 1,000 sitemap urls

Go to Apify Store
Sitemap URL Extractor – All URLs from Any Website

Sitemap URL Extractor – All URLs from Any Website

Get every URL from a website's XML sitemaps: auto-discovers sitemaps via robots.txt, follows sitemap indexes, reads .xml.gz, text and RSS sitemaps. lastmod, changefreq, priority, hreflang, filters. $0.20 per 1,000 URLs.

Pricing

from $0.20 / 1,000 sitemap urls

Rating

0.0

(0)

Developer

Parth

Parth

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

14 days ago

Last modified

Security

Limited permissions

Share

Get the complete list of a website's URLs from its XML sitemaps in seconds. Enter a domain and the Actor finds the sitemaps (from robots.txt and common locations such as /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml), follows sitemap index files recursively, reads gzipped (.xml.gz), text and RSS/Atom sitemaps, and outputs one row per unique URL with lastmod, changefreq, priority, image count and hreflang alternates.

$0.20 per 1,000 URLs. No browser, no start fee.

Use cases

  • 🗺️ Crawl planning — feed the URL list into scrapers, the Website to Markdown Crawler, an SEO auditor or a status checker
  • 🆕 Find new or updated content — use Modified after to get only pages changed since a date (competitor monitoring, news, product launches)
  • 📊 SEO audits — count indexable pages per section, check sitemap coverage, compare with crawls
  • 🛒 Ecommerce — list all product or category URLs of a store

Features

  • Sitemap auto-discovery from robots.txt + common paths, or give a direct sitemap URL
  • Recursive sitemap indexes, .xml.gz, plain-text and RSS/Atom sitemaps
  • Fields: url, lastmod (normalized ISO 8601), changefreq, priority, imageCount, hreflang alternates, Google News title, source sitemapUrl
  • Filters: include/exclude glob or regex patterns, lastmod after date, max URLs per site
  • De-duplicated per site; run summary lists every sitemap file read and any errors

Input example

{
"startUrls": [{ "url": "https://apify.com" }, { "url": "https://blog.apify.com/sitemap.xml" }],
"maxUrlsPerSite": 5000,
"includeUrlPatterns": ["https://blog.apify.com/**"],
"lastmodAfter": "2026-01-01"
}

Output example

{
"url": "https://blog.apify.com/when-data-gets-too-big-why-you-need-structured-data/",
"lastmod": "2026-10-19T11:01:48.000Z",
"changefreq": null,
"priority": null,
"imageCount": 1,
"alternates": null,
"sitemapUrl": "https://blog.apify.com/sitemap-posts.xml",
"site": "https://blog.apify.com"
}

The RUN_SUMMARY record lists each sitemap file read (type, URL count, child sitemaps) and errors.

Pricing

EventPriceWhen
Sitemap URL$0.0002 ($0.20 / 1,000 URLs)Each unique URL saved after filters
Actor start$0.00005Once per run

A 5,000-page site costs about $1. Sites without a sitemap return a free error row.

FAQ

The site has no sitemap — what now? You'll get a free row saying so. Use a crawler (e.g. the Website to Markdown Crawler or Technical SEO Site Auditor) to discover pages by following links.

Does it check if the URLs work? No, it lists them. Pipe the list into the Bulk URL Status & Redirect Checker to find 404s and redirects in your sitemap.

Are huge sitemaps supported? Yes — sitemap indexes with hundreds of files and millions of URLs. Use Max URLs per site to cap.