Sitemap URL Extractor – All URLs from Any Website
Pricing
from $0.20 / 1,000 sitemap urls
Sitemap URL Extractor – All URLs from Any Website
Get every URL from a website's XML sitemaps: auto-discovers sitemaps via robots.txt, follows sitemap indexes, reads .xml.gz, text and RSS sitemaps. lastmod, changefreq, priority, hreflang, filters. $0.20 per 1,000 URLs.
Pricing
from $0.20 / 1,000 sitemap urls
Rating
0.0
(0)
Developer
Parth
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
14 days ago
Last modified
Categories
Security
Limited permissionsShare
Get the complete list of a website's URLs from its XML sitemaps in seconds. Enter a domain and the Actor finds the sitemaps (from robots.txt and common locations such as /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml), follows sitemap index files recursively, reads gzipped (.xml.gz), text and RSS/Atom sitemaps, and outputs one row per unique URL with lastmod, changefreq, priority, image count and hreflang alternates.
$0.20 per 1,000 URLs. No browser, no start fee.
Use cases
- 🗺️ Crawl planning — feed the URL list into scrapers, the Website to Markdown Crawler, an SEO auditor or a status checker
- 🆕 Find new or updated content — use Modified after to get only pages changed since a date (competitor monitoring, news, product launches)
- 📊 SEO audits — count indexable pages per section, check sitemap coverage, compare with crawls
- 🛒 Ecommerce — list all product or category URLs of a store
Features
- Sitemap auto-discovery from robots.txt + common paths, or give a direct sitemap URL
- Recursive sitemap indexes,
.xml.gz, plain-text and RSS/Atom sitemaps - Fields:
url,lastmod(normalized ISO 8601),changefreq,priority,imageCount, hreflangalternates, Google News title, sourcesitemapUrl - Filters: include/exclude glob or regex patterns, lastmod after date, max URLs per site
- De-duplicated per site; run summary lists every sitemap file read and any errors
Input example
{"startUrls": [{ "url": "https://apify.com" }, { "url": "https://blog.apify.com/sitemap.xml" }],"maxUrlsPerSite": 5000,"includeUrlPatterns": ["https://blog.apify.com/**"],"lastmodAfter": "2026-01-01"}
Output example
{"url": "https://blog.apify.com/when-data-gets-too-big-why-you-need-structured-data/","lastmod": "2026-10-19T11:01:48.000Z","changefreq": null,"priority": null,"imageCount": 1,"alternates": null,"sitemapUrl": "https://blog.apify.com/sitemap-posts.xml","site": "https://blog.apify.com"}
The RUN_SUMMARY record lists each sitemap file read (type, URL count, child sitemaps) and errors.
Pricing
| Event | Price | When |
|---|---|---|
| Sitemap URL | $0.0002 ($0.20 / 1,000 URLs) | Each unique URL saved after filters |
| Actor start | $0.00005 | Once per run |
A 5,000-page site costs about $1. Sites without a sitemap return a free error row.
FAQ
The site has no sitemap — what now? You'll get a free row saying so. Use a crawler (e.g. the Website to Markdown Crawler or Technical SEO Site Auditor) to discover pages by following links.
Does it check if the URLs work? No, it lists them. Pipe the list into the Bulk URL Status & Redirect Checker to find 404s and redirects in your sitemap.
Are huge sitemaps supported? Yes — sitemap indexes with hundreds of files and millions of URLs. Use Max URLs per site to cap.