Sitemap URL Extractor
Pricing
Pay per event
Sitemap URL Extractor
Extract every URL from any website's XML sitemaps, including sitemap indexes, gzip sitemaps, and robots.txt discovery. Returns lastmod, changefreq, and priority.
Pricing
Pay per event
Rating
0.0
(0)
Developer
Data Lantern
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
a day ago
Last modified
Categories
Share
Sitemap URL Extractor gets every page URL listed in a website's XML sitemaps. Enter a domain and it finds the sitemaps for you through robots.txt and the usual locations, follows sitemap indexes, and reads gzip-compressed sitemaps.
What can this tool do?
- Discover sitemaps automatically from
robots.txt,/sitemap.xml,/sitemap_index.xml, and/wp-sitemap.xml. - Follow nested sitemap indexes of any depth.
- Read
.xml,.xml.gz, and plain-text sitemaps. - Return
lastmod,changefreq, andpriorityfor each URL. - Filter URLs with include and exclude patterns, such as only
/blog/pages. - Process many websites in one run.
What data does it return?
| Field | Example |
|---|---|
url | https://example.com/blog/post-1 |
lastmod | 2026-09-01 |
changefreq | weekly |
priority | 0.8 |
sitemap | https://example.com/post-sitemap.xml |
website | https://example.com/ |
How to use it
- Enter one or more websites or sitemap URLs.
- Optionally set a URL limit and include or exclude patterns.
- Click Start, then download the results as JSON, CSV, or Excel, or read them through the API.
Common uses
- Build a full page list for an SEO audit or a site migration.
- Feed a website's pages into a crawler or an AI knowledge base.
- Track newly published pages by comparing
lastmodbetween runs.
Pricing
Pay per URL: $0.50 per 1,000 URLs. You only pay for URLs you receive. Set a maximum cost per run in the run options.
Use it through the API, AI agents, and integrations
Call it from your code with the Apify API, schedule it, or connect it to Make, Zapier, n8n, or an AI agent through Apify's MCP server.
Is it legal?
Sitemaps are files that websites publish so that others can find their pages. This tool reads only those public files. It does not log in, bypass access controls, or collect personal information.
FAQ
The run returned no URLs. The website may not publish a sitemap. The run log lists the locations that were checked.
Can I get the page content too? This tool returns URLs only. Pass them to a crawler, such as Website Content Crawler, to get page text.
Feedback
Found a bug or need a field added? Open an issue on the Issues tab. We usually respond within 24 hours.
