Sitemap URL Extractor (XML, Index, GZ)
Pricing
$0.50 / 1,000 url extracteds
Sitemap URL Extractor (XML, Index, GZ)
Extract every URL from a website's XML sitemaps with lastmod, changefreq and priority. Finds sitemaps via robots.txt, follows sitemap indexes and reads .xml.gz files.
Pricing
$0.50 / 1,000 url extracteds
Rating
0.0
(0)
Developer
Proper Ecosystem Tools
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
9 days ago
Last modified
Categories
Security
Limited permissionsShare
Get every URL a website lists in its XML sitemaps, with lastmod, changefreq, and priority. Just enter a domain: the Actor finds the sitemaps through robots.txt, follows sitemap indexes, and reads gzip-compressed files.
Features
- Auto-discovery via robots.txt
Sitemap:lines, with /sitemap.xml and /sitemap_index.xml as fallbacks - Follows nested sitemap indexes
- Reads .xml.gz files
- Caps per site for URLs and sitemap files
- Very cheap: $0.50 per 1,000 URLs
Input
| Field | Description |
|---|---|
urls | A domain (sitemaps are found via robots.txt) or a direct sitemap URL. |
maxUrls | Stop after this many URLs per site. |
maxSitemaps | Stop after reading this many sitemap files per site. |
Output (illustrative example)
{"site": "example.com","sitemap": "https://www.example.com/sitemap-posts.xml","url": "https://www.example.com/blog/post-1","lastmod": "2025-01-15","changefreq": "weekly","priority": 0.8}
Pricing
Pay per event: url extracted. Rows that fail with an error are free. Set a maximum charge per run to cap spend.
Use cases
- Feed URLs into SEO audits, status checks, or scrapers
- Track new and updated pages on competitor sites
- Content inventories and migration planning
- Count indexed-intended pages
Works with the Apify API, schedules, webhooks, Make, Zapier, n8n, and AI agents via MCP.