Sitemap Extractor — XML Sitemap to URL List (Index & Gzip)
Pricing
from $1.00 / 1,000 url extracteds
Go to Apify Store
Sitemap Extractor — XML Sitemap to URL List (Index & Gzip)
Give it a domain; get every URL in its sitemaps with lastmod, changefreq and priority. Finds sitemaps via robots.txt and common paths, follows sitemap indexes, handles .xml.gz. Fast, cheap, no browser.
Pricing
from $1.00 / 1,000 url extracteds
Rating
0.0
(0)
Developer
Upton & Partners
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
20 hours ago
Last modified
Categories
Share
Give it a website. Get back every URL listed in its sitemaps — with lastmod, changefreq and priority — as a clean table you can export to CSV, JSON or Excel, or pull via API.
What it does
- Finds sitemaps automatically from
robots.txt, falling back to/sitemap.xml,/sitemap_index.xmland/sitemap.xml.gz - Follows sitemap indexes to any depth
- Reads gzipped sitemaps (
.xml.gz) - Filters to URLs containing a substring, e.g.
/blog/ - No browser, no proxies — plain HTTP, so it's fast and cheap
Use cases
- SEO audits and content inventories
- Seeding a crawler or a RAG pipeline with a site's full URL list
- Monitoring when pages were last modified
- Migration checks: compare URL sets before and after a relaunch
Input
| Field | Description |
|---|---|
domains | Websites, e.g. example.com. Sitemaps are discovered automatically. |
sitemapUrls | Optional direct sitemap URLs. |
maxUrls | Cap per website. Default 50,000. |
includeFilter | Optional substring filter. |
Output
Pricing
Pay per URL extracted. You only pay for results.
Notes
- Reads only public sitemap files that sites publish for crawlers. It does not crawl pages or collect personal data.
- If a site publishes no sitemap, the run finishes with zero results and you pay nothing.
- This Actor was built and is maintained with AI assistance, with human review. Issues are answered within a few days.
