Sitemap URL Extractor
Pricing
from $0.35 / 1,000 url inventorieds
Sitemap URL Extractor
Traverse public sitemap indexes into a deduplicated URL inventory with source sitemap, lastmod, changefreq, priority, media counts, and partial-failure evidence.
Pricing
from $0.35 / 1,000 url inventorieds
Rating
0.0
(0)
Developer
Michael Olmos
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
Sitemap URL Inventory
Turn public sitemap indexes and URL sets into a normalized, deduplicated inventory. Every URL keeps its source sitemap plus lastmod, changefreq, priority, and media counts where available.
Reliability and safety
- Recursively follows sitemap indexes with explicit caps of 500 sitemap files and 100,000 output URLs.
- Public HTTP(S) only; private IPs, private DNS answers, embedded credentials, and unsafe redirects are blocked.
- Invalid child sitemap URLs, HTTP failures, parse failures, cross-host exclusions, and cap truncation remain visible in the OUTPUT summary.
sameHostnameOnlyprevents a root sitemap from expanding onto unrelated hosts by default.
Charging
PAY_PER_EVENT uses a one-time Actor-start event plus url-inventoried. Only successful unique stored URL inventory rows are charged. Duplicate or invalid entries, sitemap fetch/parse failures, excluded children, and the OUTPUT summary are not charged.
{"sitemapUrls":["https://blog.apify.com/sitemap-posts.xml"],"maxSitemaps":3,"maxUrls":10,"sameHostnameOnly":true,"timeoutSecs":20}