Sitemap URL Extractor avatar

Sitemap URL Extractor

Pricing

from $0.35 / 1,000 url inventorieds

Go to Apify Store
Sitemap URL Extractor

Sitemap URL Extractor

Traverse public sitemap indexes into a deduplicated URL inventory with source sitemap, lastmod, changefreq, priority, media counts, and partial-failure evidence.

Pricing

from $0.35 / 1,000 url inventorieds

Rating

0.0

(0)

Developer

Michael Olmos

Michael Olmos

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Share

Sitemap URL Inventory

Turn public sitemap indexes and URL sets into a normalized, deduplicated inventory. Every URL keeps its source sitemap plus lastmod, changefreq, priority, and media counts where available.

Reliability and safety

  • Recursively follows sitemap indexes with explicit caps of 500 sitemap files and 100,000 output URLs.
  • Public HTTP(S) only; private IPs, private DNS answers, embedded credentials, and unsafe redirects are blocked.
  • Invalid child sitemap URLs, HTTP failures, parse failures, cross-host exclusions, and cap truncation remain visible in the OUTPUT summary.
  • sameHostnameOnly prevents a root sitemap from expanding onto unrelated hosts by default.

Charging

PAY_PER_EVENT uses a one-time Actor-start event plus url-inventoried. Only successful unique stored URL inventory rows are charged. Duplicate or invalid entries, sitemap fetch/parse failures, excluded children, and the OUTPUT summary are not charged.

{"sitemapUrls":["https://blog.apify.com/sitemap-posts.xml"],"maxSitemaps":3,"maxUrls":10,"sameHostnameOnly":true,"timeoutSecs":20}