Sitemap Auditor avatar

Sitemap Auditor

Pricing

from $0.08 / 1,000 unique sitemap urls

Go to Apify Store
Sitemap Auditor

Sitemap Auditor

Discover XML sitemap indexes and export a bounded, deduplicated URL inventory with alternate-language links.

Pricing

from $0.08 / 1,000 unique sitemap urls

Rating

0.0

(0)

Developer

Axel Hu

Axel Hu

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Share

Export a deduplicated URL inventory from public XML sitemaps and nested sitemap indexes. Website inputs discover Sitemap directives in robots.txt and fall back to /sitemap.xml. Output includes loc, source sitemap, lastmod/changefreq/priority and optional alternate-language links. It does not crawl or verify each listed page.

Example

{"startUrls":["https://www.sitemaps.org/sitemap.xml"],"maxSitemaps":20,"maxEntries":1000,"includeAlternates":true}

Results go to the default Dataset and diagnostics/limits to SUMMARY. An empty result with fetch/parsing failures fails the run; a valid empty sitemap may succeed with no output. Partial runs retain their successfully found entries.

Pricing

$0.00005 per run start plus $0.00008 per unique URL emitted ($0.08/1,000). A run emitting 20 URLs costs $0.00165. Failed fetches and duplicates have no URL charge; the start charge still applies. Respecting the user's charge limit can truncate the inventory.

Limits and safety

At most 10 input URLs, 100 sitemap documents, 10,000 output entries, 150 HTTP attempts, 20 MB transferred and 40 MB decoded per run. Each sitemap is limited to 5 MB and each robots.txt to 1 MB; fetch timeout is 3–60 seconds. gzip, Brotli and deflate HTTP encodings and bounded gzip sitemap files are supported. XML DTD and entity declarations are rejected. Limits may yield partial inventories. Every redirect is revalidated (up to 5); connections use validated, pinned public IP addresses. Private/reserved/transition addresses, URL credentials, and ports other than HTTP(S) 80/443 are rejected. No browser, login, cookies or paid external API. Query values in output URLs are redacted, so query-dependent inventories require another tool; no raw secret-bearing URL is logged.

Support

Open an Issue on this Actor's Apify page with a run ID and non-sensitive sample. Do not post credentials or private URLs.