Sitemap Indexability Auditor avatar

Sitemap Indexability Auditor

Pricing

from $33.50 / 1,000 indexability checks

Go to Apify Store
Sitemap Indexability Auditor

Sitemap Indexability Auditor

Audit whether the URLs in your sitemaps (or a plain URL list) are actually indexable — sitemaps are expanded (bounded nested depth + a hard URL cap) and every page URL gets one evidenced indexability verdict.

Pricing

from $33.50 / 1,000 indexability checks

Rating

0.0

(0)

Developer

NexGen Watch

NexGen Watch

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

21 hours ago

Last modified

Categories

Share

Audits whether the URLs in your sitemaps (or a plain URL list) are actually indexable. Sitemaps are expanded — bounded by nested-sitemap depth and a hard URL cap — and every page URL gets one evidenced verdict.

What you submit

urls — sitemap urls or page urls. Sitemap URL(s) and/or page URLs. Sitemaps are expanded (bounded nested depth + capped child count) into their page URLs; each page URL gets one indexability verdict: HTTP state, robots permission, page robots directives (meta robots + X-Robots-Tag), canonical target + conflicts, and lastmod plausibility. A complete verdict bills; a target blocked by robots/SSRF/403/429/5xx or unreachable is delivered as an unbilled status.

The runtime source gate (per submitted target)

Because you choose the targets, the source contract is enforced at run time, per origin, before any page is read:

  • robots.txt is fetched once per origin and honored for our crawler. No robots / 404 = permitted; a disallowed path or an unavailable robots file = BLOCKED.
  • SSRF guard — every host is resolved and must be a public address. Private, loopback, link-local, reserved and cloud-metadata addresses are refused before a socket opens.
  • HTTP — bounded body reads; 403 / 429 / 5xx = BLOCKED; DNS / timeout / connection faults = UNREACHABLE.

A BLOCKED or UNREACHABLE target is delivered as an unbilled status row — never a broken-site verdict, and never charged.

Output

One row per target. A complete evidenced verdict carries outcome: answer; blocked / unreachable / unparseable targets carry that status and are not billed.

Pricing

Pay per event. The reserved start event is platform-automatic and is never charged from code. The only event charged in code is one complete verdict per target — blocked, unreachable and locally-malformed targets never bill (push-then-charge; failures can only undercharge).

EventPrice (USD)When it fires
apify-actor-start$0.02once when the run starts (reserved; never charged in code)
indexability_check$0.05once per complete evidenced verdict delivered (blocked / unreachable / unparseable never bill)

Volume tiers reduce the per-verdict price as usage grows: $0.05 → $0.045 → $0.04 → $0.0335.

Why this and not a generic crawler

45-user sitemap/SEO comparators exist; this differs — a per-URL indexability VERDICT (robots+meta+canonical+lastmod evidenced), not a crawl dump.