Sitemap Link Health Checker avatar

Sitemap Link Health Checker

Pricing

from $1.00 / 1,000 url checkeds

Go to Apify Store
Sitemap Link Health Checker

Sitemap Link Health Checker

Extract URLs from public XML sitemaps and check a bounded sample for HTTP errors and redirects while respecting robots.txt.

Pricing

from $1.00 / 1,000 url checkeds

Rating

0.0

(0)

Developer

asaf meizner

asaf meizner

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a month ago

Last modified

Features

Limited permissions

Share

Check HTTP health for URLs listed in a public XML sitemap. Use it for sites you own or have permission to audit. It respects robots.txt and uses sequential requests with at least one second between checks, plus any declared crawl delay.

Input

{"sitemapUrl":"https://docs.python.org/sitemap.xml","maxUrls":20,"maxSitemaps":5}

Sitemap indexes and page URLs are followed within the starting origin only. Defaults: 20 page checks and 5 sitemap documents; hard limits: 200 pages and 20 sitemap documents. Redirects are limited to nine requests and checked against robots.txt at each destination. Cross-origin redirects are skipped. Responses are limited to 3 MB decoded; XML entities are rejected. Temporary HTTP failures receive up to two retries. No recursive HTML crawling, proxies, logins or browser automation.

Example output

Illustrative row showing the output shape; timing varies by run:

{
"url": "https://docs.python.org/3.13/",
"sitemapUrl": "https://docs.python.org/sitemap.xml",
"finalUrl": "https://docs.python.org/3.13/",
"status": 200,
"redirects": 0,
"responseMs": 1120,
"healthy": true,
"type": "url-check"
}

To find broken sitemap links, filter the dataset for type equal to url-check and healthy equal to false. Keep url-error rows separately: they indicate a check could not finish, rather than a confirmed HTTP error. Export the dataset as JSON or CSV for a spreadsheet or scheduled monitoring workflow.

Output and pricing

Each url-check row contains url, sitemapUrl, finalUrl, status, redirects, responseMs, and healthy (HTTP 200–399). Timing includes rate-limit waits and retries. Sitemap parsing failures produce sitemap-error; blocked or unreachable pages produce url-error. HTTP health does not establish content quality or indexability. Large pages exceeding the response limit cannot be checked.

Price: $0.001 per completed url-check ($1 per 1,000), including responses such as HTTP 404. Network failures, oversized responses and robots-denied URLs are not charged.

Verification and limits

On October 18, 2026, the actor ran end to end locally against https://docs.python.org/sitemap.xml and checked the Python 3.11, 3.12 and 3.13 documentation roots: all returned HTTP 200. Seven parser/HTTP safety tests passed. The public robots file advertises this sitemap and permits these paths; documentation licensing is at https://docs.python.org/3/license.html. Users must verify authorization and applicable site terms. Robots permission alone does not establish authorization. This is a speculative portfolio experiment with unproven Store demand.