Pricing

from $1.50 / 1,000 sitemap health checks

Try for free

Go to Apify Store

Sitemap URL Scraper: List URLs & Check Changes

Try for free

List every URL a site's sitemaps declare, with lastmod, changefreq and priority, or add a health check of each sitemap: fetch status, URL count, drift since your last run, a dead-link sample and alerts. Sites that never answer come back as free status rows.

Pricing

from $1.50 / 1,000 sitemap health checks

Rating

0.0

(0)

Developer

Pradio Actors

Actor stats

Bookmarked

Total users

Monthly active users

13 days ago

Last modified

Categories

SEO tools

Developer tools

You can access the Sitemap URL Scraper: List URLs & Check Changes programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = { "startUrls": [
9        "https://cmu.edu/sitemap.xml",
10        "https://www.sitemaps.org/sitemap.xml",
11        "https://docs.python.org/sitemap.xml",
12    ] }
13
14# Run the Actor and wait for it to finish
15run = client.actor("pradio/sitemap-url-scraper").call(run_input=run_input)
16
17# Fetch and print Actor results from the run's dataset (if there are any)
18print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
19for item in client.dataset(run.default_dataset_id).iterate_items():
20    print(item)
21
22# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Sitemap URL Scraper: Drift & Dead-Link Audit API in Python

The Apify API client for Python is the official library that allows you to use Sitemap URL Scraper: List URLs & Check Changes API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Sitemap URL Scraper: List URLs & Check Changes API in JavaScript

Sitemap URL Scraper: List URLs & Check Changes API through CLI

Sitemap URL Scraper: List URLs & Check Changes OpenAPI definition

Sitemap URL Scraper: List URLs & Check Changes API

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Bikram Adhikari

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

Sitemap URL Extractor — recursive, filters, .gz

x402opklaar/sitemap-url-extractor

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Opklaar

Sitemap Change Detector

tri_angle/sitemap-change-detector

Identify and monitor sitemaps for specified websites. Retrieve only the new, updated, or removed URLs since the last crawl.

Tri⟁angle

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.

Neo B

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.

Nicolas van Arkens

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

Sitemap URL Extractor & Sitemap Scraper: All Website URLs

nebulacolors/sitemap-urls

Sitemap extractor that lists all website URLs from its sitemaps: robots.txt Sitemap lines or /sitemap.xml, nested sitemap indexes, gzip and text sitemaps, with lastmod, changefreq and priority. Filter by pattern or date, or crawl links when there's no sitemap. $0.0003 per URL.

Nebula Colors LLC

Sitemap URL Extractor

tidyrow/sitemap-url-extractor

Extract every URL from any website's sitemaps. Finds sitemaps via robots.txt or common paths, follows sitemap indexes, reads gzip, RSS/Atom and text sitemaps, and returns lastmod, priority, hreflang, images and news. Optional HTTP status checks.

Tidyrow Data

Sitemap URL Extractor: All URLs via robots.txt, Index & .gz

saif-tools/sitemap-url-extractor

Give it domains or sitemap URLs. It discovers sitemaps via robots.txt, follows sitemap indexes, unzips .gz files and returns one clean JSON row per URL with lastmod, changefreq and priority. Fast, cheap, MCP-friendly.