Pricing

from $0.10 / 1,000 url listeds

Try for free

Go to Apify Store

Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status

Try for free

Extract every URL from a website's XML sitemaps (sitemap indexes, .xml.gz, text sitemaps, auto-discovered from robots.txt) with lastmod, changefreq, priority, hreflang and image counts. Validates against the sitemaps.org protocol and can check each URL for 404s, redirects and robots.txt blocks.

Pricing

from $0.10 / 1,000 url listeds

Rating

0.0

(0)

Developer

Larry Johnson

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

SEO tools

Developer tools

Automation

You can access the Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "startUrls": ["https://crawlee.dev/"],
10    "maxUrls": 200,
11}
12
13# Run the Actor and wait for it to finish
14run = client.actor("mrlarryjohnson/sitemap-extractor-validator").call(run_input=run_input)
15
16# Fetch and print Actor results from the run's dataset (if there are any)
17print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
18for item in client.dataset(run.default_dataset_id).iterate_items():
19    print(item)
20
21# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Sitemap Extractor & Validator: All URLs, .gz, Status Check API in Python

The Apify API client for Python is the official library that allows you to use Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status API in JavaScript

Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status API through CLI

Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status OpenAPI definition

Sitemap Extractor & Validator: All URLs, Indexes, .gz, Status API

Sitemap Detector

coder_zoro/sitemap-detector

Find sitemap URLs fast with our free Sitemap Finder tool. Instantly detect sitemaps from any website for SEO audits, indexing checks, and crawl planning. Improve visibility, site structure insights, and search engine performance in just seconds

Zoro

182

5.0

(3)

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Bikram Adhikari

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

Sitemap URL Extractor — recursive, filters, .gz

x402opklaar/sitemap-url-extractor

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Opklaar

Sitemap Extractor

cerebral_aluminum/sitemap-extractor

Extract all URLs from website sitemaps. Pages, images, PDFs. Handles sitemap indexes and WordPress.

Benny

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.

Neo B

Email Validator: Bulk List Verifier, Pay Per Email Checked

mrlarryjohnson/email-validator-api

Validate email lists without sending a thing: syntax, DNS/MX existence, disposable-domain detection, role-based and free-provider flags, 0-100 deliverability score. DNS failures are free, never faked.