Pricing

from $0.40 / 1,000 url extracteds

Try for free

Go to Apify Store

Sitemap Scraper - XML URL Extractor & Monitor

Try for free

Build a URL inventory from XML sitemaps for SEO audits, crawl planning or content monitoring. Export JSON or CSV and monitor changes. $0.4 per 1,000 rows plus $0.001 per run.

Pricing

from $0.40 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Andy Besos

Actor stats

Bookmarked

Total users

Monthly active users

18 hours ago

Last modified

Categories

SEO tools

Developer tools

Website URLs

targets

Required

Required. One or more website base URLs (e.g. https://example.com). The actor automatically discovers sitemaps via robots.txt and common paths (/sitemap.xml, /sitemap_index.xml). You can also paste direct sitemap URLs like https://example.com/sitemap.xml. URLs are normalized automatically.

Type:string[]

Example:

[
  "https://apify.com"
]

Maximum URLs per target

maxItemsPerTarget

Optional

Limit the number of URLs returned per target. Set to 0 for all URLs. The prefilled health-check input returns one URL.

Type:integer

Minimum:0

Default:0

Example:

Maximum sitemap recursion depth

maxDepth

Optional

How deep to follow nested sitemap indexes. 1 = only the top-level sitemap. 3 = up to 3 levels of sitemap indexes. Increase for sites with deeply nested sitemap structures.

Type:integer

Minimum:1

Maximum:20

Default:5

Maximum sitemaps to process

maxSitemaps

Optional

Safety limit on the total number of sitemap files to fetch per target. Prevents runaway on sites with thousands of nested sitemaps. Set to 0 for unlimited.

Type:integer

Minimum:0

Maximum:10000

Default:100

Request timeout (milliseconds)

timeoutMillis

Optional

Timeout per HTTP request in milliseconds. Increase for slow sites.

Type:integer

Minimum:5000

Maximum:120000

Default:30000

Concurrent requests

concurrency

Optional

Number of concurrent HTTP requests for fetching sitemaps. Higher is faster but may trigger rate limits. 1 is safest.

Type:integer

Minimum:1

Maximum:10

Default:3

Include HTTP status check

includeStatusCheck

Optional

When enabled, performs an HTTP HEAD request for each extracted URL to get the HTTP status code. Adds the statusCode field to output. Slower but useful for finding broken URLs.

Type:boolean

Default:false

Change monitor ID

monitorId

Optional

Persistent namespace for change tracking. Keep the same value for the same targets and filters. Use another value for an independent monitor or schedule.

Type:string

Default:default

Return only changes since

onlyChangesSince

Optional

Optional ISO 8601 timestamp such as 2026-08-01T00:00:00.000Z. When set, the dataset contains only records detected as new, updated, or removed since that time. The first run creates the baseline.

Type:string

Use Apify Proxy

useApifyProxy

Optional

Sitemaps are public XML and normally work without a proxy. Enable only as a network fallback if you encounter IP-based blocking.

Type:boolean

Default:false

Apify Proxy configuration

proxyConfiguration

Optional

Optional proxy configuration used only when useApifyProxy is enabled.

Type:object

Sitemap Detector

coder_zoro/sitemap-detector

Find sitemap URLs fast with our free Sitemap Finder tool. Instantly detect sitemaps from any website for SEO audits, indexing checks, and crawl planning. Improve visibility, site structure insights, and search engine performance in just seconds

Zoro

182

5.0

(3)

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Bikram Adhikari

Sitemap Generator

datawinder/sitemap-generator

Automatically crawl a website and generate an SEO-ready sitemap in XML, HTML, or TXT format. Supports crawl depth limits, URL include/exclude patterns, and optional merging with an existing sitemap.xml. Ideal for SEO audits, site migrations, and automation.

DatawinderLabs

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

XML Sitemap Finder & Extractor API

andok/find-sitemap-from-url

Find and extract all XML sitemaps for any domain. Automatically parses robots.txt, scans HTML tags, and recursively follows indexes. Perfect for SEO & web scraping.

Andok

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

278

Sitemap Generator - Creates sitemap.xml for any domain

wisteria_banjo/sitemap-generator---creates-sitemap-xml-for-any-domain

Generate a clean, standards-compliant sitemap.xml for a website. This actor crawls a single website, discovers all indexable pages, and produces: ✅ A ready-to-submit sitemap.xml (Google-compliant) ✅ A structured JSON dataset of discovered URLs (for auditing, reporting, and billing)

Chris Xavier

Sitemap Change Orchestrator

tri_angle/sitemap-change-orchestrator

Monitor website sitemaps for new, updated, or removed URLs. Integration with the Website Content Crawler (WCC) allows feeding only relevant URLs. This ensures your web crawls are efficient, targeted, and resource-optimized, keeping your datasets fresh for any application.

Tri⟁angle

XML Sitemap URL Extractor

andok/sitemap-extractor

Recursively crawl and extract every single URL from a website’s sitemap.xml. Automate your SEO audits and scraping queues.

Andok

Fast Sitemap Generator

eunit/sitemap-generator

Boost SEO with this automatic Sitemap Generator. Crawl any site to create XML, HTML, & TXT sitemaps. Supports custom depth, regex filters, & robots.txt. Compatible with Google Search Console.