Under maintenance

Pricing

Pay per usage

Try for free

Go to Apify Store

Sitemap URL Extractor

Under maintenance

Try for free

Discover and parse XML sitemaps for any website. Returns every URL with lastmod, changefreq and priority. Handles sitemap indexes, gzipped and plain-text sitemaps.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Y A

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

What it does

🔍 Auto-discovers sitemaps from a bare domain via robots.txt and common well-known paths (/sitemap.xml, /sitemap_index.xml, WordPress /wp-sitemap.xml, and more).
🗂️ Follows sitemap indexes recursively — nested sitemaps are crawled automatically.
🗜️ Handles gzipped (.xml.gz) and plain-text sitemaps transparently.
🧹 De-duplicates URLs across multiple sitemaps.
⚡ HTTP-only and fast — no headless browser, so runs are cheap and quick.

Input

Field	Type	Description
`startUrls`	array	List of domains or sitemap URLs. Domains are auto-discovered; sitemap URLs are parsed directly.
`url`	string	Convenience field for a single target.
`maxUrls`	integer	Max URLs to return (0 = unlimited). Default `0`.
`includeSubSitemaps`	boolean	Recursively follow sitemap-index files. Default `true`.

Example input

{
    "startUrls": ["https://example.com"],
    "maxUrls": 0,
    "includeSubSitemaps": true
}

Output

Each dataset item is one URL:

{
    "url": "https://example.com/blog/hello-world",
    "lastmod": "2025-01-15",
    "changefreq": "weekly",
    "priority": "0.8",
    "sourceSitemap": "https://example.com/sitemap.xml"
}

You can export results as JSON, CSV, Excel, or via API directly from the run.

Pricing

This Actor is billed per result — you pay only for the URLs it actually extracts. No subscription, no minimum. Runs that find nothing cost nothing beyond the negligible start event.

Notes

The Actor respects standard sitemap conventions and identifies itself with a clear User-Agent.
If a site has no discoverable sitemap, the run completes cleanly with zero results.

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.

Nicolas van Arkens

Sitemap URL Extractor

crawlerbros/sitemap-url-extractor

Extract every URL from any site's sitemap.xml with handles sitemap index files (nested sitemaps), gzipped sitemaps, and robots.txt discovery. Returns URL, lastmod, changefreq, priority, and optional image/video/alternate-language fields. No proxy, no cookies, no login.

Crawler Bros

Sitemap URL Extractor

blazing_stake/sitemap-url-extractor

Extract every URL from any website's sitemap, including nested sitemap indexes (recursive). Auto-discovers sitemaps from robots.txt. Returns URLs with lastmod, changefreq, priority.

Mehmet Kut

Sitemap URL Extractor

wiry_kingdom/sitemap-url-extractor

Extract every URL from any website's sitemap.xml with lastmod, changefreq, priority. Recursively expands sitemap index files, reads robots.txt, handles gzipped sitemaps. SEO audits, content migration, site inventory, competitor research.

Mohieldin Mohamed

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

Sitemap Analyzer — Parse, Validate & Check URLs

accurate_pouch/sitemap-analyzer

Parse XML sitemaps, extract all URLs, validate structure (priority, changefreq, lastmod), optionally check HTTP status of every URL. Supports sitemap indexes.

Manchitt Sanan

Sitemap URL Extractor

seemuapps/sitemap-extractor

Extract every URL from a website's sitemap.xml. Recursively walks nested sitemap indexes and returns loc, lastmod, changefreq, and priority for each page.

Andrew

Sitemap Finder & URL Extractor · Crawl Any XML Sitemap

corent1robert/sitemap-detector

Find and crawl XML sitemaps from any website. Follows sitemap indexes, handles gzip, and exports every page URL with source file and lastmod into a clean dataset. No config needed.

Corentin Robert

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Extract URLs from XML sitemaps and robots.txt for SEO crawls, audits, content migrations, and RAG indexing. Auto-discovers sitemap files, parses nested sitemap indexes, and exports URL, lastmod, priority, changefreq, and image metadata in bulk.

Ava Torres

Sitemap URL Extractor: Every URL, Recursive

thoob/sitemap-extractor

Reads sitemap.xml, sitemap index files, .gz compressed sitemaps, and robots.txt Sitemap directives, and returns one clean row per URL with lastmod, changefreq, and priority. Billed only per delivered URL.

Pono Data