Pricing

$0.50 / 1,000 url extracteds

XML Sitemap Scraper & URL Extractor API - SEO Crawler

Extract URLs from XML sitemaps and robots.txt for SEO crawls, audits, content migrations, and RAG indexing. Auto-discovers sitemap files, parses nested sitemap indexes, and exports URL, lastmod, priority, changefreq, and image metadata in bulk.

Pricing

$0.50 / 1,000 url extracteds

Rating

0.0

(0)

Developer

Ava Torres

Actor stats

Bookmarked

Total users

Monthly active users

20 days ago

Last modified

Sitemap URL Extractor & Parser

Extract all URLs from XML sitemaps with automatic discovery, nested sitemap index support, and rich metadata. Perfect for SEO audits, content migration, competitive analysis, and website monitoring.

What it does

Give it any website URL or sitemap.xml link, and it returns every URL listed in the sitemap along with metadata like last modification date, change frequency, and priority.

Key features:

Auto-discovery -- Finds sitemaps automatically by checking robots.txt and common paths
Nested sitemap support -- Handles sitemap index files that reference multiple sub-sitemaps
Rich metadata -- Extracts lastmod, changefreq, priority, and image data
Date filtering -- Only include URLs modified after a specific date
Bulk processing -- Process multiple websites in a single run
No API key needed -- Works out of the box

Input

Field	Description	Default
urls	Website or sitemap.xml URLs to extract	Required
autoDiscover	Auto-find sitemaps from robots.txt	true
maxResults	Maximum URLs to extract	1000
modifiedSince	Only URLs modified after this date (YYYY-MM-DD)	(all)
includeImages	Include image metadata from sitemaps	false

Output

Each result contains:

{
  "url": "https://example.com/page",
  "sitemapSource": "https://example.com/sitemap.xml",
  "lastModified": "2026-04-01",
  "changeFreq": "weekly",
  "priority": "0.8",
  "images": []
}

Use cases

SEO Audit -- Get a complete list of indexed pages with their metadata
Content Migration -- Map all URLs before migrating to a new platform
Competitive Analysis -- See what pages competitors have and how often they update
Website Monitoring -- Track new pages added since a specific date
Link Building -- Find all pages on a target site to identify link opportunities
Content Inventory -- Catalog all pages with their update frequency and priority

Pricing

$0.50 per 1,000 URLs extracted. No API key or external service required.

Sitemap URL Extractor

crawlerbros/sitemap-url-extractor

Extract every URL from any site's sitemap.xml with handles sitemap index files (nested sitemaps), gzipped sitemaps, and robots.txt discovery. Returns URL, lastmod, changefreq, priority, and optional image/video/alternate-language fields. No proxy, no cookies, no login.

Crawler Bros

Sitemap URL Extractor

wiry_kingdom/sitemap-url-extractor

Extract every URL from any website's sitemap.xml with lastmod, changefreq, priority. Recursively expands sitemap index files, reads robots.txt, handles gzipped sitemaps. SEO audits, content migration, site inventory, competitor research.

Mohieldin Mohamed

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

Sitemap URL Extractor

seemuapps/sitemap-extractor

Extract every URL from a website's sitemap.xml. Recursively walks nested sitemap indexes and returns loc, lastmod, changefreq, and priority for each page.

Andrew

Sitemap URL Discovery (sitemap.xml + robots.txt → all URLs)

gochujang/sitemap-url-discovery

Given a domain, finds sitemap.xml / sitemap_index.xml (also via robots.txt), recursively expands sitemap indexes, returns one row per discovered URL with lastmod / changefreq / priority. SEO audits, crawl-target prep, content cataloging. $0.0001/URL + $0.01 site fee.

Hojun Lee

Sitemap URL Extractor: Every URL, Recursive

thoob/sitemap-extractor

Reads sitemap.xml, sitemap index files, .gz compressed sitemaps, and robots.txt Sitemap directives, and returns one clean row per URL with lastmod, changefreq, and priority. Billed only per delivered URL.

Pono Data

Sitemap URL Extractor — robots.txt + sitemap.xml Crawl

v0iddo/sitemap-url-extractor

Discover every URL a site exposes via its public sitemap chain. Reads robots.txt, follows Sitemap declarations, recursively descends sitemap-index files, extracts URLs with lastmod, changefreq, priority.

vøiddo

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.

Nicolas van Arkens

Sitemap to URL Crawler — Extract Sitemap.xml URLs

logiover/sitemap-to-url-crawler

Extract all URLs from any sitemap.xml recursively. Export sitemap URLs to CSV/JSON for RAG pipelines, SEO audits, and LLM training datasets.

Logiover

Sitemap URL Extractor

mikolabs/sitemap-url-extractor

Extract every URL and its metadata from any sitemap.xml in seconds. Paste one or more sitemap URLs, run the Actor, and get a clean, structured dataset with url, lastmod, changefreq, priority, and more — ready to export as CSV, JSON, or Excel.