Pricing

$1.00 / 1,000 sitemap file fetcheds

Sitemap URL Extractor — recursive, filters, .gz

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Pricing

$1.00 / 1,000 sitemap file fetcheds

Rating

0.0

(0)

Developer

Opklaar

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Input

{
    "sitemapUrls": ["https://example.com"],
    "includePatterns": ["/blog/"],
    "excludePatterns": ["/tag/", "/page/"],
    "maxUrls": 100000
}

Output (one dataset item per URL)

{
    "url": "https://example.com/blog/hello-world",
    "lastmod": "2026-07-14",
    "changefreq": "weekly",
    "priority": "0.8",
    "sitemap": "https://example.com/sitemap-posts.xml"
}

Export as JSON, CSV, or Excel straight from the dataset tab, or fetch via API.

Pricing

Pay per event — sitemap-fetched, charged once per sitemap file successfully fetched and parsed (an index file and each nested sitemap count once each). A sitemap that fails to download or parse is free. There are no per-URL charges: a 50,000-URL sitemap in one file costs one event.

Common uses

Seed list for any crawler or scraper (pairs well with an article extractor for full-content pipelines)
SEO: find URLs missing from a sitemap, compare lastmod freshness, inventory a competitor's content structure
Migration QA: diff URL lists before/after a relaunch

Works with AI agents

Exposed through Apify's MCP server — an AI agent can ask "list every blog URL on example.com" and get structured JSON back in seconds.

FAQ

What if the site has no sitemap? Auto-discovery checks robots.txt plus common paths (/sitemap.xml, /wp-sitemap.xml, …). If nothing is found, the run tells you — and costs nothing.

Does it respect huge sitemap indexes? Yes — nested sitemaps are queued breadth-first with a 500-file safety cap and your maxUrls limit.

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.

Nicolas van Arkens

Sitemap URL Extractor: Every URL, Recursive

thoob/sitemap-extractor

Reads sitemap.xml, sitemap index files, .gz compressed sitemaps, and robots.txt Sitemap directives, and returns one clean row per URL with lastmod, changefreq, and priority. Runs without a proxy. Billed only per delivered URL.

Pono Data

Sitemap Url Extractor

scrapevanta/sitemap-url-extractor

Extracts every URL from a sitemap or sitemap index, auto-discovers sitemaps from robots.txt, handles gzipped sitemaps, filters by URL pattern and last-modified date, and reports site structure and content freshness analytics.

ScrapeVanta

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Sitemap URL Extractor

crawlerbros/sitemap-url-extractor

Extract every URL from any site's sitemap.xml with handles sitemap index files (nested sitemaps), gzipped sitemaps, and robots.txt discovery. Returns URL, lastmod, changefreq, priority, and optional image/video/alternate-language fields. No proxy, no cookies, no login.

Crawler Bros

5.0

Sitemap URL Extractor — Priced per Sitemap, Not per URL

eliai/sitemap-url-extractor

Extract every URL from sitemap.xml, sitemap indexes (recursive), or a bare domain via robots.txt. Returns loc, lastmod, changefreq, priority. Priced per FILE, not per URL: $0.005 per sitemap parsed plus $0.015 per 1,000 URLs, so a 5,000-URL sitemap costs $0.08. Failures never charged.

Anthony Snider

Sitemap URL Extractor

leorochasantos/sitemap-extractor

Extract every URL from any XML sitemap — support sitemap indexes, gzip, robots.txt discovery, and metadata extraction. Returns clean structured output: one URL per row.

Leonardo Santos

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap URL Extractor — robots.txt + sitemap.xml Crawl

v0iddo/sitemap-url-extractor

Discover every URL a site exposes via its public sitemap chain. Reads robots.txt, follows Sitemap declarations, recursively descends sitemap-index files, extracts URLs with lastmod, changefreq, priority.