Pricing

Pay per usage

Try for free

Go to Apify Store

Sitemap Harvest Seo

Try for free

Turn any sitemap into a clean, deduplicated URL list. Follows indexes recursively, handles .xml.gz, include/exclude regex, query stripping, optional lastmod/priority. Ideal for SEO audits, Screaming Frog, RAG, and Zapier/n8n.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

A Man

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

Sitemap URL Harvester — Indexes, Gzip & Filters

Turn any sitemap into a clean, deduplicated URL list in seconds. Handles sitemap indexes, gzipped sitemaps, and regex filters so you can feed SEO audits, Screaming Frog, RAG pipelines, or Zapier without wrestling XML by hand.

What it solves

Client sitemap split across many index files — you need every product URL
Keep only /blog/ (or drop /checkout/) with one regex
.xml.gz or auto-gzip responses that break lighter tools

What you get

Feature	Benefit
Multi-sitemap input	One URL or twenty — indexes followed recursively
Gzip by magic bytes	Safe decompress even when `fetch` already inflated the body
Regex filtering	`includeRegex` / `excludeRegex`
Query stripping	Clean URLs for dedupe
Optional meta	`lastmod`, `priority`, `changefreq` when `includeMeta: true`
Partial failure safety	Bad child sitemap → error row; run continues

Sample output

{
  "url": "https://apify.com/actors",
  "sourceSitemapUrl": "https://apify.com/sitemap.xml",
  "index": 12,
  "lastmod": "2026-08-01",
  "priority": "0.8",
  "changefreq": "weekly"
}

Who it's for

SEO agencies building crawl lists
Content teams inventorying product or blog URLs
Automation builders feeding On-Page SEO Audit or RAG ingest

Example input

{
  "sitemapUrls": ["https://apify.com/sitemap.xml"],
  "maxUrls": 5000,
  "stripQueryParams": true,
  "includeMeta": true
}

Pricing (when monetised)

Event	When	Suggested
`url-harvested`	Each page URL written to the dataset	Start $0.0005–$0.001 / URL → hike after volume

Error rows are not charged.

Acceptable use (legal)

Only harvest sitemaps you are authorised to use (your property, client property, or public sitemaps published for crawlers).
Private / loopback / metadata hosts are blocked before fetch (SSRF guard).
Do not use harvested URL lists to attack, spam, or bypass access controls.

Local test

npm install && npm test
node src/main.mjs

Built by narrow_circle

XML Sitemap URL Extractor

devilscrapes/xml-sitemap-url-extractor

Turn any site's sitemap.xml, sitemap index, or robots.txt Sitemap directive into a clean URL dataset with loc, lastmod, changefreq and priority per row. Recursively expands sitemap indexes (bounded depth), follows redirects, and decompresses .xml.gz automatically.

DevilScrapes

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap URL Extractor

seemuapps/sitemap-extractor

Extract every URL from a website's sitemap.xml. Recursively walks nested sitemap indexes and returns loc, lastmod, changefreq, and priority for each page.

Andrew

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Parse XML website sitemaps and extract URLs for SEO crawls, audits, migrations, and RAG indexing. Auto-discovers sitemap files from robots.txt, follows nested indexes, and exports URL, lastmod, priority, changefreq, and image metadata.

Ava Torres

Sitemap Extractor — Expand XML Sitemaps to URL Lists

omao/sitemap-extractor

Fetch any XML sitemap (or a domain) and get a clean list of all its URLs with lastmod, changefreq and priority. Follows sitemap indexes and gzipped sitemaps. Great for SEO and crawling.

Marouane Oulabass

Sitemap to URL Crawler — Extract Sitemap.xml URLs

logiover/sitemap-to-url-crawler

Extract all URLs from any sitemap.xml recursively. Export sitemap URLs to CSV/JSON for RAG pipelines, SEO audits, and LLM training datasets.

Logiover

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap Parser

blaspat/sitemap-parser

Parse any XML sitemap — extract all URLs with last modified dates, change frequency, and priority. Handles sitemap indexes recursively. Perfect for SEO auditing, migration planning, and content monitoring

Blasius Patrick

Sitemap Extractor — Recursive Crawl with lastmod & Priority

axery/sitemap-extractor

Recursively crawl any sitemap.xml or sitemap index into a flat list of URLs with lastmod, changefreq and priority — the fastest way to enumerate a site's pages.