Pricing

from $0.25 / 1,000 url results

Try for free

Go to Apify Store

Sitemap URL Extractor & Filter

Try for free

Extract, filter, and export URLs from sitemap.xml files for SEO audits, crawler seeding, RAG pipelines, and site intelligence.

Pricing

from $0.25 / 1,000 url results

Rating

0.0

(0)

Developer

Ralph T

Actor stats

Bookmarked

Total users

Monthly active users

4 months ago

Last modified

What it does

Starts from one or more sitemap XML URLs.
Supports sitemap indexes and nested sitemap files.
Extracts page URLs plus lastmod, changefreq, and priority when present.
Applies include/exclude regex filters before export.
Deduplicates URLs.
Outputs a clean dataset view ready for CSV, JSON, or downstream Apify Actors.

Best for

Preparing URL lists for RAG crawlers.
Seeding Apify crawlers with filtered URLs.
SEO audits and site inventory checks.
Finding docs/blog/product URLs from large sites.
Competitive content monitoring.

Input example

{
  "sitemapUrls": ["https://docs.apify.com/sitemap.xml"],
  "includePatterns": ["^https://docs\\.apify\\.com/platform/actors"],
  "excludePatterns": ["/login", "/signup", "#"],
  "maxUrls": 1000,
  "maxSitemaps": 100,
  "sameDomainOnly": true
}

Output

Each dataset item is one filtered URL:

{
  "url": "https://docs.apify.com/platform/actors",
  "sitemapUrl": "https://docs.apify.com/sitemap.xml",
  "rootSitemapUrl": "https://docs.apify.com/sitemap.xml",
  "hostname": "docs.apify.com",
  "path": "/platform/actors",
  "lastmod": "2026-07-01T00:00:00.000Z",
  "changefreq": "weekly",
  "priority": 0.8,
  "discoveredAt": "2026-07-04T00:00:00.000Z"
}

Notes

Keep maxUrls low for first runs, inspect the output, then scale up.
For very large sitemap indexes, use include/exclude patterns to avoid exporting irrelevant URLs.
This Actor extracts URLs only; pair it with a crawler Actor when you need page content.

XML Sitemap URL Extractor

andok/sitemap-extractor

Recursively crawl and extract every single URL from a website’s sitemap.xml. Automate your SEO audits and scraping queues.

Andok

Sitemap Detector

coder_zoro/sitemap-detector

Find sitemap URLs fast with our free Sitemap Finder tool. Instantly detect sitemaps from any website for SEO audits, indexing checks, and crawl planning. Improve visibility, site structure insights, and search engine performance in just seconds

Zoro

182

5.0

(3)

Sitemap & URL Extractor — Get Every URL of a Website

dataquarry/sitemap-url-extractor

Get every URL of a website: parses sitemap.xml and sitemap-indexes (discovered via robots.txt or the default location), with a same-site crawl fallback when there's no sitemap. Returns each URL + lastmod. No API key.

Daniel Brenner

Sitemap URL Extractor

mikolabs/sitemap-url-extractor

Extract every URL and its metadata from any sitemap.xml in seconds. Paste one or more sitemap URLs, run the Actor, and get a clean, structured dataset with url, lastmod, changefreq, priority, and more — ready to export as CSV, JSON, or Excel.

Mikolabs

Website URL Extractor - Get All Site URLs

lofomachines/urls-extractor

Extract every URL from any website automatically — no code needed. This URL extractor crawls pages and parses XML sitemaps into one structured list with metadata (lastmod, priority, changefreq). Filter by keyword, cap results, and export to JSON, CSV, or Excel. Built for SEO audits & migrations.

Lofomachines

240

5.0

(1)

Sitemap URL Extractor — recursive, filters, .gz

x402opklaar/sitemap-url-extractor

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Opklaar

XML Sitemap URL Extractor & Checker

scrapesignal_labs/sitemap-url-extractor

Extract URLs from XML sitemaps, sitemap indexes, robots.txt, and gzip files. Filter pages and optionally check HTTP status codes for SEO audits.

ScrapeSignal Labs

Sitemap URL Extractor — Robots.txt & Sitemap.xml Parser

tarnlight/sitemap-url-extractor

Extracts the URLs a website lists in its XML sitemaps (sitemap indexes, gzip and text sitemaps, robots.txt discovery), up to your Max URLs cap, with filters and a clear per-site report.

Tarnlight

Sitemap Extractor – All URLs from sitemap.xml + Status Check

gazidev/sitemap-url-extractor

Extract every URL from any website's sitemap.xml: auto-discovery via robots.txt, nested sitemap indexes, .xml.gz, image/news/video/hreflang tags and lastmod. Filter by date or glob, get only new URLs, and optionally check HTTP status, redirects and canonical per URL.

Cemal Atakli

Sitemap Generator - Creates sitemap.xml for any domain

wisteria_banjo/sitemap-generator---creates-sitemap-xml-for-any-domain

Generate a clean, standards-compliant sitemap.xml for a website. This actor crawls a single website, discovers all indexable pages, and produces: ✅ A ready-to-submit sitemap.xml (Google-compliant) ✅ A structured JSON dataset of discovered URLs (for auditing, reporting, and billing)