Pricing

Pay per usage

Sitemap URL Extractor & Filter

Extract, filter, and export URLs from sitemap.xml files for SEO audits, crawler seeding, RAG pipelines, and site intelligence.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Ralph T

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

What it does

Starts from one or more sitemap XML URLs.
Supports sitemap indexes and nested sitemap files.
Extracts page URLs plus lastmod, changefreq, and priority when present.
Applies include/exclude regex filters before export.
Deduplicates URLs.
Outputs a clean dataset view ready for CSV, JSON, or downstream Apify Actors.

Best for

Preparing URL lists for RAG crawlers.
Seeding Apify crawlers with filtered URLs.
SEO audits and site inventory checks.
Finding docs/blog/product URLs from large sites.
Competitive content monitoring.

Input example

{
  "sitemapUrls": ["https://docs.apify.com/sitemap.xml"],
  "includePatterns": ["^https://docs\\.apify\\.com/platform/actors"],
  "excludePatterns": ["/login", "/signup", "#"],
  "maxUrls": 1000,
  "maxSitemaps": 100,
  "sameDomainOnly": true
}

Output

Each dataset item is one filtered URL:

{
  "url": "https://docs.apify.com/platform/actors",
  "sitemapUrl": "https://docs.apify.com/sitemap.xml",
  "rootSitemapUrl": "https://docs.apify.com/sitemap.xml",
  "hostname": "docs.apify.com",
  "path": "/platform/actors",
  "lastmod": "2026-07-01T00:00:00.000Z",
  "changefreq": "weekly",
  "priority": 0.8,
  "discoveredAt": "2026-07-04T00:00:00.000Z"
}

Notes

Keep maxUrls low for first runs, inspect the output, then scale up.
For very large sitemap indexes, use include/exclude patterns to avoid exporting irrelevant URLs.
This Actor extracts URLs only; pair it with a crawler Actor when you need page content.

Sitemap to URL Crawler — Extract Sitemap.xml URLs

logiover/sitemap-to-url-crawler

Extract all URLs from any sitemap.xml recursively. Export sitemap URLs to CSV/JSON for RAG pipelines, SEO audits, and LLM training datasets.

Logiover

Sitemap URL Extractor

lnlenost/sitemap-url-extractor

Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.

Niccolò Salerno

Sitemap Crawler - XML Sitemap URL Extractor

miccho27/sitemap-crawler

Extract all URLs from XML sitemaps (including sitemap index) and optionally audit each page

Tatsuya Mizuno

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Extract URLs from XML sitemaps and robots.txt for SEO crawls, audits, content migrations, and RAG indexing. Auto-discovers sitemap files, parses nested sitemap indexes, and exports URL, lastmod, priority, changefreq, and image metadata in bulk.

Ava Torres

Sitemap Url Extractor

scrapers-hub/sitemap-url-extractor

Sitemap URL extractor to extract all URLs from XML sitemaps quickly and efficiently 🌐📄 Ideal for SEO audits, site analysis, and indexing workflows. Fast, accurate, and easy to use.

Scrapers Hub

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap URL Extractor

aetheragent/sitemap-extractor

Extract all URLs from any website's sitemap.xml. Parse robots.txt to find sitemap locations, follow sitemap indexes, and return a complete list of all discovered URLs. Essential for SEO audits, web crawlers, and site migration planning.

Grant Mitchell

XML Sitemap URL Extractor

andok/sitemap-extractor

Recursively crawl and extract every single URL from a website’s sitemap.xml. Automate your SEO audits and scraping queues.

Andok

Sitemap URl Extractor

scrapebridge/sitemap-url-extractor

🔎 Sitemap URL Extractor pulls URLs from any sitemap quickly and accurately. Export results for SEO audits, crawling, link building & content planning. 🚀 Automate discovery, enhance indexing, boost rankings.

Scrape Bridge

Sitemap Url Extractor

scrapevanta/sitemap-url-extractor

🔎 Sitemap URL Extractor extracts all URLs from sitemap XMLs fast and accurately. 📄 Extract, analyze, and verify website pages for SEO audits, link building, and crawling efficiency. 🚀 Perfect for marketers, developers, and data teams.