Pricing

$0.10 / 1,000 sitemap url records

Try for free

Go to Apify Store

Sitemap to AI/RAG URL Feed

Try for free

Turn public XML sitemaps into structured URL feeds for AI agents, RAG ingestion, crawlers, and indexing workflows.

Pricing

$0.10 / 1,000 sitemap url records

Rating

0.0

(0)

Developer

HAVIO AI

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

What it does

accepts urlset and sitemapindex
follows child sitemaps recursively
deduplicates discovered URLs
preserves lastmod, changefreq, and priority
records source sitemap and recursion depth
marks public HTTP/HTTPS page URLs as AI crawl candidates
rejects localhost, private IPs, local hostnames, credential-bearing URLs, and DNS targets resolving to non-public addresses
caps body size, recursion depth, and result count

Input

{
  "sitemapUrls": ["https://chirpy.cotes.page/sitemap.xml"],
  "recursive": true,
  "maxDepth": 2,
  "maxResults": 10000
}

Output

Each discovered URL becomes one dataset item with fields such as:

url
lastmod
changefreq
priority
source_sitemap
parent_sitemap
depth
ai_crawl_candidate

Failed sitemap fetches are returned as non-billed diagnostic rows.

Good for

RAG crawl-seed generation
AI agent website discovery
sitemap auditing and URL inventory
indexing pipelines
crawler input preparation
change-monitoring workflows

This Actor is deterministic and does not use an LLM.

XML Sitemap Scraper & URL Extractor API - SEO Crawler

pink_comic/sitemap-url-extractor

Parse XML website sitemaps and extract URLs for SEO crawls, audits, migrations, and RAG indexing. Auto-discovers sitemap files from robots.txt, follows nested indexes, and exports URL, lastmod, priority, changefreq, and image metadata.

Ava Torres

Sitemap URL Finder

thescrapelab/sitemap-target-url-extractor

Find useful URLs from robots.txt and sitemaps, then output deduplicated URL inventory rows with source sitemap, domain, path, filter, and crawl summary data for SEO and scraping workflows.

Inus Grobler

Sitemap URL Harvester

mahogany_songbird/sitemap-url-harvester

Collect URLs from XML sitemaps for SEO and crawling.

Britton Furness

Site to Agent Feed (URL to RAG-ready Markdown)

constant_quadruped/site-to-agent-feed

Turn any URL into clean, RAG-ready Markdown + structured JSON for LLMs and AI agents. Self-healing main-content extraction (survives redesigns), headings/links/tables, optional change-detection. No paid APIs.

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

278

Sitemap Extractor - Hardened URL Inventory

8tp/sitemap-url-extractor-coverage-api

Extract URL inventories from public HTTPS sitemap XML and gzip files with robots.txt discovery, bounded index traversal, and machine-readable coverage receipts. No page crawling, login, browser, proxy, or private-network access.

Hunter M.

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap URL Exporter — Nested Sitemaps & Robots Discovery

gertner-data/sitemap-url-exporter

Export up to 3,000 deduplicated URLs per website from robots.txt and nested XML sitemaps, with lastmod and source sitemap. Feed crawlers, migrations and ETL from one JSON report. Launch price: $1/1,000 website reports; all exported URLs included.

Евгений Гертнер

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser — fast and cheap.

Walid

Sitemap URL Extractor

receptional_blender/sitemap-url-extractor

Give it any website or sitemap URL and get back every page URL. It reads robots.txt and sitemap.xml, follows nested sitemap indexes, and returns each URL with its last-modified date, change frequency and priority as clean JSON. No key, login or proxy required.