Pricing

from $0.30 / 1,000 urls

Try for free

Go to Apify Store

Sitemap URL Extractor: All Pages from robots.txt & Sitemaps

Try for free

Extract every URL a website publishes in its XML sitemaps: robots.txt discovery, nested indexes, gzip, hreflang, images, news. Fast and cheap — no browser. $0.30 per 1,000 URLs.

Pricing

from $0.30 / 1,000 urls

Rating

0.0

(0)

Developer

Andrew Shamah

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

Configure MCP server with Sitemap URL Extractor | All Pages from XML Sitemaps

Add the configuration above to your project's .mcp.json file for Claude Code, then run /mcp in Claude Code to sign in to Apify. It connects to the hosted Apify MCP server with the Sitemap URL Extractor | All Pages from XML Sitemaps Actor already loaded. Clients without OAuth support can authenticate with an Authorization: Bearer header carrying an API token from API & Integrations in Apify Console.

For other MCP clients, get a client-specific configuration with the Sitemap URL Extractor | All Pages from XML Sitemaps Actor preconfigured at https://mcp.apify.com/?tools=fetch-actor-details,dataforgehq/sitemap-urls.

You can connect to the Apify MCP server using an MCP client that supports Streamable HTTP.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap URL Extractor — All Page URLs from a Website

power_on/sitemap-url-list

Input: domains or sitemap URLs. Output: one row per page URL with its lastmod, changefreq and priority, plus a report row per sitemap file read. Finds sitemaps via robots.txt, follows nested indexes, unpacks gzip. Filter by URL pattern or by date. Hard cap of 25,000 URLs per run.

Power On Labs

Sitemap URL Harvester

mahogany_songbird/sitemap-url-harvester

Collect URLs from XML sitemaps for SEO and crawling.

Britton Furness

Sitemap URL Extractor — Robots.txt & Sitemap.xml Parser

tarnlight/sitemap-url-extractor

Extracts the URLs a website lists in its XML sitemaps (sitemap indexes, gzip and text sitemaps, robots.txt discovery), up to your Max URLs cap, with filters and a clear per-site report.

Tarnlight

Sitemap Extractor – All URLs from sitemap.xml + Status Check

gazidev/sitemap-url-extractor

Extract every URL from any website's sitemap.xml: auto-discovery via robots.txt, nested sitemap indexes, .xml.gz, image/news/video/hreflang tags and lastmod. Filter by date or glob, get only new URLs, and optionally check HTTP status, redirects and canonical per URL.

Cemal Atakli

Sitemap URL Extractor

sootesting/sitemap-url-extractor

Extract URLs from XML sitemaps in bulk. Supports sitemap indexes, auto-discovers nested sitemaps, and outputs structured JSON. Pay-per-event: per 1,000 URLs extracted.

soot

Sitemap URL Extractor - XML Sitemap Scraper

benthepythondev/sitemap-url-extractor

Extract URLs from XML sitemaps and sitemap indexes. Get URL, lastmod, changefreq, priority and source sitemap.

Ben

Sitemap URL Finder

thescrapelab/sitemap-target-url-extractor

Find useful URLs from robots.txt and sitemaps, then output deduplicated URL inventory rows with source sitemap, domain, path, filter, and crawl summary data for SEO and scraping workflows.

Inus Grobler

Sitemap URL Extractor

appreciative_duct/sitemap-url-extractor

Extract all URLs from website sitemaps. Finds sitemaps in robots.txt, follows sitemap indexes, and reads gzip, news, image, and video sitemaps.

Ross AI

Sitemap URL Extractor

sampon/sitemap-url-extractor

List every URL a website publishes in its XML sitemaps, found automatically through robots.txt. Filter by text or lastmod date, or get only the URLs added since your last run.