Pricing

$0.20 / 1,000 urls

Try for free

Go to Apify Store

Sitemap URL Extractor - All URLs from Any Website's Sitemaps

Try for free

Get every URL a website publishes in its XML sitemaps, with lastmod, changefreq and priority. Finds sitemaps via robots.txt, follows sitemap indexes and gzipped sitemaps. Pay only per URL returned.

Pricing

$0.20 / 1,000 urls

Rating

0.0

(0)

Developer

Conor Wilson

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Configure MCP server with Sitemap URL Extractor - List All Website URLs

The configuration above connects to the hosted Apify MCP server with the Sitemap URL Extractor - List All Website URLs Actor already loaded. It uses OAuth, so your client opens a browser window to sign you in to Apify on first use. No API token is needed. Clients without OAuth support can authenticate with an Authorization: Bearer header carrying an API token from API & Integrations in Apify Console.

Get a ready-to-use configuration for your MCP client with the Sitemap URL Extractor - List All Website URLs Actor preconfigured at https://mcp.apify.com/?tools=fetch-actor-details,ennobling_spray/sitemap-urls.

You can connect to the Apify MCP Server using clients like Tester MCP Client, or any other MCP client of your choice.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

Sitemap Generator - Crawl Website & Create XML Sitemap

scrappy_garden/sitemap-generator

Generate an XML sitemap for any website. Crawls internal pages from start URLs (with depth + page limits), deduplicates URLs, and stores a ready-to-submit sitemap.xml plus a structured dataset and summary for SEO audits.

Bikram Adhikari

Sitemap Generator

datawinder/sitemap-generator

Automatically crawl a website and generate an SEO-ready sitemap in XML, HTML, or TXT format. Supports crawl depth limits, URL include/exclude patterns, and optional merging with an existing sitemap.xml. Ideal for SEO audits, site migrations, and automation.

DatawinderLabs

Sitemap Extractor

smorgi_apps/sitemap-extractor

Smorgi Apps

Sitemap URL Extractor — All Pages of Any Website

tidydata/sitemap-url-extractor

Extract every URL from any website's sitemap: finds sitemaps via robots.txt, follows sitemap indexes and .gz files, returns lastmod, priority and change frequency. $0.30 per 1,000 URLs.

tidydata

Bill 96 French-Parity Website Checker

master_invictus/bill96-french-parity-checker

Check that English pages have working French equivalents (Quebec Bill 96 / Charter of the French Language).

Frank Nagy

Website Traffic Checker - Bulk Domain Traffic Estimate

tenfoldfleet/website-traffic-checker

Check the website traffic of a list of domains: estimated monthly Google search traffic (organic and paid) and ranking keywords, plus optional traffic value and top 10 rankings. 1,000 domains per request, 94 countries. Not total visits. $4 per 1,000 domains + $0.025 per run; no data is free.

Tenfold Fleet

Sitemap URL Extractor

axiomworks/sitemap-url-extractor

Find and read website sitemaps, then return one dataset row per page URL with lastmod, priority, changefreq, image, video, news, and hreflang data. The Actor discovers sitemap locations from robots.txt, common paths, and homepage links, and follows sitemap indexes recursively.

Axiom Works

Robots.txt Tester — Is a URL Allowed to Crawl?

hipersoft/robots-txt-checker

Test whether URLs are allowed or blocked by a site's robots.txt for any crawler user-agent. Returns allowed/blocked, the matched rule, crawl-delay and the site's sitemaps. Great for SEO audits and crawler compliance. One row per URL as JSON, CSV or Excel.

hiper soft

Trivia Question Generator (Open Trivia DB)

smilemask/trivia-question-generator

Pull trivia questions with the correct answer and distractors, filterable by category (general knowledge, science, geography, history, entertainment and more), difficulty and question type. Free Open Trivia DB API, no key, CC BY-SA 4.0 licensed question data.