Pricing

$1.00 / 1,000 results

Try for free

Go to Apify Store

Sitemap URL Extractor

Try for free

Give a website or sitemap URL; get every URL its sitemaps list, one row each, with lastmod, changefreq, priority and source sitemap. Finds sitemaps via robots.txt, follows indexes, reads .xml.gz and text. $1 per 1,000 URLs.

Pricing

$1.00 / 1,000 results

Rating

0.0

(0)

Developer

Jesse Hawkins

Actor stats

Bookmarked

Total users

Monthly active users

13 days ago

Last modified

Sitemap URL Extractor: every URL from a website's sitemaps API through CLI

The Apify CLI is the official tool that allows you to use Sitemap URL Extractor locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Sitemap URL Extractor API in Python

Sitemap URL Extractor API in JavaScript

Sitemap URL Extractor OpenAPI definition

Sitemap URL Extractor API

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Apify

414

3.2

(8)

XML Sitemap Finder & Extractor API

andok/find-sitemap-from-url

Find and extract all XML sitemaps for any domain. Automatically parses robots.txt, scans HTML tags, and recursively follows indexes. Perfect for SEO & web scraping.

Andok

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

Sitemap Generator

alizarin_refrigerator-owner/sitemap-generator

Generate XML sitemaps by crawling any website. Discover all pages, images, & videos with configurable crawl depth, URL filters, & multiple output formats. Full Site Crawling ,Image Sitemap, Video Sitemap, Multiple Output Formats, URL Filtering, Configurable Depth, Last Modified, Webhook Integration

The Howlers

Sitemap URL Harvester

mahogany_songbird/sitemap-url-harvester

Collect URLs from XML sitemaps for SEO and crawling.

Britton Furness

Sitemap to URL List Extractor

scrapeworks/sitemap-to-urls

Extract every URL from any website's sitemap as clean JSON. Handles sitemap indexes (recursive) and gzipped sitemaps automatically. Includes lastmod, priority, and changefreq.

Nicolas van Arkens

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.

Neo B

Sitemap URL Extractor

sootesting/sitemap-url-extractor

Extract URLs from XML sitemaps in bulk. Supports sitemap indexes, auto-discovers nested sitemaps, and outputs structured JSON. Pay-per-event: per 1,000 URLs extracted.

soot

Sitemap Extractor

smorgi_apps/sitemap-extractor

Smorgi Apps

Sitemap & URL Extractor

autoloom/sitemap-url-extractor

Find a website's sitemaps (from robots.txt or common paths), extract every URL with its lastmod, changefreq and priority, follow nested sitemap indexes, and optionally check each URL's live status and redirects. Falls back to the homepage's internal links when there's no sitemap.