Sitemap extractor: list every URL in an XML sitemap

Created by

Detroit Web Agent - Open Data

Actor

Sitemap Extractor & Broken Link Checker: All URLs, $1/1k

Find every sitemap for a domain (robots.txt, nested indexes, .gz, .txt, common paths) and return all URLs with lastmod, priority, images, hreflang, path groups and duplicates. Optional broken-link, redirect, noindex checks. Partial results never fail the run. $0.001 per sitemap file / link checked.

Try for free

Sitemap Extractor & Broken Link Checker: All URLs, $1/1ktransparent_meteorite/sitemap-link-inventory

URL

Last modified

Priority

Change freq

+11 fields

Input

Domains or sitemap URLs(required):https://crawlee.dev

Max URLs per site:50

Link check mode:off

Max sitemap files per site:3

Output fields

URL

Last modified

Priority

Change freq

Path group

Source sitemap

Flags

HTTP

Redirects

Days since lastmod

Extension

HTTPS

URL length

Slug

How it works

Sign up on Apify or log in

The Sitemap Extractor & Broken Link Checker: All URLs, $1/1k Actor is ready to run with the inputs already set for "Sitemap extractor: list every URL in an XML sitemap". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Sitemap extractor: list every URL in an XML sitemap" task

The Sitemap Extractor & Broken Link Checker: All URLs, $1/1k Actor will start running based on the input automatically. You can also change all the input fields, like domains or sitemap urls, max urls per site, and more, to match your specific use case.

Receive the "Sitemap extractor: list every URL in an XML sitemap" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as URL, last modified, priority, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Sitemap extractor: list every URL in an XML sitemap" task via API.