Pricing

from $0.10 / 1,000 delivered sitemap urls

Try for free

Go to Apify Store

Sitemap Extractor & URL Change Monitor

Try for free

Extract every URL from XML, gzip, text and nested sitemaps, with robots.txt discovery. Compare repeat checks for added URLs, publisher lastmod updates and confirmed removals. An incomplete sitemap tree never produces false removals. Export for SEO audits and incremental crawlers.

Pricing

from $0.10 / 1,000 delivered sitemap urls

Rating

0.0

(0)

Developer

Vadim Bezrukov

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

SEO tools

Automation

Developer tools

Websites or sitemaps

sites

Required

One to 100 root websites, robots.txt URLs, direct sitemap files, sitemap indexes, .xml.gz files, or text sitemaps. externalId is echoed for downstream joins.

Type:object[]

Min. items:1

Max. items:100

Mode

mode

Optional

snapshot extracts the current inventory without state. monitor compares only complete successful inventories in Apify KVS.

Type:string

Default:snapshot

Options:

snapshotmonitor

Output mode

outputMode

Optional

changesOnly emits URL rows only for real changes; the first baseline and unchanged runs still return one site_summary. Snapshot mode always returns extracted URLs.

Type:string

Default:all

Options:

changesOnlyall

Discover from robots.txt

discoverFromRobots

Optional

For root websites, read every Sitemap: declaration first. If none exist, try /sitemap.xml. Direct sitemap and robots.txt inputs are always respected.

Type:boolean

Default:true

Check emitted page status

checkPageStatus

Optional

Optional lightweight checks for emitted current URL rows only. Disabled by default: extracting a million URLs must not make a million page requests.

Type:boolean

Default:false

Include URL glob patterns

includePatterns

Optional

Optional case-sensitive glob patterns such as :///blog/* or product. Empty means include every sitemap URL. Pattern changes use a separate monitor state namespace.

Type:string[]

Max. items:100

Default:

[]

Exclude URL glob patterns

excludePatterns

Optional

Optional case-sensitive glob patterns such as /tag/ or ?preview=. Exclusions run after includes.

Type:string[]

Max. items:100

Default:

[]

XML Sitemap URL Extractor & Checker

scrapesignal_labs/sitemap-url-extractor

Extract URLs from XML sitemaps, sitemap indexes, robots.txt, and gzip files. Filter pages and optionally check HTTP status codes for SEO audits.

ScrapeSignal Labs

Sitemap URL Extractor

lnlenost/sitemap-url-extractor

Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.

Niccolò Salerno

Sitemap URL Extractor

leorochasantos/sitemap-extractor

Extract every URL from any XML sitemap — support sitemap indexes, gzip, robots.txt discovery, and metadata extraction. Returns clean structured output: one URL per row.

Leonardo Santos

Sitemap URL Extractor — Get All URLs From Any Website

q_services/sitemap-url-extractor

Extract every URL from any website's XML sitemaps. Handles sitemap indexes, robots.txt discovery, URL filtering. Great for SEO audits.

Q Services

Sitemap URL Extractor: robots.txt, gzip, Changes

succinct_glider/sitemap-urls

Extract every URL from a website's XML sitemaps: found through robots.txt, sitemap indexes and .gz files followed, lastmod and date filters, URL patterns, and new, changed or removed URLs since your last run. Reads sitemap files only, never the pages.

Alexandre Bobichon

Sitemap Extractor: Website → All URLs (sitemap.xml parser)

boxbox10/sitemap-extractor

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Marvin Eguilos

Sitemap URL Extractor

crawlerbros/sitemap-url-extractor

Extract every URL from any site's sitemap.xml with handles sitemap index files (nested sitemaps), gzipped sitemaps, and robots.txt discovery. Returns URL, lastmod, changefreq, priority, and optional image/video/alternate-language fields. No proxy, no cookies, no login.

Crawler Bros

5.0

Sitemap Extractor: Every URL from XML Sitemaps to JSON

stive.wg/sitemap-extractor

Extract every URL from XML sitemaps and sitemap indexes: url, lastmod, changefreq, priority and source sitemap. Handles nested indexes, gzip and plain text formats. Up to 20 roots and 50,000 URLs per run. Clean JSON for SEO audits, migrations and crawl planning. Missing fields are null.

Stive Hassan

Sitemap URL Exporter — Nested Sitemaps & Robots Discovery

gertner-data/sitemap-url-exporter

Export up to 3,000 deduplicated URLs per website from robots.txt and nested XML sitemaps, with lastmod and source sitemap. Feed crawlers, migrations and ETL from one JSON report. Launch price: $1/1,000 website reports; all exported URLs included.