Pricing

from $20.00 / 1,000 site checks

Try for free

Go to Apify Store

Sitemap Monitor & Integrity Auditor

Try for free

Audit sitemap infrastructure and conservatively monitor URL inventory changes without crawling pages by default.

Pricing

from $20.00 / 1,000 site checks

Rating

0.0

(0)

Developer

VinceSoft

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

Categories

Sites

sites

Required

One to 100 public website, robots.txt, or sitemap URLs.

Type:object[]

Min. items:1

Max. items:100

Default:

[
  {
    "url": "https://www.djangoproject.com/sitemap.xml",
    "externalId": "automatic-check"
  }
]

Mode

mode

Optional

Snapshot extracts current state; monitor compares successful runs.

Type:string

Default:snapshot

Options:

snapshotmonitor

Output mode

outputMode

Optional

Return every URL or changes only.

Type:string

Default:all

Options:

allchangesOnly

Discover from robots.txt

discoverFromRobots

Optional

Read Sitemap directives before falling back to /sitemap.xml.

Type:boolean

Default:true

Include URL patterns

includePatterns

Optional

Optional case-sensitive wildcard patterns.

Type:string[]

Default:

[]

Exclude URL patterns

excludePatterns

Optional

Case-sensitive wildcard patterns removed from inventory and monitoring state.

Type:string[]

Default:

[]

Check page HTTP status

checkPageStatus

Optional

Disabled by default because it greatly increases requests.

Type:boolean

Default:false

Page check mode

pageCheckMode

Optional

Choose which sitemap URLs receive a lightweight HEAD/GET status check.

Type:string

Default:none

Options:

nonechangedOnlyall

Maximum sitemap depth

maxSitemapDepth

Optional

Maximum recursive index depth, capped at 8.

Type:integer

Minimum:0

Maximum:8

Default:8

Maximum sitemap files

maxSitemapFiles

Optional

Safety limit per site, capped at 10,000.

Type:integer

Minimum:1

Maximum:10000

Default:10000

Maximum URLs

maxUrls

Optional

Safety limit per site, capped at 5,000,000.

Type:integer

Minimum:1

Maximum:5000000

Default:5000000

Request timeout (seconds)

requestTimeoutSecs

Optional

Per-request timeout, capped at 120 seconds.

Type:integer

Minimum:1

Maximum:120

Default:30

Maximum request retries

maxRequestRetries

Optional

Retries for temporary HTTP and network failures.

Type:integer

Minimum:0

Maximum:5

Default:3

Confirm removals after runs

confirmRemovalsAfterRuns

Optional

Number of consecutive successful missing observations before confirmation.

Type:integer

Minimum:1

Maximum:10

Default:2

Sitemap API

vivid_astronaut/sitemap

BRAINIALL Team

Sitemap Freshness Auditor

frank_conifer_af4/sitemap-freshness-auditor

Audit sitemap URLs, lastmod dates, stale content signals, index coverage, and sitemap health.

Juddroid

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

276

Sitemap Robots Delta Monitor

tom_the_builder/sitemap-robots-delta-monitor

Monitor sitemap.xml and robots.txt for URL inventory changes and return new, changed, or removed URLs in normalized JSON.

Danil Iarmolchik

Sitemap Extractor & URL Change Monitor

automa-flow/sitemap-extractor-monitor

Sitemap extractor API for complete XML, gzip, text and nested sitemap inventories. Export normalized URLs or monitor new, publisher-lastmod-changed and conservatively confirmed removed URLs. Failed or partial trees never manufacture mass removals.

Vadim Bezrukov

Sitemap URL Extractor — XML Sitemap & robots.txt

accountable_eel/sitemap-url-discovery

Discover every URL a website's own XML sitemap declares, starting from robots.txt's Sitemap: directive and following sitemap indexes automatically. No key, no page crawling — charged only when a working sitemap is found.

Adrian Voss

Sitemap Extractor

smorgi_apps/sitemap-extractor

Smorgi Apps

Sitemap Sniffer

maximedupre/sitemap-sniffer

Find sitemap files from website roots, domains, robots.txt, and direct sitemap URLs. Export sitemap metadata, URL counts, nested index depth, and optional URL inventory rows.