Pricing

Pay per usage

Sitemap URL Delta Monitor

Monitor public sitemap.xml files for new URLs, removed URLs, lastmod changes, and clean stateful deltas for SEO, RAG indexing, and content operations.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Nikita S

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Automation

Sitemap URLs (or root domains if discoverSitemaps is true)

sitemapUrls

Required

Public sitemap.xml or sitemap index URLs. When discoverSitemaps is enabled, root domains (e.g. https://example.com) are also accepted — the actor will fetch /robots.txt and enqueue Sitemap entries from it.

Type:array

Discover sitemaps from robots.txt

discoverSitemaps

Optional

If true, fetch each start URL's robots.txt and enqueue any Sitemap entries found there. Only works on sites that publish a robots.txt.

Type:boolean

Default:false

URL filter regex

urlFilterRegex

Optional

Optional JavaScript-compatible regex applied to discovered URLs. Matched URLs are included in the output and the persisted snapshot; non-matches are ignored. Applies to final URLs, not intermediate sitemaps.

Type:string

Default:

Change types to emit

changeTypes

Optional

Which change types to emit as dataset rows. Defaults to ['new_url', 'updated_url', 'removed_url'] (delta-only). Add 'unchanged' to also include rows that did not change since the previous snapshot.

Type:array

Default:

[
  "new_url",
  "updated_url",
  "removed_url"
]

Add removed URLs to key-value store

addRemovedUrlsToKvs

Optional

When true, also write a REMOVED-URLS key to the state key-value store with the full list of URLs that disappeared since the last snapshot, in addition to emitting 'removed_url' rows in the dataset.

Type:boolean

Default:false

Previous items

previousItems

Optional

Optional previous sitemap URL rows from an earlier run (overrides persisted state if provided).

Type:array

Default:

[]

Only output changed URLs (legacy alias for changeTypes)

onlyChanged

Optional

If true (default), only emit rows whose status is not 'unchanged'. Equivalent to changeTypes excluding 'unchanged'.

Type:boolean

Default:true

Persist state between runs

persistState

Optional

Store the latest sitemap snapshot in a named key-value store.

Type:boolean

Default:true

State store name

stateStoreName

Optional

Named key-value store used for snapshots when persistState is enabled.

Type:string

Default:sitemap-delta-monitor-state

State key override

stateKey

Optional

Optional snapshot key. Leave empty to derive from input sitemap URLs.

Type:string

Default:

Max nested sitemaps

maxSitemapUrls

Optional

Maximum nested sitemap URLs to fetch from sitemap indexes (and from robots.txt discovery).

Type:integer

Minimum:1

Maximum:200

Default:25

Max URLs

maxUrls

Optional

Maximum URLs to track per run.

Type:integer

Minimum:1

Maximum:50000

Default:5000

Request timeout (ms)

requestTimeoutMs

Optional

Per-request timeout in milliseconds for sitemap and robots.txt fetches.

Type:integer

Minimum:5000

Maximum:120000

Default:30000

Sitemap Robots Delta Monitor

tom_the_builder/sitemap-robots-delta-monitor

Monitor sitemap.xml and robots.txt for URL inventory changes and return new, changed, or removed URLs in normalized JSON.

Danil Iarmolchik

Sitemap Xml Monitor

datawinder/sitemap-xml-monitor

Monitor sitemap.xml files for structural, availability, and content changes. Detect critical SEO issues like URL removals, broken sitemaps, index changes, and formatting errors with severity-based alerts.

DatawinderLabs

Website Change Monitor — Content Diff & Alerts

accurate_pouch/website-change-monitor

Monitor websites for content changes. Text diff, hash comparison, CSS selector targeting. Webhook alerts when content changes. Use with Apify scheduling for daily monitoring. 5 URLs free.

Manchitt Sanan

Structured Data Scraper & Validator

taroyamada/structured-data-validator

Crawl websites to extract JSON-LD and Microdata, validate schema markup syntax, and flag missing fields across massive URL lists.

naoki anzai

🗺️ Sitemap Scraper & Analyzer

taroyamada/sitemap-analyzer

Extract thousands of URLs from complex nested XML sitemaps to audit website structure, HTTP status codes, and indexability for technical SEO.

naoki anzai

Broken Link Checker — Recursive Site Crawler

accurate_pouch/broken-link-checker

Recursively crawl your website and find every broken link, 404, redirect, and timeout. Checks internal and external links with configurable depth. 100 links free per run.

Manchitt Sanan

Sitemap Analyzer — Parse, Validate & Check URLs

accurate_pouch/sitemap-analyzer

Parse XML sitemaps, extract all URLs, validate structure (priority, changefreq, lastmod), optionally check HTTP status of every URL. Supports sitemap indexes.

Manchitt Sanan

Shopify Store Audit & Tech-Stack Lead Scorer

fried_calamaries/shopify-store-intel

Audit any Shopify store — installed apps, theme, pricing & catalog signals, and tech-stack gaps. Bulk-score a prospect list and monitor stores for app installs/removals.

ByteMe

Tech Stack Detector — Bulk Website Technology Lookup

accurate_pouch/tech-stack-detector

Detect frameworks, CMS, analytics, CDN, hosting, chat tools, and more for any list of URLs. No API key needed — reads public HTTP headers and HTML.

Manchitt Sanan

Shopify App Store Scraper

alwaysprimedev/shopify-app-store-scraper

Scrape the Shopify App Store for app metadata, pricing tiers, ratings, reviews, and Built-for-Shopify badges. Designed for delta-tracking — daily price drops, rating shifts, and badge wins.

Always Prime

179

Supplier Stock/Price Monitor

zentrafoundry/supplier-stock-price-monitor

Track Supplier/manufacturer public product pages, Public sitemaps/RSS/CSV/XML feeds and return product availability, price, stock, review, catalog, and change records.