Go to example tasks

Monitor a Website for New and Removed URLs

Track which pages a website publishes, updates or drops. Replace the sample website and external ID, then keep this Task, its URL and its patterns unchanged so later runs compare the same saved inventory. The first complete run is a quiet baseline returning only a site summary; later runs emit added, lastmod-changed and removed URL events. A removal is confirmed only after two complete runs.

Try for free
Sitemap Extractor & URL Change Monitor
Sitemap Extractor & URL Change Monitorautoma-flow/sitemap-extractor-monitor
Change type
External id
Url
Previous lastmod
+4 fields
Text
Number
Boolean
List
Object

Input

Websites or sitemaps(required)
Website, robots.txt, or sitemap URL(required):https://blog.apify.com
Your external ID:blog-demo
Include URL glob patterns
Exclude URL glob patterns

Output fields

Change type
External id
Url
Previous lastmod
Current lastmod
Sitemap url
Http status
Scraped at

How it works

Sign up on Apify01

Create your Apify account to access the Sitemap Extractor & URL Change Monitor.

Start the run02

The Actor will start running based on the input automatically.

Receive the output03

Monitor the progress in real-time. You will be notified as soon as your dataset is complete and ready for review.

Integrate into your workflow04

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow.

Image

Integrate Actor directly into your workflow

Choose from one of 100+ integration options we provide or integrate via API

Webhook

Webhook

n8n

n8n

Make

Make

Zapier

Zapier

Airbyte

Airbyte

Keboola

Keboola

IFTTT

IFTTT

Hubspot

Hubspot

GDrive

GDrive

Gmail

Gmail

Apify MCP

Apify MCP

GitHub

GitHub

Slack

Slack

LangChain

LangChain

LlamaIndex

LlamaIndex

Flowise

Flowise

Pinecone

Pinecone

OpenAI

OpenAI

Mastra

Mastra

Clay

Clay