Broken Url Monitor

Pricing

Pay per event

Broken Url Monitor

Stateful sitemap-based broken URL monitor that detects link failures, redirects, and regressions over time for SEO and automated website monitoring.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Datawinder

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

6 hours ago

Last modified

What it does

Parses sitemap files and sitemap indexes (nested sitemaps supported)
Validates all URLs using HTTP HEAD (automatic fallback to GET)
Stores a baseline snapshot on first run
Compares subsequent runs against the previous snapshot
Reports only meaningful changes, classified by severity

Detected changes

Broken URLs (4xx / 5xx)
Status code changes
Newly introduced redirects
URL recoveries (error → OK)
Large response time regressions

Why this Actor

Most link checkers:

Run once
Dump raw status codes
Require manual comparison

This Actor:

Is stateful
Safe to run repeatedly or on a schedule
Produces diff-based output
Designed for monitoring, not crawling

Input

Field	Type	Required	Default	Description
`sitemapUrl`	string	✅	–	URL of a sitemap or sitemap index
`requestMethod`	string	❌	`head`	HTTP method (`head` or `get`)
`followRedirects`	boolean	❌	`true`	Follow HTTP redirects
`timeoutMs`	number	❌	`10000`	Request timeout in milliseconds
`maxConcurrency`	number	❌	`10`	Number of parallel URL checks

First run (baseline)

On the first execution:

All URLs are checked
Results are stored as a baseline
No diffs are reported

Example output:

{
  "baseline": true,
  "summary": {
    "total": 84,
    "ok": 84,
    "redirect": 0,
    "clientError": 0,
    "serverError": 0
  },
  "message": "Baseline stored. Monitoring is now active."
}

Subsequent runs (monitoring)

On later executions:

URLs are rechecked
Results are compared against the previous snapshot
Only changes are reported

Example output:

{
  "baseline": false,
  "summary": {
    "total": 84,
    "ok": 82,
    "errors": 2
  },
  "changes": {
    "critical": [
      {
        "url": "https://example.com/page",
        "previous": { "status": 200 },
        "current": { "status": 404 }
      }
    ],
    "warning": [],
    "info": []
  },
  "unchangedCount": 82
}

Severity levels

critical
- Status code regressions (e.g. 200 → 404)
warning
- Newly introduced redirects
- Response time regressions (>4× increase)
info
- URL recoveries
- Newly added URLs

Recommended usage

Run on a schedule (daily or hourly)
Use Apify webhooks or integrations for alerts
One Actor run equals one monitoring snapshot

Notes

Each sitemap is monitored independently
State is stored automatically per sitemap
Safe to rerun indefinitely
No proxies required for most sites

Webhook & Alerts

This Actor is designed to be used with Apify webhooks.

Example: Alert on broken URLs

Trigger condition:

Event: ACTOR.RUN.SUCCEEDED
Payload filter (pseudo):

payload.OUTPUT.baseline === false &&
payload.OUTPUT.changes.critical.length > 0

Example: Slack alert message (JSON)

{
  "text": ":rotating_light: Broken URLs detected",
  "attachments": [
    {
      "fields": [
        { "title": "Sitemap", "value": "{{sitemapUrl}}" },
        { "title": "Critical changes", "value": "{{criticalChanges}}" },
        { "title": "Warnings", "value": "{{warningChanges}}" }
      ]
    }
  ]
}

Example: Email summary

Send when:

baseline === false
criticalChanges > 0 Include:
sitemap URL
number of broken URLs
link to Actor run

Leboncoin Scraper (API) Pro 🇫🇷

clearpath/leboncoin-api

Leboncoin.fr Scraper (API): Extract French classified ads for market research, price monitoring & competitive analysis. Location-based search, category filtering, business intelligence. Optimized for efficient data extraction across France. ⚡

ClearPath

189

3.1

(3)

Facebook Reels Downloader Pro

codenest/facebook-reels-downloader-pro

🚀 Download Facebook Reels instantly! Get 1080p HD videos, separate audio tracks, and secure Apify Key-Value Store URLs. Perfect for marketers 📈, content creators 🎬, and developers 💻. Enjoy encrypted storage, permanent download links, and reliable access to all your media files.

CodeNest

Vivareal Property Search Scraper

stealth_mode/vivareal-property-search-scraper

Scrape comprehensive property listings from VivaReal.com.br, Brazil's leading real estate marketplace. Extract prices, locations, amenities, property details, and developer information from search results. Perfect for real estate agencies, property investors, market analysts, and market research.

Stealth mode

Instagram Followers Scraper Pro

alpha-scraper/instagram-followers-scraper-pro

📸 Instagram Followers Scraper lets you extract public profile data from Instagram accounts quickly! Get followers, posts, bio links, profile pics, account type & more in structured JSON. Perfect for research, marketing & analytics. Fast, reliable & easy to use! ✨

Alpha Scraper

5.0

(1)

Wayfair Product Search Scraper

stealth_mode/wayfair-product-search-scraper

Efficiently scrape product listings from Wayfair.com search results. Extract comprehensive furniture and home decor data including prices, reviews, variants, shipping details, and inventory status. Perfect for e-commerce competitors, price monitoring, market research, and product catalog building.

Stealth mode

Jumia Product Search Scraper

stealth_mode/jumia-product-search-scraper

Automate extraction of product data from Jumia Nigeria's marketplace. Capture SKUs, pricing, ratings, seller information, categories, and images from search results. Perfect for price monitoring, competitor analysis, market research, and inventory intelligence across Nigeria's leading e-commerce.

Stealth mode

Hosco Jobs Search Scraper

stealth_mode/hosco-jobs-search-scraper

Efficiently scrape job listings from Hosco.com, the world's leading hospitality career platform. Extract comprehensive data including hotel jobs, restaurant positions, salary ranges, and company details. Perfect for recruitment agencies, hospitality market research, and career analytics.

Stealth mode

Konga Product Search Scraper

stealth_mode/konga-product-search-scraper

Automate extraction of comprehensive product data from Konga.com, Nigeria's leading e-commerce platform. Capture pricing, inventory, seller information, ratings, and delivery details. Perfect for price monitoring, market research, competitive intelligence, and inventory analysis in West Africa's.

Stealth mode

Comparis Property Search Scraper

stealth_mode/comparis-property-search-scraper

Efficiently scrape property listings from Comparis.ch, Switzerland's leading real estate comparison platform. Extract comprehensive rental and sale data including prices, locations, property types, and market ratings. Perfect for real estate agencies, market analysts, & property investment research

Stealth mode

Immonet Search Scraper

stealth_mode/immonet-search-scraper

Automate extraction of German property listings from Immonet.de. Capture comprehensive real estate data including prices, locations, specifications, and contact details. Ideal for market analysis, investment research, and competitive intelligence in Germany's property market.

Stealth mode