Bulk URL Status Checker

Sitemap URL Extractor

automation-lab/sitemap-url-extractor

This actor parses XML sitemaps and extracts all URLs with their metadata. It handles both regular sitemaps and sitemap indexes (recursively follows child sitemaps up to 3 levels deep). For each URL, it captures the last modified date, change frequency, priority, and whether the entry...

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Sitemap Generator

alizarin_refrigerator-owner/sitemap-generator

Generate XML sitemaps by crawling any website. Discover all pages, images, & videos with configurable crawl depth, URL filters, & multiple output formats. Full Site Crawling ,Image Sitemap, Video Sitemap, Multiple Output Formats, URL Filtering, Configurable Depth, Last Modified, Webhook Integration

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Get all URLs of a website from its XML sitemap: finds sitemaps via robots.txt and common paths, walks sitemap indexes, reads .gz files and extracts every page URL with lastmod, priority, images, news and hreflang. HTTP-only. $0.40 per 1,000 URLs; duplicates and failed sites are free.

Moz Domain Authority Checker - Bulk DA, Links & Spam Score

scrapewise/moz-domain-authority

Bulk Moz Domain Authority checker without a Moz account: DA, linking root domains, ranking keywords, spam score, top pages by Page Authority, top linking domains and 60 days of discovered and lost linking domains. US$ 7 per 1,000 domains.

Sitemap URL Extractor

lnlenost/sitemap-url-extractor

Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.

Broken Link Checker - Find Dead 404 Links

logiover/broken-link-checker

Site-wide broken link checker: crawl any website, find 404 and dead links, export the link audit to CSV or JSON with source page and status code.

Extract all SEO meta tags, Open Graph, Twitter Cards, and get an instant SEO score (0-100). Perfect for SEO audits, competitive analysis, and digital marketing. Analyze any website in seconds!

Sitemap Sniffer

crawlerbros/sitemap-sniffer

Discover every sitemap file for a website. Reads robots.txt for Sitemap directives, probes common sitemap paths, and recursively unpacks sitemap-index files. HTTP-only, no proxy or cookies needed.