Pricing

from $0.20 / 1,000 url listeds

Try for free

Go to Apify Store

Sitemap Extractor & Broken Link Checker: All URLs of a Site

Try for free

Get every URL of a website from its sitemaps (found automatically via robots.txt, indexes and .gz followed), with last-modified dates, images and hreflang. Optional status check finds broken pages, redirects and slow URLs.

Pricing

from $0.20 / 1,000 url listeds

Rating

0.0

(0)

Developer

SwiftKit

Actor stats

Bookmarked

Total users

Monthly active users

16 days ago

Last modified

Categories

SEO tools

Developer tools

Automation

Websites or sitemap URLs

websites

Required

A domain like apify.com (sitemaps are found automatically) or a direct sitemap URL.

Type:array

Max URLs per site

maxUrlsPerSite

Optional

Stop after this many URLs for each site.

Type:integer

Minimum:1

Maximum:500000

Default:1000

Only URLs containing (optional)

includePatterns

Optional

Keep URLs matching any of these texts or regular expressions, e.g. /blog/

Type:array

Skip URLs containing (optional)

excludePatterns

Optional

Drop URLs matching any of these, e.g. /tag/

Type:array

Check each URL's status

checkStatus

Optional

Request every URL and report the HTTP status, redirects and response time. Finds broken pages. Priced per URL checked.

Type:boolean

Default:false

Only show problems

onlyProblems

Optional

With status checks on: output only URLs that aren't 200 OK (broken, redirected, errors).

Type:boolean

Default:false

Checks at once

maxConcurrency

Optional

Parallel status checks per site. Keep it low to be polite.

Type:integer

Minimum:1

Maximum:10

Default:5

Broken Link Checker

jancurn/find-broken-links

Crawls a website and finds broken links. Unlike other similar SEO analysis tools, the actor also reports broken URL #fragments. The results are stored in a JSON and HTML report.

Jan Čurn

808

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

XML Sitemap Finder & Extractor API

andok/find-sitemap-from-url

Find and extract all XML sitemaps for any domain. Automatically parses robots.txt, scans HTML tags, and recursively follows indexes. Perfect for SEO & web scraping.

Andok

Website URL Crawler & Link Extractor

maged120/get-urls-pro

Crawl any website and extract every URL with its depth, parent page and anchor text. Build a sitemap or audit internal links. Works on static and JavaScript sites.

Maged

222

Sitemap URL Extractor — recursive, filters, .gz

x402opklaar/sitemap-url-extractor

Extract every URL from any sitemap: recursive sitemap-index expansion, gzipped sitemaps, robots.txt auto-discovery, include/exclude filters, lastmod output. Feed the URL list to any crawler or audit. Pay per sitemap file processed.

Opklaar

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

Sitemap URL Harvester

mahogany_songbird/sitemap-url-harvester

Collect URLs from XML sitemaps for SEO and crawling.

Britton Furness

Bulk URL Status Checker — Broken Links, Redirects & SSL

hipersoft/bulk-url-checker

Check thousands of URLs over plain HTTP: status codes, broken links (404/410/5xx), full redirect chains, response time, content type, page title and SSL certificate expiry.

hiper soft

Sitemap URL Extractor & 404 Checker — XML Sitemap Scraper

factpipe/sitemap-url-extractor

Extract every URL from any website's XML sitemaps: robots.txt discovery, nested sitemap indexes, lastmod and priority. Optional HTTP status check finds 404s and redirects. $0.30 per 1,000 URLs.

Neo B

Sitemap Extractor - All Website URLs + Broken Link Check

adaptive_arbor_rtz/sitemap-extractor

Find every page of a website from its sitemaps (robots.txt, sitemap indexes, .gz). Returns URLs with last-modified dates, filters by pattern, and can check each URL for 404s and redirects.