Find Broken Links on a Website (404 Checker)

Created by

Charles Markette

Actor

Broken Link Checker: Crawl a Website, Find 404s & Redirects

Crawl a website and check every link it contains: internal pages, external links and (optionally) images, scripts and stylesheets. Each link row shows its HTTP status, redirect target and the page it was found on, so you know exactly what to fix. Respects robots.txt and the sitemap. Unverifiable answers (401, 403, 429) are flagged, not called broken.

Try for free

Broken Link Checker: Crawl a Website, Find 404s & Redirectscharlesmarkette/broken-link-checker-crawl-website-404

Link

Status

Broken

Unverified (blocked)

+9 fields

Input

Start URLs(required):https://books.toscrape.com/

Max pages to crawl:20

Max crawl depth:10

Crawl scope:sameHost

Use the sitemap:true

Respect robots.txt:true

Check external links:true

Check images, scripts and stylesheets:false

Output only broken links:false

Timeout per request (seconds):15

Parallel requests:10

Parallel requests per host:2

Output fields

Link

Status

Broken

Unverified (blocked)

Internal / external

Type

Found on

Pages linking

Final URL

Redirects

Loop

Time (ms)

Error

How it works

Sign up on Apify or log in

The Broken Link Checker: Crawl a Website, Find 404s & Redirects Actor is ready to run with the inputs already set for "Find Broken Links on a Website (404 Checker)". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Find Broken Links on a Website (404 Checker)" task

The Broken Link Checker: Crawl a Website, Find 404s & Redirects Actor will start running based on the input automatically. You can also change all the input fields, like start urls, max pages to crawl, and more, to match your specific use case.

Receive the "Find Broken Links on a Website (404 Checker)" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as link, status, broken, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Find Broken Links on a Website (404 Checker)" task via API.