How do I check for broken links without overloading my site?

Created by

Tarcio Elyakin Agra Diniz

Actor

Find Broken Links on Your Whole Site: 404 Link Checker

Shared hosting or a site that already struggles at peak does not need an audit firing dozens of requests at once. This is the polite configuration: one request at a time and two full seconds between requests to the same host, external links left out, so the run only touches your own server. If the site robots.txt asks for a longer Crawl-delay than yours, the longer value wins.

Try for free

Find Broken Links on Your Whole Site: 404 Link Checkerlotebo-lab/broken-link-auditor

Row type

Broken URL

HTTP status

Error

+4 fields

Input

Website(required):https://books.toscrape.com

Max pages to crawl:3

Max crawl depth:1

Delay between requests:2

Links checked at the same time:1

Also check links to other sites:false

Output fields

Row type

Broken URL

HTTP status

Error

Found on page

Anchor text

Link type

Summary

How it works

Sign up on Apify or log in

The Find Broken Links on Your Whole Site: 404 Link Checker Actor is ready to run with the inputs already set for "How do I check for broken links without overloading my site?". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "How do I check for broken links without overloading my site?" task

The Find Broken Links on Your Whole Site: 404 Link Checker Actor will start running based on the input automatically. You can also change all the input fields, like website, max pages to crawl, and more, to match your specific use case.

Receive the "How do I check for broken links without overloading my site?" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as row type, broken url, HTTP status, and more.