Check External Links and Redirects on a Website

Created by

Charles Markette

Actor

Broken Link Checker: Crawl a Website, Find 404s & Redirects

Audit the outbound links on your website: crawl a section of your site and check every link to other websites for dead pages, server errors and redirects, with the page each link sits on. Great for content teams, SEO audits and docs sites. Respects robots.txt; answers like 401, 403 and 429 are flagged as unverified rather than broken.

Try for free

Broken Link Checker: Crawl a Website, Find 404s & Redirectscharlesmarkette/broken-link-checker-crawl-website-404

Link

Status

Broken

Unverified (blocked)

+9 fields

Input

Start URLs(required):https://www.python.org/about/

Max pages to crawl:10

Max crawl depth:2

Crawl scope:sameHost

Use the sitemap:false

Respect robots.txt:true

Check external links:true

Check images, scripts and stylesheets:false

Output only broken links:false

Timeout per request (seconds):15

Parallel requests:10

Parallel requests per host:2

Output fields

Link

Status

Broken

Unverified (blocked)

Internal / external

Type

Found on

Pages linking

Final URL

Redirects

Loop

Time (ms)

Error

How it works

Sign up on Apify or log in

The Broken Link Checker: Crawl a Website, Find 404s & Redirects Actor is ready to run with the inputs already set for "Check External Links and Redirects on a Website". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Check External Links and Redirects on a Website" task

The Broken Link Checker: Crawl a Website, Find 404s & Redirects Actor will start running based on the input automatically. You can also change all the input fields, like start urls, max pages to crawl, and more, to match your specific use case.

Receive the "Check External Links and Redirects on a Website" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as link, status, broken, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Check External Links and Redirects on a Website" task via API.