Broken Link Checker (internal and external)
Pricing
from $10.00 / 1,000 page crawleds
Broken Link Checker (internal and external)
Crawl a website and list every broken link with the pages it appears on.
Pricing
from $10.00 / 1,000 page crawleds
Rating
0.0
(0)
Developer
Austin Hardy
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
a day ago
Last modified
Categories
Share
Crawl a website and get a list of every broken link, with the pages it appears on. Useful after a redesign or migration, before a launch, and as a scheduled monthly check.
How it works
- It starts from your URLs and follows links on the same site, up to the page limit.
- It collects every link found (pages, images are not included, only anchors).
- It tests each unique link with a HEAD request, falling back to GET when a server rejects HEAD, and follows redirects.
- It reports links that return an error status (400 and above), time out, or fail to resolve.
Output
One row per broken link (or a single "No broken links found" row when the site is clean): brokenLink, status (or an error code such as ENOTFOUND), whether it is internal, how many pages contain it and up to five of those pages. A SUMMARY record in the key-value store has the counts: pages crawled, links checked, broken links.
Input
- startUrls: where to begin (up to 20).
- maxPages: crawl limit, 1 to 1000, default 50.
- checkExternal: also test links to other websites, default on.
- timeoutSecs: per-link timeout, default 15.
Limits
Links created by JavaScript after the page loads are not seen, because pages are fetched as plain HTML. Some sites block automated requests and may be reported as broken when they work in a browser. Pages behind a login are not supported. Up to 3000 links are checked per run.
Pricing is per crawled page (pay per event).
