Broken Link Checker with Bot-Block Detection
Pricing
from $0.50 / 1,000 link checkeds
Broken Link Checker with Bot-Block Detection
Crawl a website and find dead links, listing every page that links to them. Separates truly broken links from sites that just block bots, so you skip false alarms.
Pricing
from $0.50 / 1,000 link checkeds
Rating
0.0
(0)
Developer
Meta Parse
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Security
Limited permissionsShare
Broken Link Checker
Crawl a website and find its dead links, with every page that links to each one and the anchor text to look for.
Many checkers report a link as broken when a site merely refuses bots. This one keeps those apart, so you can fix real problems first.
| State | Meaning | What to do |
|---|---|---|
broken | 404, 410, server error, no DNS, or connection refused | Fix it |
blocked | 401, 403, 405, 406, 429, 451, 503 or 999: the server refused a robot | Check by hand; it often works in a browser |
error | Timeout or another failure that may be temporary | Rerun |
Input
Output
Broken links come first:
The SUMMARY record in the key-value store has totals for pages crawled, links checked and paths skipped by robots.txt.
Pricing
$0.0005 per unique link checked. The default limit is 500 links, or $0.25. Raise maxLinks for bigger sites: 2,000 links costs at most $1. Runs also stop within any spending limit you set.
Each run also has a $0.00005 start fee per GB of memory. All compute is included.
Behaviour
- It only reads the site you name, and follows that site's
robots.txt. Other sites' links are tested, not crawled. - It reads links from the HTML the server sends, so links that only appear after JavaScript runs aren't found.
- Subdomains count as other sites.
