Broken Link Checker: Find Dead Links, Fewer False Alarms avatar

Broken Link Checker: Find Dead Links, Fewer False Alarms

Pricing

Pay per usage

Go to Apify Store
Broken Link Checker: Find Dead Links, Fewer False Alarms

Broken Link Checker: Find Dead Links, Fewer False Alarms

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Venture Ace

Venture Ace

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

15 minutes ago

Last modified

Security

Limited permissions

Share

Check the links on a page or a small site and get one row per unique link: ok, redirect, broken, blocked, timeout, refused or skipped, with the HTTP status, the reason, where a redirect ends and the page the link was found on.

Find dead links with fewer false alarms: a link that answers HEAD with an error is confirmed with GET before it is called broken, and a bot-protected link is reported as blocked (status unknown), not broken.

Input

  • startUrls: up to 10 page or link URLs (localhost and private addresses are refused).
  • mode: pageLinks (default; links on the pages you list), crawlSite (also reads same-host pages up to maxPages), urlList (checks the URLs you list).
  • maxLinks (default 200, max 2000), maxPages (10, max 100), checkExternal, includeImages, timeoutSeconds.

How it decides

HEAD first, then GET to confirm anything that is not a clean 2xx. Redirects are followed by hand (up to 5; loops are broken). 404, 410 and other 4xx confirmed by GET, 5xx twice, DNS failure, refused connection and TLS errors are broken. A 401, 403, 429, 999, a bot challenge or a robots.txt disallow is blocked: the site refuses automated checks, so its status is unknown. This actor does not try to get past a block. No answer after two tries is timeout. robots.txt is read for every host; two requests at a time per host.

Output

Dataset rows (view links) and a SUMMARY record in the key-value store with counts per verdict and notes (pages not read, caps reached). A bad link or an unreadable start page becomes a row, never a failed run.

Pay per event: US$0.0015 per link with a confirmed verdict (ok, redirect, broken). blocked, timeout, refused and skipped rows are returned but not charged.