Broken Link Checker · 404s with Page & Anchor, Only New Ones avatar

Broken Link Checker · 404s with Page & Anchor, Only New Ones

Pricing

from $0.67 / 1,000 link checkeds

Go to Apify Store
Broken Link Checker · 404s with Page & Anchor, Only New Ones

Broken Link Checker · 404s with Page & Anchor, Only New Ones

Crawl your website and find broken links, 404s, server errors and redirects, with the exact page and anchor text to fix. On a schedule it reports only newly broken links. Respects robots.txt and tells 'blocked' apart from 'broken'.

Pricing

from $0.67 / 1,000 link checkeds

Rating

0.0

(0)

Developer

TheQuietStack

TheQuietStack

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Security

Limited permissions

Share

Broken Link Checker: 404s with Page and Anchor, Only New Ones

Finds the links on your website that no longer work and tells you where to fix them: the page, the anchor text and how often the link appears. On a schedule it reports only newly broken links, so a clean week stays quiet.

Typical uses: a weekly link check for your site · cleaning up after a relaunch · finding dead partner and affiliate links · a link report for an agency client.

What makes it different

  • Refused is not broken. A link that answers 401, 403 or 429 refused an automated check. Most checkers call that broken. Here it is problem: blocked, so your list of real problems stays real.
  • Only new problems. With onlyNew a scheduled run writes just what broke since the last run, and the site summary counts what was fixed.
  • Polite by design. The Actor names itself, follows robots.txt on every host, including external ones, and never sends parallel requests to one host.

Input example

{ "startUrls": ["https://www.example.com/"], "maxPages": 200, "maxLinks": 2000, "onlyNew": true }

Output

One row per problem, plus one free site-summary row per site.

{ "type": "link", "problem": "broken", "status": 404, "url": "https://www.example.com/old-offer", "linkKind": "internal", "tag": "a",
"foundOn": "https://www.example.com/", "anchorText": "Old offer", "otherPages": ["https://www.example.com/about"], "timesLinked": 2 }
problemMeaning
broken404, 410 or another 4xx answer
server-error5xx, also after one retry
timeout, dns-error, tls-error, network-errorNo usable answer
blocked401, 403, 429: the site refused the check, the link may well work
redirectWorks but redirects (only with includeRedirects)

Pricing

Pay per event: one charge per unique link checked, however many pages link to it. A page opened for the crawl counts as its own link check. Links skipped because of robots.txt, site-summary rows and problem rows cost nothing extra. maxLinks caps every run. A site without problems still costs its checks, because checking is the work.

Honest limits

  • Reads the HTML as delivered. Links that only appear after JavaScript runs are not seen.
  • Links in robots.txt-disallowed areas are not checked and are counted in notCheckedByRobots. If robots.txt cannot be reached (5xx or no answer), nothing on that host is opened.
  • maxPages and maxLinks can end a scan early: the summary then says complete: false, and onlyNew keeps remembering what it did not reach.
  • One host is checked one request at a time with at least 200 ms between requests, so large sites take a while. Raise the run timeout if needed.
  • Check sites you own or may check. Private and local addresses are refused.