# Link Integrity & Redirect Auditor (`silicon1235/link-integrity-redirect-auditor`) Actor Crawl public websites for broken links, redirect warnings, insecure HTTP links, invalid fragments, and recovered issues with bounded HTTP-only checks. - **URL**: https://apify.com/silicon1235/link-integrity-redirect-auditor.md - **Developed by:** [X L](https://apify.com/silicon1235) (community) - **Categories:** SEO tools, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Link Integrity & Redirect Auditor Audit public websites for broken links, redirects, insecure HTTP links, invalid fragments, and recovered issues. The Actor is HTTP-only and uses the mature `linkinator` engine instead of browser automation. ### Why this product The live Apify Store scan on 2026-07-10 found about 467 direct monthly users across broken-link products. Nearly all visible competitors use pay-per-event pricing, while the leading dedicated checker had a low public rating. This Actor differentiates with scheduled snapshots, recovery detection, bounded scans, redirect policy, HTTPS policy, fragment checks, and source-page evidence. ### Output Each checked URL becomes one dataset row with: - HTTP status and `OK`, `BROKEN`, or `SKIPPED` state - issue type and severity - redirect target - source pages linking to the URL - internal/external classification - `NEW`, `PERSISTING`, `MODIFIED`, `RECOVERED`, or `UNCHANGED` change state - stable fingerprint for scheduled comparisons The key-value store contains `SUMMARY`, `ISSUES`, `SNAPSHOTS`, and `REPORT`. ### Cost controls - `maxLinks` defaults to 250 and is capped at 5,000. - HTTP concurrency defaults to 20 and is capped at 50. - Per-request timeout defaults to 15 seconds. - 403 bot-protected URLs are skipped instead of reported as broken. - No login, residential proxy, browser, AI API, or external paid API is required. ### Local verification ```powershell npm test npm run smoke ```` ### Monetization path The code is ready for a future `url-checked` pay-per-event unit. Leave `PPE_EVENT_NAME` unset while the Actor is free or usage-cost-only. After pricing is configured in Apify Console, set `PPE_EVENT_NAME=url-checked`; one visible dataset item maps to one event and the SDK enforces user spending limits. Do not charge the synthetic Actor start event manually. Keep the first remote test private and bounded before any public or pricing change. # Actor input Schema ## `startUrls` (type: `array`): Public HTTP or HTTPS pages to scan. The Actor recursively follows pages on the same root site and validates linked resources. ## `recurse` (type: `boolean`): Follow links to additional pages under the start site's root URL instead of checking only the supplied pages. ## `maxLinks` (type: `integer`): Hard cost and runtime cap across all start URLs. ## `concurrency` (type: `integer`): Maximum number of link checks running in parallel. Lower values reduce load on small sites. ## `timeoutMs` (type: `integer`): Maximum time to wait for each HTTP request before reporting a network failure. ## `redirects` (type: `string`): Choose whether redirects are accepted, reported as warnings, or treated as broken links. ## `requireHttps` (type: `string`): Choose whether insecure HTTP links are accepted, reported, or treated as errors. ## `checkFragments` (type: `boolean`): Check server-rendered anchors such as #pricing and #contact. ## `checkCss` (type: `boolean`): Extract and validate resource URLs referenced from CSS in addition to links found in HTML. ## `skipPatterns` (type: `array`): Optional regular expressions for URLs that should not be checked. ## `headers` (type: `object`): Headers applied to requests. Do not include secrets when auditing public sites. ## `snapshotKey` (type: `string`): Key-value store record used to classify new, persisting, modified, and recovered issues. ## `saveSnapshot` (type: `boolean`): Persist the current audit fingerprint so later scheduled runs can identify changes and recoveries. ## Actor input object example ```json { "startUrls": [ { "url": "https://example.com" } ], "recurse": true, "maxLinks": 250, "concurrency": 20, "timeoutMs": 15000, "redirects": "warn", "requireHttps": "warn", "checkFragments": true, "checkCss": false, "skipPatterns": [], "headers": {}, "snapshotKey": "LINK_INTEGRITY_SNAPSHOT", "saveSnapshot": true } ``` # Actor output Schema ## `items` (type: `string`): No description ## `summary` (type: `string`): No description ## `issues` (type: `string`): No description ## `snapshots` (type: `string`): No description ## `report` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://example.com" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("silicon1235/link-integrity-redirect-auditor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://example.com" }] } # Run the Actor and wait for it to finish run = client.actor("silicon1235/link-integrity-redirect-auditor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://example.com" } ] }' | apify call silicon1235/link-integrity-redirect-auditor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=silicon1235/link-integrity-redirect-auditor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Link Integrity & Redirect Auditor", "description": "Crawl public websites for broken links, redirect warnings, insecure HTTP links, invalid fragments, and recovered issues with bounded HTTP-only checks.", "version": "0.1", "x-build-id": "JbEOAK9pmmVHzG6Be" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/silicon1235~link-integrity-redirect-auditor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-silicon1235-link-integrity-redirect-auditor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/silicon1235~link-integrity-redirect-auditor/runs": { "post": { "operationId": "runs-sync-silicon1235-link-integrity-redirect-auditor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/silicon1235~link-integrity-redirect-auditor/run-sync": { "post": { "operationId": "run-sync-silicon1235-link-integrity-redirect-auditor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "Public HTTP or HTTPS pages to scan. The Actor recursively follows pages on the same root site and validates linked resources.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "recurse": { "title": "Recursively crawl same-site pages", "type": "boolean", "description": "Follow links to additional pages under the start site's root URL instead of checking only the supplied pages.", "default": true }, "maxLinks": { "title": "Maximum unique links", "minimum": 1, "maximum": 5000, "type": "integer", "description": "Hard cost and runtime cap across all start URLs.", "default": 250 }, "concurrency": { "title": "HTTP concurrency", "minimum": 1, "maximum": 50, "type": "integer", "description": "Maximum number of link checks running in parallel. Lower values reduce load on small sites.", "default": 20 }, "timeoutMs": { "title": "Request timeout in milliseconds", "minimum": 1000, "maximum": 60000, "type": "integer", "description": "Maximum time to wait for each HTTP request before reporting a network failure.", "default": 15000 }, "redirects": { "title": "Redirect policy", "enum": [ "allow", "warn", "error" ], "type": "string", "description": "Choose whether redirects are accepted, reported as warnings, or treated as broken links.", "default": "warn" }, "requireHttps": { "title": "HTTP link policy", "enum": [ "off", "warn", "error" ], "type": "string", "description": "Choose whether insecure HTTP links are accepted, reported, or treated as errors.", "default": "warn" }, "checkFragments": { "title": "Validate page fragments", "type": "boolean", "description": "Check server-rendered anchors such as #pricing and #contact.", "default": true }, "checkCss": { "title": "Check CSS resource URLs", "type": "boolean", "description": "Extract and validate resource URLs referenced from CSS in addition to links found in HTML.", "default": false }, "skipPatterns": { "title": "Skip URL patterns", "type": "array", "description": "Optional regular expressions for URLs that should not be checked.", "default": [], "items": { "type": "string" } }, "headers": { "title": "Optional request headers", "type": "object", "description": "Headers applied to requests. Do not include secrets when auditing public sites.", "default": {} }, "snapshotKey": { "title": "Snapshot key", "type": "string", "description": "Key-value store record used to classify new, persisting, modified, and recovered issues.", "default": "LINK_INTEGRITY_SNAPSHOT" }, "saveSnapshot": { "title": "Save snapshot", "type": "boolean", "description": "Persist the current audit fingerprint so later scheduled runs can identify changes and recoveries.", "default": true } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```