llms.txt Website Auditor

Detect and validate a domain's llms.txt (and llms-full.txt), reporting whether it exists, whether it's well-formed, and how many sections and links it declares.

What it checks

• Presence of llms.txt at its conventional location
• Basic structural validity (parseable sections, well-formed links)
• Section and link counts
• Presence of a companion llms-full.txt

The Actor performs a live audit through Sentinel Verify — it never requires the domain to already be registered anywhere.

Pricing

This is a paid, pay-per-event Actor: $0.03 per completed audit.

Exactly one llms-txt-audit event is charged per run, only after a real result exists (success or a useful partial). There is no charge for invalid input, a target blocked by the public-network policy, or a run that fails before a result is produced.

Input

• domain (required): a public domain or HTTPS origin to check, e.g. example.com.

Example input:

{
  "domain": "example.com"
}

Output

The default dataset receives one result envelope per domain; RUN_SUMMARY in the default key-value store records processing, delivery, billing, and dependency totals.

Representative abbreviated output:

{
  "status": "success",
  "target": {"identifier": "example.com"},
  "result": {
    "domain": "example.com",
    "found": true,
    "valid": true,
    "url": "https://example.com/llms.txt",
    "sections": 6,
    "links": 14,
    "llmsFullTxtFound": false
  }
}

restricted means API-IFY rejected the target locally before calling Verify. unreachable means the domain could not be reached. dependency_unavailable means Verify was temporarily unavailable.

How it works

This Actor is a thin wrapper around Sentinel Verify's POST /v1/utilities/detect-llms-txt endpoint. Each domain is checked locally against API-IFY's public-network policy before being sent to Verify.

Limitations

• Public HTTPS domains only; private, loopback, link-local, metadata, reserved, and CGNAT targets are rejected.
• Audit availability depends on Sentinel Verify.

Privacy and security

The target domain is sent to Sentinel's live Utility API (/v1/utilities/detect-llms-txt) for analysis after local public-network validation. Results are stored in the customer's Apify run dataset and summary store. VERIFY_API_KEY is an operator-managed Actor secret — a scoped utilities:read Intelligence API key sent as a bearer token on every request, the same credential mechanism used by any other Utility API consumer; VERIFY_BASE_URL is an operator setting, not an Actor input.

Support

For a reproducible support request, provide the Apify run ID, result itemId, and status. Contact Sentinel Signal Systems through the support link on the Actor page.