Well-Known Files Auditor: ads.txt, app-ads.txt, security.txt, llms.txt

Audit standard site files in bulk: ads.txt/app-ads.txt (records, DIRECT vs RESELLER, exchanges, invalid lines), security.txt (contact, expiry), llms.txt, humans.txt, Apple/Android app-link files and change-password.

Why this actor

• Six standards in one row; ads.txt parsed into counts.
• Pay only for results: $1.00 per 1,000 sites, no start fee, failed lookups are free.
• Robust: automatic retries with exponential backoff, respects Retry-After, per-item error rows instead of crashed runs.
• Clean, flat JSON/CSV/Excel output ready for Google Sheets, Make, Zapier, n8n, Clay, or the Apify API.

Use cases

• Ad-ops: verify seller listings across publishers
• Security teams: find vendors without security.txt
• Track llms.txt adoption
• Mobile teams verifying app links

Input

Field	Type	Description
sites	array	Domains to audit.
maxItems	integer	0 = no limit. Caps cost.

Example input:

{
  "sites": [
    "nytimes.com",
    "github.com",
    "example.com"
  ]
}

Output

Each dataset item looks like this (real sample from a test run, long fields trimmed):

{
  "site": "https://nytimes.com",
  "securityTxt": true,
  "securityContact": true,
  "securityTxtExpires": null,
  "adsTxt": {
    "records": 30,
    "invalidLines": 0,
    "direct": 30,
    "reseller": 0,
    "exchanges": 15,
    "topExchanges": [
      "adswizz.com",
      "amazon-adsystem.com",
      "aps.amazon.com",
      "\u2026"
    ],
    "managerDomain": null
  },
  "appAdsTxt": {
    "records": 14,
    "invalidLines": 0,
    "direct": 14,
    "reseller": 0,
    "exchanges": 12,
    "topExchanges": [
      "adswizz.com",
      "amazon-adsystem.com",
      "aps.amazon.com",
      "\u2026"
    ],
    "managerDomain": null
  },
  "llmsTxt": false,
  "llmsTxtBytes": null,
  "llmsTxtTitle": null,
  "humansTxt": true,
  "appleAppSiteAssociation": true,
  "androidAssetLinks": true,
  "changePasswordWellKnown": true,
  "scrapedAt": "2026-10-14T16:24:29+00:00"
}

Rows that could not be processed contain an error field and are not charged.

Pricing

Pay-per-event: $0.001 per site (= $1.00 / 1,000). Use Max results to cap spend. Apify's free plan credit covers thousands of results per month.

Integrations & API

Run on a schedule in Apify Console, call via the Apify API / Python & JS clients, or connect to Make, Zapier, n8n, Google Sheets, Slack and webhooks. Works as a tool for AI agents via Apify MCP.

FAQ

Is this an official tool? No. It is an independent actor and is not affiliated with, sponsored or endorsed by the data source or any trademark owner named here.

Is it legal? The actor only reads publicly available data from public endpoints, without logins, and does not bypass paywalls or access controls. You are responsible for using the data in line with applicable laws (e.g. GDPR) and the source sites' terms.

Something broke? Open an issue in the Issues tab; we typically respond within 24 hours and ship fixes fast.