# llms.txt Checker: which developer docs publish llms.txt

**Use case:** 

Compare llms.txt, robots.txt and AI crawler access across Stripe, Vercel, Cloudflare and the Claude and OpenAI docs. Four of the five ship an llms.txt.

## Input

```json
{
  "startUrls": [
    {
      "url": "https://docs.anthropic.com"
    },
    {
      "url": "https://platform.openai.com"
    },
    {
      "url": "https://vercel.com"
    },
    {
      "url": "https://stripe.com"
    },
    {
      "url": "https://www.cloudflare.com"
    }
  ],
  "crawlSite": false,
  "maxPages": 10,
  "checkBrokenLinks": false,
  "maxLinksToCheck": 50,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

## Output

```json
{
  "url": {
    "label": "URL",
    "format": "link"
  },
  "scoreAiAccess": {
    "label": "AI access /100",
    "format": "number"
  },
  "aiCrawlersAllowedCount": {
    "label": "AI bots allowed",
    "format": "number"
  },
  "aiCrawlersBlocked": {
    "label": "Blocked bots",
    "format": "array"
  },
  "llmsTxtFound": {
    "label": "llms.txt",
    "format": "boolean"
  },
  "robotsTxtFound": {
    "label": "robots.txt",
    "format": "boolean"
  },
  "sitemapFound": {
    "label": "Sitemap",
    "format": "boolean"
  },
  "mainTextChars": {
    "label": "Text chars",
    "format": "number"
  },
  "textToHtmlRatio": {
    "label": "Text/HTML",
    "format": "number"
  },
  "jsonLdTypes": {
    "label": "Schema types",
    "format": "array"
  }
}
```

## About this Actor

This example demonstrates how to use [AI Crawler Checker: robots.txt & llms.txt Audit](https://apify.com/aiqlabs/seo-ai-visibility-auditor) with a specific input configuration. Visit the [Actor detail page](https://apify.com/aiqlabs/seo-ai-visibility-auditor) to learn more, explore other use cases, and run it yourself.