# AI Crawler Access Checker: audit an entire website

**Use case:** 

Crawl up to 10 pages and score each one for AI crawler access, llms.txt, structured data and classic SEO. Find the pages ChatGPT and Claude cannot read.

## Input

```json
{
  "startUrls": [
    {
      "url": "https://apify.com"
    }
  ],
  "crawlSite": true,
  "maxPages": 10,
  "checkBrokenLinks": false,
  "maxLinksToCheck": 50,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

## Output

```json
{
  "url": {
    "label": "URL",
    "format": "link"
  },
  "statusCode": {
    "label": "Status",
    "format": "number"
  },
  "scoreTotal": {
    "label": "Total /100",
    "format": "number"
  },
  "scoreSeo": {
    "label": "SEO",
    "format": "number"
  },
  "scoreAiAccess": {
    "label": "AI access",
    "format": "number"
  },
  "scoreStructuredData": {
    "label": "Schema",
    "format": "number"
  },
  "scoreSocial": {
    "label": "Social",
    "format": "number"
  },
  "issueCount": {
    "label": "Issues",
    "format": "number"
  },
  "title": {
    "label": "Page title",
    "format": "text"
  }
}
```

## About this Actor

This example demonstrates how to use [AI Crawler Checker: robots.txt & llms.txt Audit](https://apify.com/aiqlabs/seo-ai-visibility-auditor) with a specific input configuration. Visit the [Actor detail page](https://apify.com/aiqlabs/seo-ai-visibility-auditor) to learn more, explore other use cases, and run it yourself.