# Audit Competitor AI Crawler Policies

**Use case:** 

Compare robots.txt and llms.txt rules for GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and CCBot across competitor websites.

## Input

```json
{
  "domains": [
    "openai.com",
    "anthropic.com",
    "google.com"
  ],
  "maxDomains": 100,
  "timeoutSecs": 15
}
```

## Output

```json
{
  "domain": {
    "label": "Domain",
    "format": "text"
  },
  "robotsStatus": {
    "label": "robots.txt",
    "format": "number"
  },
  "llmsTxtStatus": {
    "label": "llms.txt",
    "format": "number"
  },
  "gptbot": {
    "label": "GPTBot",
    "format": "text"
  },
  "claudebot": {
    "label": "ClaudeBot",
    "format": "text"
  },
  "perplexitybot": {
    "label": "PerplexityBot",
    "format": "text"
  },
  "googleExtended": {
    "label": "Google-Extended",
    "format": "text"
  },
  "commonCrawl": {
    "label": "CCBot",
    "format": "text"
  },
  "recommendation": {
    "label": "Recommendation",
    "format": "text"
  },
  "error": {
    "label": "Error",
    "format": "text"
  }
}
```

## About this Actor

This example demonstrates how to use [AI Crawler Policy Audit API | 🤖 $1/1K](https://apify.com/webdata_labs/ai-crawler-policy-audit-api) with a specific input configuration. Visit the [Actor detail page](https://apify.com/webdata_labs/ai-crawler-policy-audit-api) to learn more, explore other use cases, and run it yourself.