# Technical SEO Crawl Rules Workflow

**Use case:** 

Audit robots.txt directives and sitemap coverage across several competitor domains before planning a crawl or SEO migration.

## Input

```json
{
  "urls": [
    "nytimes.com",
    "bbc.com",
    "cnn.com",
    "theguardian.com"
  ],
  "parseSitemaps": true,
  "maxSitemapUrls": 10000
}
```

## Output

```json
{
  "url": {
    "label": "Website"
  },
  "totalSitemapUrls": {
    "label": "Total URLs in Sitemaps"
  },
  "checkTimeMs": {
    "label": "Check (ms)"
  },
  "error": {
    "label": "Error"
  },
  "checkedAt": {
    "label": "Checked At"
  }
}
```

## About this Actor

This example demonstrates how to use [Robots.txt & Sitemap Analyzer](https://apify.com/automation-lab/robots-sitemap-analyzer) with a specific input configuration. Visit the [Actor detail page](https://apify.com/automation-lab/robots-sitemap-analyzer) to learn more, explore other use cases, and run it yourself.