# Sitemap Freshness & Schema Integrity Auditor (`sebastian-actors/sitemap-freshness-schema-integrity-auditor`) Actor

Audit sitemap lastmod, schema dates, and page freshness with static HTTP checks and deterministic issue codes.

- **URL**: https://apify.com/sebastian-actors/sitemap-freshness-schema-integrity-auditor.md
- **Developed by:** [Sebastian](https://apify.com/sebastian-actors) (community)
- **Categories:** SEO tools, Developer tools, Automation
- **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.22 / 1,000 audited urls

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Sitemap Freshness & Schema Integrity Auditor

Find stale pages, broken schema dates, and sitemap `lastmod` mismatches before search engines, clients, or content teams notice.

This Actor audits sitemap-backed freshness signals with static HTTP requests only. It expands sitemap URLs, checks robots.txt, fetches each page, extracts HTML and JSON-LD context, compares date sources, and outputs deterministic issue codes for every URL.

The issue codes are the product. The freshness score is a quick triage helper.

### Who it is for

- Technical SEO teams checking sitemap `lastmod` quality.
- Content teams auditing stale article, recipe, docs, and product pages.
- Agencies that need a repeatable client-facing freshness report.
- Site owners who want structured data/date integrity checks without running a browser crawler.

### What it does

- Expands sitemap `urlset` and `sitemapindex` files, including bounded sitemap indexes.
- Checks `robots.txt` before page fetches when enabled.
- Fetches pages with static HTTP GET requests, redirects, retries, timeout, and body-size limits.
- Extracts title, meta description, canonical, H1, robots meta, language, Open Graph, Twitter metadata, and a content hash.
- Extracts JSON-LD entities, schema types, schema date fields, and local recommended-field signals.
- Detects Microdata and RDFa presence without claiming full graph validation.
- Extracts semantic date candidates from sitemap `lastmod`, HTTP `Last-Modified`, JSON-LD, meta tags, `time[datetime]`, and visible semantic date elements.
- Compares cross-source date signals and emits deterministic issue codes.
- Writes exactly one dataset row per URL and writes an aggregate run summary to `OUTPUT`.

### What it does not do

This is intentionally not a browser crawler or generic SEO suite.

- No Playwright, Puppeteer, browser rendering, screenshots, or visual diffs.
- No residential proxies or proxy rotation.
- No LLM calls, AI classification, or claim verification.
- No login-gated scraping, form submission, or paywalled content access.
- No unbounded crawling beyond provided sitemap URLs or direct URLs.
- No historical diff tracking or monitoring state.
- No full Google Rich Results Test parity.

### Sitemap URLs vs direct URLs

Use sitemap input when you can. Sitemap runs are the strongest mode because the Actor can compare page signals against sitemap `lastmod`.

Use direct URLs when you want to inspect specific pages, reproduce an issue, or test a small page set. Direct URL runs cannot produce sitemap-specific findings unless those URLs also came from a sitemap.

Do not put `robots.txt` or `sitemap.xml` in the direct URL list. Put sitemap files in `sitemapUrls`; direct URLs should be HTML pages.

### Example inputs

#### Generic sitemap audit

```json
{
  "sitemapUrls": ["https://www.your-site.com/sitemap.xml"],
  "urls": [],
  "maxPages": 100,
  "maxConcurrency": 5,
  "requestDelayMs": 250,
  "requestTimeoutSecs": 20,
  "respectRobotsTxt": true,
  "includeSeoBasics": true,
  "includeSchemaValidation": true,
  "includeRawDateCandidates": false,
  "dateMismatchToleranceDays": 3,
  "userAgent": "Sitemap Freshness & Schema Integrity Auditor (+https://apify.com/)"
}
````

#### Direct URL spot check

```json
{
  "sitemapUrls": [],
  "urls": [
    "https://www.your-site.com/blog/example-post",
    "https://www.your-site.com/docs/example-page"
  ],
  "maxPages": 10,
  "maxConcurrency": 2,
  "requestDelayMs": 250,
  "requestTimeoutSecs": 20,
  "respectRobotsTxt": true,
  "includeSeoBasics": true,
  "includeSchemaValidation": true,
  "includeRawDateCandidates": false,
  "dateMismatchToleranceDays": 3,
  "userAgent": "Sitemap Freshness & Schema Integrity Auditor (+https://apify.com/)"
}
```

#### Ecommerce/product sitemap audit

Use this shape for Shopify-style product sitemaps or any product sitemap with product page URLs. Replace the URL with your own product sitemap.

```json
{
  "sitemapUrls": ["https://www.example-shop.com/sitemap_products_1.xml"],
  "urls": [],
  "maxPages": 100,
  "maxConcurrency": 2,
  "requestDelayMs": 500,
  "requestTimeoutSecs": 20,
  "respectRobotsTxt": true,
  "includeSeoBasics": true,
  "includeSchemaValidation": true,
  "includeRawDateCandidates": false,
  "dateMismatchToleranceDays": 3,
  "userAgent": "Sitemap Freshness & Schema Integrity Auditor (+https://apify.com/)"
}
```

#### Debug date extraction

Turn on raw date candidates only when you are debugging why a page received a date-related issue. It makes rows more verbose.

```json
{
  "sitemapUrls": ["https://www.your-site.com/sitemap.xml"],
  "urls": [],
  "maxPages": 20,
  "maxConcurrency": 2,
  "requestDelayMs": 250,
  "requestTimeoutSecs": 20,
  "respectRobotsTxt": true,
  "includeSeoBasics": true,
  "includeSchemaValidation": true,
  "includeRawDateCandidates": true,
  "dateMismatchToleranceDays": 3,
  "userAgent": "Sitemap Freshness & Schema Integrity Auditor (+https://apify.com/)"
}
```

### Output

The dataset contains one row per URL. Successful HTML rows include:

- `url`, `normalizedUrl`, `finalUrl`, and `checkedAt`
- `status`: `ok`, `skipped`, or `error`
- `source`: direct or sitemap metadata, including sitemap `lastmod` when available
- `request`: HTTP status, content type, response bytes, redirects, and `Last-Modified`
- `page`: static HTML context such as title, canonical, H1, robots meta, language, and content hash
- `dates`: selected published/modified dates, raw source availability, and best known update date
- `schema`: JSON-LD/schema detection and local validation context
- `freshness`: score, label, and short explanation
- `issues`: detailed deterministic issues with severity, category, message, and optional evidence
- `issueCodes`: unique issue-code strings for filtering and aggregation

The Actor also writes an aggregate run summary to Apify key-value store key `OUTPUT`. The summary includes discovered/queued/checked counts, score distribution, issue counts, top critical URLs, warnings, and cost guardrail flags.

The Actor definition includes Apify output schemas for a default overview table, an issue-focused table, a date-signal table, and the `OUTPUT` run summary record.

### Example output row

```json
{
  "url": "https://www.your-site.com/blog/example-post",
  "normalizedUrl": "https://www.your-site.com/blog/example-post",
  "finalUrl": "https://www.your-site.com/blog/example-post",
  "checkedAt": "2026-07-08T00:00:00.000Z",
  "status": "ok",
  "source": {
    "type": "sitemap",
    "sitemapUrl": "https://www.your-site.com/sitemap.xml",
    "sitemapLastmod": "2026-07-01"
  },
  "request": {
    "httpStatus": 200,
    "contentType": "text/html; charset=utf-8",
    "responseBytes": 123456,
    "redirectCount": 0,
    "lastModifiedHeader": null,
    "fetchError": null
  },
  "dates": {
    "sitemapLastmod": "2026-07-01",
    "httpLastModified": null,
    "bestKnownUpdateDate": "2026-07-01",
    "daysSinceBestKnownUpdate": 7,
    "dateSourcesAvailable": ["sitemap"]
  },
  "schema": {
    "found": true,
    "types": ["Article", "BreadcrumbList", "Organization"],
    "primaryType": "Article",
    "datePublished": "2026-01-10",
    "dateModified": "2026-07-01",
    "validationScope": "local-heuristic",
    "missingRecommendedFields": []
  },
  "freshness": {
    "score": 96,
    "scoreLabel": "Fresh",
    "explanation": "Best known update date is 7 days old; score reflects date completeness, consistency, schema, and SEO context signals."
  },
  "issues": [
    {
      "code": "HTTP_LAST_MODIFIED_MISSING",
      "severity": "info",
      "category": "date-missing",
      "message": "The page did not return an HTTP Last-Modified header."
    }
  ],
  "issueCodes": ["HTTP_LAST_MODIFIED_MISSING"]
}
```

### Freshness score

Scores are clamped from `0` to `100`.

- `90-100`: Fresh
- `70-89`: Adequate
- `50-69`: Needs Attention
- `25-49`: Stale
- `0-24`: Critical
- `null`: Not Scored

Skipped rows, fetch failures, and non-HTML rows are not scored. Their `freshness.score` is `null`.

The score is explainable from issue penalties. It is useful for sorting, but the issue codes should drive action.

### Issue codes

#### Fetch and processing

- `INVALID_INPUT_URL`: an input URL is invalid or unsupported.
- `SITEMAP_FETCH_FAILED`: a sitemap could not be fetched.
- `SITEMAP_PARSE_FAILED`: sitemap XML could not be parsed.
- `SITEMAP_EMPTY`: sitemap parsing produced no URL entries.
- `SITEMAP_INDEX_DEPTH_LIMIT`: sitemap index recursion reached the V1 depth limit.
- `URL_FETCH_FAILED`: a page URL could not be fetched.
- `HTTP_STATUS_NON_200`: a page returned a non-200 HTTP status.
- `NON_HTML_CONTENT`: the response was not HTML.
- `RESPONSE_TOO_LARGE`: the response exceeded the body-size limit.

#### Robots

- `ROBOTS_DISALLOWED`: robots.txt disallowed the page URL.
- `ROBOTS_FETCH_FAILED`: robots.txt could not be fetched; the run continues with a warning.

#### Schema

- `JSON_LD_PARSE_ERROR`: one or more JSON-LD blocks could not be parsed.
- `SCHEMA_NOT_FOUND`: no JSON-LD schema entities were found.
- `SCHEMA_TYPE_MISSING`: schema was found but no type was detected.
- `SCHEMA_RECOMMENDED_FIELD_MISSING`: a local recommended schema field is missing.
- `SCHEMA_DATE_PUBLISHED_MISSING`: content schema is missing `datePublished`.
- `SCHEMA_DATE_MODIFIED_MISSING`: content schema is missing `dateModified`.
- `SCHEMA_MODIFIED_BEFORE_PUBLISHED`: schema `dateModified` is earlier than `datePublished`.

#### Date source availability

- `SITEMAP_LASTMOD_MISSING`: sitemap input was used but the entry has no `lastmod`.
- `HTTP_LAST_MODIFIED_MISSING`: the page response did not include `Last-Modified`.
- `VISIBLE_DATE_MISSING`: no semantic visible date was found on a content page.
- `DATE_PUBLISHED_MISSING`: no reliable published date was found.
- `DATE_MODIFIED_MISSING`: no reliable modified date was found.

#### Date mismatches

- `DATE_MISMATCH_SCHEMA_MODIFIED_VS_SITEMAP_LASTMOD`
- `DATE_MISMATCH_SCHEMA_MODIFIED_VS_HTTP_LAST_MODIFIED`
- `DATE_MISMATCH_SCHEMA_MODIFIED_VS_VISIBLE_MODIFIED`
- `DATE_MISMATCH_SCHEMA_PUBLISHED_VS_VISIBLE_PUBLISHED`
- `DATE_MISMATCH_SITEMAP_LASTMOD_VS_HTTP_LAST_MODIFIED`
- `SITEMAP_LASTMOD_NEWER_THAN_SCHEMA_MODIFIED`
- `HTTP_LAST_MODIFIED_NEWER_THAN_SCHEMA_MODIFIED`
- `VISIBLE_MODIFIED_NEWER_THAN_SCHEMA_MODIFIED`
- `FUTURE_DATE_DETECTED`
- `INVALID_DATE_FORMAT`

#### Staleness

- `CONTENT_OLDER_THAN_90_DAYS`
- `CONTENT_OLDER_THAN_6_MONTHS`
- `CONTENT_OLDER_THAN_12_MONTHS`
- `CONTENT_OLDER_THAN_24_MONTHS`
- `NO_RELIABLE_UPDATE_DATE`

#### SEO context

- `CANONICAL_MISSING`
- `CANONICAL_POINTS_ELSEWHERE`
- `ROBOTS_NOINDEX`

SEO context is included to explain page interpretation. It is not meant to turn this Actor into a broad SEO audit tool.

### Troubleshooting

#### I got `NON_HTML_CONTENT`

The URL returned XML, JSON, text, an image, or another non-HTML content type. If you were trying to audit a sitemap, move that URL into `sitemapUrls` instead of `urls`.

#### I got `ROBOTS_DISALLOWED`

The Actor respected robots.txt and skipped the URL. This is expected when `respectRobotsTxt` is enabled. Only disable this for sites you own, control, or have explicit permission to test.

#### Many rows have `SITEMAP_LASTMOD_MISSING`

The sitemap entries do not include `lastmod`. The Actor can still inspect page/schema signals, but sitemap freshness comparisons will be unavailable.

#### Many rows have `HTTP_LAST_MODIFIED_MISSING`

Many modern sites do not send `Last-Modified` for HTML pages. This is usually an info-level issue if sitemap or schema dates are present.

#### Product pages show `ProductGroup`

That is normal for ecommerce pages that model variants under a top-level product group. The Actor treats `ProductGroup` as the primary ecommerce entity when present.

### Cost notes

Dogfood runs have been cheap with static HTTP:

- Apify Blog: 100 pages cost about `$0.007`.
- Allbirds product sitemap: 100 pages cost about `$0.013`.

A cautious early estimate is roughly `$0.07-$0.13 per 1,000 pages`, assuming similar response sizes and latency. Real costs vary by target site, response size, redirects, failures, and Apify runtime conditions. Measure your own runs before committing to a public pricing model.

# Actor input Schema

## `sitemapUrls` (type: `array`):

XML sitemap URLs to discover HTML pages from. Use this for the strongest audit because sitemap lastmod can be compared with page and schema dates.

## `urls` (type: `array`):

Individual HTML page URLs to check. Do not put sitemap.xml or robots.txt here; put sitemap files in Sitemap URLs.

## `maxPages` (type: `integer`):

Maximum number of pages to analyze after sitemap expansion and URL deduplication.

## `maxConcurrency` (type: `integer`):

Maximum number of pages fetched in parallel. Keep this conservative for polite, low-cost audits.

## `requestDelayMs` (type: `integer`):

Polite delay between requests to the same origin, in milliseconds.

## `requestTimeoutSecs` (type: `integer`):

Timeout for sitemap and page HTTP requests, in seconds.

## `respectRobotsTxt` (type: `boolean`):

Check robots.txt and skip URLs disallowed for this crawler before fetching pages.

## `includeSeoBasics` (type: `boolean`):

Extract title, meta description, canonical, H1, robots meta, Open Graph, and Twitter metadata as context.

## `includeSchemaValidation` (type: `boolean`):

Parse JSON-LD and check common recommended fields for supported Article, Recipe, Product, and organization-style schema.

## `includeRawDateCandidates` (type: `boolean`):

Include all raw date candidates found in schema, meta tags, and visible semantic elements. Useful for debugging, but more verbose.

## `dateMismatchToleranceDays` (type: `integer`):

Number of days allowed between date sources before a mismatch issue is flagged.

## `userAgent` (type: `string`):

User-Agent header used for static HTTP requests.

## Actor input object example

```json
{
  "sitemapUrls": [
    "https://example.com/sitemap.xml"
  ],
  "urls": [
    "https://example.com/blog/post"
  ],
  "maxPages": 100,
  "maxConcurrency": 5,
  "requestDelayMs": 250,
  "requestTimeoutSecs": 20,
  "respectRobotsTxt": true,
  "includeSeoBasics": true,
  "includeSchemaValidation": true,
  "includeRawDateCandidates": false,
  "dateMismatchToleranceDays": 3,
  "userAgent": "Sitemap Freshness & Schema Integrity Auditor (+https://apify.com/)"
}
```

# Actor output Schema

## `results` (type: `string`):

One dataset row per checked URL, with freshness score, issue codes, schema context, date signals, and request metadata.

## `issueReview` (type: `string`):

Dataset rows opened with the issue-focused view selected.

## `dateSignals` (type: `string`):

Dataset rows opened with the date-signal-focused view selected.

## `runSummary` (type: `string`):

Aggregate run summary stored in the default key-value store under OUTPUT.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "sitemapUrls": [
        "https://example.com/sitemap.xml"
    ],
    "urls": [
        "https://example.com/blog/post"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("sebastian-actors/sitemap-freshness-schema-integrity-auditor").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "sitemapUrls": ["https://example.com/sitemap.xml"],
    "urls": ["https://example.com/blog/post"],
}

# Run the Actor and wait for it to finish
run = client.actor("sebastian-actors/sitemap-freshness-schema-integrity-auditor").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "sitemapUrls": [
    "https://example.com/sitemap.xml"
  ],
  "urls": [
    "https://example.com/blog/post"
  ]
}' |
apify call sebastian-actors/sitemap-freshness-schema-integrity-auditor --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=sebastian-actors/sitemap-freshness-schema-integrity-auditor",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Sitemap Freshness & Schema Integrity Auditor",
        "description": "Audit sitemap lastmod, schema dates, and page freshness with static HTTP checks and deterministic issue codes.",
        "version": "0.1",
        "x-build-id": "Iar4bxv1c0kBnFbGX"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/sebastian-actors~sitemap-freshness-schema-integrity-auditor/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-sebastian-actors-sitemap-freshness-schema-integrity-auditor",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/sebastian-actors~sitemap-freshness-schema-integrity-auditor/runs": {
            "post": {
                "operationId": "runs-sync-sebastian-actors-sitemap-freshness-schema-integrity-auditor",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/sebastian-actors~sitemap-freshness-schema-integrity-auditor/run-sync": {
            "post": {
                "operationId": "run-sync-sebastian-actors-sitemap-freshness-schema-integrity-auditor",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "properties": {
                    "sitemapUrls": {
                        "title": "Sitemap URLs",
                        "type": "array",
                        "description": "XML sitemap URLs to discover HTML pages from. Use this for the strongest audit because sitemap lastmod can be compared with page and schema dates.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "urls": {
                        "title": "Additional URLs",
                        "type": "array",
                        "description": "Individual HTML page URLs to check. Do not put sitemap.xml or robots.txt here; put sitemap files in Sitemap URLs.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "maxPages": {
                        "title": "Max pages",
                        "minimum": 1,
                        "maximum": 1000,
                        "type": "integer",
                        "description": "Maximum number of pages to analyze after sitemap expansion and URL deduplication.",
                        "default": 100
                    },
                    "maxConcurrency": {
                        "title": "Max concurrency",
                        "minimum": 1,
                        "maximum": 10,
                        "type": "integer",
                        "description": "Maximum number of pages fetched in parallel. Keep this conservative for polite, low-cost audits.",
                        "default": 5
                    },
                    "requestDelayMs": {
                        "title": "Delay between requests per origin in ms",
                        "minimum": 0,
                        "maximum": 5000,
                        "type": "integer",
                        "description": "Polite delay between requests to the same origin, in milliseconds.",
                        "default": 250
                    },
                    "requestTimeoutSecs": {
                        "title": "Request timeout seconds",
                        "minimum": 5,
                        "maximum": 60,
                        "type": "integer",
                        "description": "Timeout for sitemap and page HTTP requests, in seconds.",
                        "default": 20
                    },
                    "respectRobotsTxt": {
                        "title": "Respect robots.txt",
                        "type": "boolean",
                        "description": "Check robots.txt and skip URLs disallowed for this crawler before fetching pages.",
                        "default": true
                    },
                    "includeSeoBasics": {
                        "title": "Include basic SEO context",
                        "type": "boolean",
                        "description": "Extract title, meta description, canonical, H1, robots meta, Open Graph, and Twitter metadata as context.",
                        "default": true
                    },
                    "includeSchemaValidation": {
                        "title": "Include local schema checks",
                        "type": "boolean",
                        "description": "Parse JSON-LD and check common recommended fields for supported Article, Recipe, Product, and organization-style schema.",
                        "default": true
                    },
                    "includeRawDateCandidates": {
                        "title": "Include raw date candidates",
                        "type": "boolean",
                        "description": "Include all raw date candidates found in schema, meta tags, and visible semantic elements. Useful for debugging, but more verbose.",
                        "default": false
                    },
                    "dateMismatchToleranceDays": {
                        "title": "Date mismatch tolerance days",
                        "minimum": 0,
                        "maximum": 30,
                        "type": "integer",
                        "description": "Number of days allowed between date sources before a mismatch issue is flagged.",
                        "default": 3
                    },
                    "userAgent": {
                        "title": "User agent",
                        "type": "string",
                        "description": "User-Agent header used for static HTTP requests.",
                        "default": "Sitemap Freshness & Schema Integrity Auditor (+https://apify.com/)"
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```
