The Artifact Machine AI Access Audit

A small artifact for checking whether AI search engines and AI assistants can access, cite, and understand a website.

Use this Actor before a site launch, content refresh, SEO review, or AI visibility campaign. It gives teams a fast crawlability and AI-access report for one target URL.

Pulled from The Artifact Machine: generated, tested, and cleaned up by a human.

What It Checks

• robots.txt policy for AI search, AI user-agent, and training crawlers
• llms.txt and llms-full.txt presence and basic structure
• XML sitemap presence, lastmod coverage, and freshness
• HTTPS, canonical, noindex, and nosnippet page access signals

Best For

• SEO and GEO audits
• Agency client diagnostics
• Site launch checks
• AI answer visibility reviews
• Monthly crawlability monitoring

Input

{
  "url": "https://example.com",
  "includeRawContent": false
}

Input Fields

• url: homepage or canonical page URL to audit.
• includeRawContent: optional debugging flag that includes truncated robots.txt and llms.txt snippets in the output.

Output

The Actor writes one dataset item and an OUTPUT key-value record with:

• composite score and grade
• issue counts by severity
• check summaries for robots, llms, sitemap, and page access
• actionable issues with impact and how-to-fix guidance

Example output fields:

• score: 0-100 composite AI access score
• grade: A-F score band
• issueCounts: issue totals by severity
• checks.robotsTxt: AI crawler policy results
• checks.llmsTxt: AI guidance file results
• checks.sitemap: sitemap presence and freshness
• checks.pageAccess: HTTPS, canonical, noindex, and snippet access
• issues: prioritized fix list

Limits

• This Actor audits one submitted URL and the root-level policy files for that URL's origin.
• It does not crawl an entire site.
• It does not guarantee indexing or citation by any search engine or AI product.
• Some sites block automated requests differently from regular browsers, so results should be reviewed before client delivery.

Pricing

Use pay-per-event pricing based on completed reports rather than per issue. The recommended first paid event is audit-completed.