Pricing

$250.00 / 1,000 completed audits

AI Access Audit (robots.txt + llms.txt)

How does a site present itself to AI? Per-crawler robots.txt verdicts for 13 major AI user agents (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and more), llms.txt presence and shape, sitemap signals, and a concrete fix list. Charged only when the audit completes.

Pricing

$250.00 / 1,000 completed audits

Rating

0.0

(0)

Developer

Chris Arsenault

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

What it checks

robots.txt policy, per AI crawler: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-Web, anthropic-ai, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, CCBot, Bytespider, meta-externalagent. Each gets a verdict — blocked, partial, allowed, or unaddressed — plus the exact rule that decides it. Training crawlers and on-behalf-of-user agents are labeled by purpose, because blocking one and not the other is usually a deliberate choice.
llms.txt: present or not, and whether it has the shape consumers expect (sections, markdown links) or is just a stub.
Sitemap: declared in robots.txt, and reachable.
Recommendations: a short, specific fix list — never generic advice.

Output

A summary row plus one row per crawler:

{ "agent": "GPTBot", "purpose": "OpenAI training", "verdict": "unaddressed",
  "basis": "no applicable rules (crawlers default to allowed)" }

Why "unaddressed" matters

Most sites have never stated an AI policy at all — which means every AI crawler assumes full access. Whether that is fine or a problem is a business decision; this audit makes the current state explicit so someone can actually decide.

Use cases

Agencies: the AI-visibility line item for every site audit, generated in seconds.
Publishers deciding an AI stance: see the current posture before changing it, then re-run to verify the change took.
Agents doing due diligence: check whether a data source permits AI access before building on it.

Billing is per completed audit; three or four polite GETs per run. Built by 1450 Enterprises, the team behind the WordPress Content Audit and MCP Server Probe.

AI SEO Audit: robots.txt, llms.txt & 26 AI Crawlers

aiqlabs/seo-ai-visibility-auditor

Crawls a site from one starting URL and reports how visible it is to AI: which AI crawlers robots.txt admits, whether llms.txt exists, and what structured data and metadata each page offers. Give it a domain to crawl - for a fixed list of pages, use SEO Audit Tool instead.

Ai-Q Labs

AI Visibility Site Audit — robots.txt & llms.txt checks

43sunsets/ai-visibility-site-audit

Evidence-based audit of your own website: which AI crawlers robots.txt lets in (RFC 9309, 21 user-agent and control tokens, checked against the operators' own docs), which pages are discoverable, and each page's technical readiness — a ticket-grade fix plan with honest coverage disclosure.

Ken Yao

AI Crawler Policy Auditor

junipr/ai-crawler-policy-auditor

Audit robots and AI crawler policy signals for AI crawler access, blocking, and site-readiness.

junipr

AI Crawler Access Auditor

kingii98/ai-crawler-access-auditor

Audit which AI crawlers can access a site via robots.txt, llms.txt, and sitemap signals for GPTBot, ClaudeBot, PerplexityBot, and more.

kingii98

GEO Site Audit - AI Readiness Checker

dltik/geo-site-audit

Audit your website for AI crawler accessibility: robots.txt (GPTBot, ClaudeBot, Perplexity), llms.txt, sitemap, Schema.org, meta tags, content extractability, TTFB. Get an AI-readiness score 0-100 with prioritized recommendations.

Walid

5.0

(1)

GEO Auditor — AI Search Readiness & Citability Audit

foxlabs/geo-auditor

Audit how ready your site is to be found, read & cited by AI search (ChatGPT, Perplexity, Gemini, Claude). Checks AI-crawler access, structured data, content extractability, speed & trust — scored 0-100 with a prioritized fix list. GEO / AEO technical audit.

Berkan Kaplan

AI Readability Checker — Can ChatGPT & Claude Read Your Site?

eliai/ai-readability-checker

Audit a site the way AI crawlers see it: robots.txt rules per bot (GPTBot, ClaudeBot, PerplexityBot), real per-bot fetches, and how much text exists before JavaScript runs. Weighted from crawler logs, not blog advice. $0.05 per audit.

Anthony Snider

The Artifact Machine - AI Access Audit

artifact-machine/artifact-machine-ai-access-audit

A small artifact for checking whether AI search engines and AI assistants can access, cite, and understand a website.

The Artifact Machine

AI Crawler Robots.txt Audit & llms.txt Checker

davidbenittah/ai-crawler-robots-audit

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.