AI Agent Readiness Audit (llms.txt, AI Crawlers, Schema) avatar

AI Agent Readiness Audit (llms.txt, AI Crawlers, Schema)

Pricing

from $15.00 / 1,000 website auditeds

Go to Apify Store
AI Agent Readiness Audit (llms.txt, AI Crawlers, Schema)

AI Agent Readiness Audit (llms.txt, AI Crawlers, Schema)

Score any website 0 to 100 for AI search and agents: llms.txt, ChatGPT, Claude and Perplexity crawler access, structured data, server-rendered content and API or MCP discovery, with prioritised fixes.

Pricing

from $15.00 / 1,000 website auditeds

Rating

0.0

(0)

Developer

Pagecraft Tools

Pagecraft Tools

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 hours ago

Last modified

Categories

Share

AI Agent Readiness Audit: llms.txt, AI Crawler Access and Schema Checker

Check how ready any website is for AI search and AI agents (ChatGPT, Claude, Perplexity, Gemini). Get a score out of 100, a grade and a prioritised list of fixes. Like an SEO audit, for AI answers.

What it checks

  • 📄 llms.txt and llms-full.txt
  • 🤖 AI crawler access in robots.txt for 14 bots: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, CCBot, Meta-ExternalAgent, Bytespider and Amazonbot
  • 🧩 Structured data (schema.org JSON-LD), including an Organization block
  • 📝 Content readable without JavaScript (many AI crawlers do not run it)
  • 🗺️ Sitemap, meta description and HTTPS
  • 🔌 Machine interfaces: OpenAPI, MCP manifest or AI plugin manifest

Input

FieldWhat to enter
Domains or URLsacme.com, a URL or an email address; one per line, duplicates removed
{ "domains": ["acme.com", "example.org"] }

Output

Each website gets score (0 to 100), grade (A to E), every check with pass or fail, recommendations ordered by impact, the llms.txt preview and a per-bot table showing whether each AI crawler is allowed and which robots.txt rule decides it.

Who it's for

SEO and marketing agencies auditing clients, website owners checking AI visibility, and anyone building lead lists of sites that need help with AI search.

Pricing

Pay per website audited. See the Pricing tab. Websites that fail or block us cost a flat $0.001 each, because they still use server time. Set Maximum cost per run to cap your spend. Give the run more memory to go faster (4 websites at once per GB). Residential proxies are not supported.

EventWhen it is chargedPrice per 1,000 (Free / Bronze / Silver / Gold plan)
Website auditedEach website audited and returned.$20 / $18 / $16 / $15
Website failedA website that could not be reached or blocked us (it still uses server time).$1.50 on every plan

Notes

The score reflects publicly visible signals and is a guide, not a guarantee of AI search ranking. robots.txt is evaluated for the home page path using standard longest-match rules.