AI Search (GEO) Audit & llms.txt Generator – ChatGPT, Claude, Perplexity

Check if ChatGPT, Claude, Perplexity, Gemini & Copilot crawlers can access and understand your site. Get a GEO readiness score, robots.txt AI bot report, schema & content checks – and a ready-to-publish llms.txt.

What does it do?

Find out whether ChatGPT, Claude, Perplexity, Gemini, Copilot and other AI assistants can access, understand and cite your website – the new discipline called GEO (Generative Engine Optimization) or AEO. For every site you get a GEO readiness score (0–100), a robots.txt report for 19 AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot…), llms.txt / llms-full.txt detection, structured data (schema.org) and entity checks, server-rendered content check (most AI crawlers do not run JavaScript), sitemap, meta and Open Graph checks, prioritized fixes – and an automatically generated llms.txt file built from your sitemap, ready to upload.

Why use it?

• SEO & marketing agencies: sell GEO / AI-visibility audits to clients.
• Website owners: make sure you are not accidentally blocking AI search bots (lost traffic) while you can still block training bots.
• Publishers: control the training vs. search split of AI crawlers.
• Developers: create an llms.txt in seconds.

Quick start

1. Click Try for free / Start.
2. Paste your list (the example input already works – just press Start).
3. Download results as JSON, CSV, Excel or HTML, or use the API, schedules and integrations (Make, Zapier, n8n, Slack, Google Sheets…).

Input example

{
  "startUrls": [{ "url": "https://apify.com" }],
  "generateLlmsTxt": true,
  "maxPagesForLlmsTxt": 25
}

Output example

{
  "domain": "example.com",
  "geoScore": 68,
  "grade": "C",
  "aiSearchBotsBlocked": ["PerplexityBot"],
  "aiTrainingBotsBlocked": ["GPTBot", "CCBot"],
  "hasLlmsTxt": false,
  "schemaTypes": ["Organization", "WebSite"],
  "serverRenderedWordCount": 812,
  "issues": [{ "severity": "high", "code": "AI_SEARCH_BOTS_BLOCKED", "fix": "Allow these user agents in robots.txt…" }],
  "generatedLlmsTxtUrl": "https://api.apify.com/v2/key-value-stores/…/records/llms-example.com.txt"
}

Pricing

Pay only for results: $20.00 per 1,000 websites (pay-per-event). No subscription. Platform usage is included in the price. You can set a maximum cost per run and the Actor stops before exceeding it.

FAQ

What is llms.txt?

A proposed standard (llmstxt.org): a Markdown file at /llms.txt that gives AI assistants a curated map of your most important pages.

Does it crawl my whole site?

No. It reads robots.txt, llms.txt, the homepage and up to N pages from your sitemap (default 25), respecting robots.txt rules.

Are failed sites charged?

No. Sites that cannot be reached are listed in FAILED_INPUTS and are free.

Legal & responsible use

This Actor only accesses publicly available data and official public APIs, respects robots.txt where applicable and paces its requests. You are responsible for using the results in line with applicable laws (e.g. GDPR/CCPA) and the terms of the data sources.

Support

Found a bug or need a feature? Open an issue on the Actor’s Issues tab – we usually reply within 24 hours. Check our other tools: Website SEO & Broken Link Auditor, B2B Lead & Tech Stack Intelligence, Shopify Product Scraper and ATS Jobs Scraper.