llms.txt Website Auditor

Check websites for llms.txt and llms-full.txt, extract sections and links for AI readiness and GEO audits.

Find public llms.txt, llms-full.txt, and AI-readable documentation links for company domains.

llms-txt-converter is an Apify Actor that crawls any documentation site and outputs the two GEO-standard files (llms.txt and llms-full.txt) used by ChatGPT, Claude, Perplexity, Gemini, and Bing Copilot to find and cite your docs.

LLMs.txt AI Discovery Auditor

glowing_glove/llms-txt-ai-discovery-auditor

Check websites for llms.txt, llms-full.txt, robots AI crawler rules, sitemap hints, and AI search readiness gaps.

llms.txt Generator: llms-full.txt for Any Website (AI SEO)

fayoussef/llms-txt-generator

Generate a spec-compliant llms.txt and llms-full.txt for any website in one run. Crawls your sitemap or internal links, extracts every page's title, meta description and full Markdown content, and outputs two ready-to-upload files for ChatGPT, Claude, Perplexity and Gemini.

AI Crawler Policy Checker: robots.txt & llms.txt

accountable_eel/ai-crawler-policy-lookup

Check what a website's robots.txt says about AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and more) and whether it publishes an llms.txt. Reads the site's own public files directly: no API key, no third-party service. Charged only when an explicit AI policy or llms.txt is found.

llms.txt Validator & Generator

aicrawlready/llms-txt-validator-generator

Validate /llms.txt against the llmstxt.org format with a 0-100 score, per-check pass/warn/fail, broken-link check and fix suggestions, or generate a draft llms.txt from a site's sitemap and page metadata.

LLMS.txt Auditor

junipr/llms-txt-auditor

Check for llms.txt / AI crawler policy guidance and produce structured readiness reports.

Crawl a website and generate an llms.txt file (the emerging standard that helps LLMs and AI agents understand your site). Optionally build llms-full.txt with full page content. Output saved to the key-value store.

Audit a website for /llms.txt and /llms-full.txt AI discovery readiness. Get a readiness score, markdown structure summary, and actionable recommendations. Built for GEO/AI-SEO consultants, documentation teams, and devrel.