Pricing

from $20.00 / 1,000 site auditeds

AI Crawlability Auditor | llms.txt robots & Schema Check

Score a site for AI crawlability: llms.txt, GPTBot/ClaudeBot/Perplexity robots rules, schema.org, sitemap, and JS-free content. $0.02/site + $0.02 start.

Pricing

from $20.00 / 1,000 site auditeds

Rating

0.0

(0)

Developer

Andok

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

AI Crawlability Auditor

Score a website for AI/search-bot crawlability: llms.txt, robots rules for GPTBot/ClaudeBot/PerplexityBot/Google-Extended/CCBot, schema.org JSON-LD, canonical/meta tags, sitemap reachability, and JS-free content length.

Input

Field	Required	Description
url	one of	Single site
urls	one of	Bulk list
timeoutSeconds	no	Default 15

Output example

{
  "url": "https://www.anthropic.com",
  "score_0_100": 78,
  "checks": [
    { "id": "llms_txt", "pass": true, "detail": "Found llms.txt", "fix_hint": "..." }
  ],
  "audited_at": "2026-07-23T12:00:00.000Z"
}

Cost

Actor start: $0.02
Per site: $0.02
Typical 5-site run: ~$0.12

Limitations

Static HTML only (no Playwright).
Bot allow/deny parsing covers common robots.txt patterns, not every edge case.

Reviews

If this Actor helped, leave a short Store review.

AI Crawlability Auditor | llms.txt robots & Schema Check

eesti/ai-crawlability-auditor

Score a site for AI crawlability: llms.txt, GPTBot/ClaudeBot/Perplexity robots rules, schema.org, sitemap, and JS-free content. $0.02/site + $0.02 start.

ando

GEO Site Audit - AI Readiness Checker

dltik/geo-site-audit

Audit your website for AI crawler accessibility: robots.txt (GPTBot, ClaudeBot, Perplexity), llms.txt, sitemap, Schema.org, meta tags, content extractability, TTFB. Get an AI-readiness score 0-100 with prioritized recommendations.

Walid

5.0

Robots.txt & Sitemap Discovery API

213x/robots-sitemap-discovery

Discover robots.txt rules, sitemap URLs, crawl delays, and basic crawlability signals for domains or website URLs.

AI Crawler Robots.txt Audit & llms.txt Checker

davidbenittah/ai-crawler-robots-audit

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.

David

AI Visibility Site Audit — robots.txt & llms.txt checks

43sunsets/ai-visibility-site-audit

Audit how visible your own website is to AI crawlers and assistants: robots.txt rules for 13 AI bots, llms.txt, structured data, meta hygiene and sitemap — with a scored report and a ready-to-edit llms.txt draft.

Ken Yao

llms.txt Generator: Make Any Website AI-Readable

apifmcpfactory/llms-txt-generator

Generates a spec-compliant llms.txt file for any website from the site's own pages and metadata (no AI invention) - the fix when an AI-readiness audit finds llms.txt missing; $0.02 per site.

Howth Technology Factory

AI Readiness Auditor

rationalistic_counsel/ai-readiness-auditor

Check how AI-ready any website is. Get an AI Readiness Score (0-100) checking llms.txt, robots.txt AI crawler directives, Schema.org structured data, and meta tags. No API key needed.

J N

AI Crawler Access Checker

zinin/ai-crawler-access-checker

Check which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended & more) can access your website. Bulk audit of robots.txt rules, llms.txt presence and sitemap for AI search visibility (GEO/AEO).