Pricing

$20.00 / 1,000 readiness reports

Try for free

Go to Apify Store

AI Crawler Readiness Audit & llms.txt Draft

Try for free

Audits public robots.txt rules for eight crawler tokens, HTTP headers, llms.txt and JSON-LD. Produces evidence-based drafts and local readiness heuristics. Does not measure citations in AI answers or guarantee rankings.

Pricing

$20.00 / 1,000 readiness reports

Rating

0.0

(0)

Developer

HirePulse

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

SEO tools

Developer tools

Brand Domain

domain

Required

Public website domain to inspect for crawler-readiness evidence; not a measurement of AI-answer citations.

Type:string

Max. length:253

Example:

linear.app

Competitor Domains (Up to 3)

competitor_domains

Optional

Competitor domains to run head-to-head GEO benchmarking against (e.g. 'asana.com', 'monday.com').

Type:string[]

Max. items:3

Example:

[
  "asana.com",
  "monday.com"
]

Target Category Keywords

category_keywords

Optional

Optional category phrases for autocomplete suggestions. Suggestions can be ambiguous; they are not AI-answer citations.

Type:string[]

Max. items:10

Example:

[
  "issue tracking software",
  "project management tool"
]

Generate Ready llms.txt & Fix Kit

generate_ready_llms_txt

Optional

Generate a draft using observed facts only; review before publishing. No merchant policies, pricing or certifications are inferred.

Type:boolean

Default:true

AI Search Readiness Checker

epistemedeus/ai-search-readiness-checker

Audit public website signals that affect machine readability: HTML retrieval, metadata, JSON-LD, robots.txt, sitemap, and llms.txt. Get a disclosed technical score, evidence URLs, concrete fixes, and explicit limits. No ranking or citation claims.

Lucian Constantinescu

AI Brand Visibility

adityalingwal/AI-brand-Visibility

Track your brand visibility across AI platforms (ChatGPT and Gemini). Analyze mentions, citations, and competitive positioning.

Aditya Lingwal

111

4.2

(7)

AI Crawler Access Checker

zinin/ai-crawler-access-checker

Audit up to 100 sites for 16 AI crawler policies. Get search vs training verdicts, robots.txt and llms.txt evidence, confidence, unknown states, priorities, and next actions for GEO/AEO reviews.

Tim Zinin

5.0

(6)

llms.txt Checker: AI Search Readiness Audit

apifmcpfactory/llms-txt-checker

Audits whether a website is readable by AI assistants (llms.txt, robots.txt AI-crawler access, sitemap) and returns a 0-100 score with concrete fixes - use when asked whether a site is visible to ChatGPT/Claude or how to improve that; $0.005 per site audited.

Howth Technology Factory

AI Crawler Access and llms.txt Visibility Panel

lavender_whistle/ai-visibility-panel

Track which AI crawlers each website blocks or allows (GPTBot, ClaudeBot, CCBot, Google-Extended, PerplexityBot, Bytespider and more) plus whether it adopted the llms.txt standard. One clean row per domain from public robots.txt and llms.txt. Zero-config default run, no login, no PII.

Cathal Judge

AI Visibility Audit — AEO / GEO Consultant

bovi/ai-visibility-audit

Audit a brand's AI-search visibility across its key queries. Structured rows: per-query AI Overview presence, brand citations, organic rank, citation gaps, outreach targets, plus a roll-up with share-of-voice and recommended focus. Pay per row.

Vitalii Bondarev

AI Search Visibility Checker

seeb/ai-search-visibility-checker

Check public pages and search-style result pages for target brand, domain, topic, and competitor visibility signals.

Techionik

Robots AI Crawler Policy Checker

seeb/robots-ai-crawler-policy-checker

Analyze robots.txt and crawler policy text for AI bot access rules, disallow paths, sitemap references, and blocked model-training crawlers.

Techionik

Website SEO, Accessibility & AI Readiness Auditor

feeng/website-seo-ai-readiness-auditor

🔎 Crawl websites and turn technical SEO, accessibility, security, performance, broken-link, structured-data, robots.txt, llms.txt, and AI crawler signals into prioritized 0–100 audit scores and client-ready reports.