LLMs.txt Checker - AI Readiness Scanner with Recommendations

Check websites for llms.txt files and provide AI recommendations

Features

• Batch URL Processing: Check hundreds of URLs in a single run
• Full Spec Support: Checks both /llms.txt and /llms-full.txt
• Content Analysis: Parses file structure, sections, and metadata
• AI Recommendations: Get suggestions for improving existing llms.txt files
• Sales Opportunity Identification: Find prospects missing AI optimization
• Webhook Integration: Send results to your CRM or automation tools

Quick Start

{
  "input": "your input here"
}

Demo Mode

Set demoMode: true to test with sample data (no charges). When you're ready for real results, set demoMode: false or omit it.

{
  "demoMode": true,
  ...
}

Input Parameters

Parameter	Type	Required	Description
See input schema

Output Format

Each result includes:

• url: The website checked
• hasLlmsTxt: Whether /llms.txt exists
• hasLlmsFullTxt: Whether /llms-full.txt exists
• fileSize: Size of the llms.txt file
• content: Raw file content
• sections: Parsed sections from the file
• recommendations: AI-generated improvement suggestions
• salesOpportunity: Rating (HIGH/MEDIUM/LOW/NONE) for sales potential

Pricing

This actor uses pay-per-event billing: $0.001 per URL checked (first 100 URLs free in demo mode)

Use Cases

Lead Generation

Scan competitor customer lists or industry directories to find businesses without llms.txt files - perfect prospects for AI optimization services.

SEO Audits

Include llms.txt analysis in your technical SEO audits to identify AI readiness gaps.

Competitive Analysis

See how competitors are presenting themselves to AI systems.

---

Common Problems & Solutions

"Invalid API key" error

Cause: Your API key is wrong, expired, or doesn't have the right permissions. Fix: Double-check your API key. Make sure you copied it exactly without extra spaces.

"Rate limit exceeded" error

Cause: You've hit the API's rate limits. Fix: Wait a few minutes, then try again. Consider reducing the number of concurrent requests.

Empty or incomplete results

Cause: The target may have anti-scraping protection or the data doesn't exist. Fix:

• Check if the URL/search query is correct
• Try with different parameters
• Some sites may block automated access

Demo data showing instead of real results

Cause: demoMode is still set to true. Fix: Set demoMode: false and provide your API key(s).

---

Built by John Rippy | Actor Arsenal