llms.txt Generator & Website AI Readiness Scraper API
Pricing
$0.50 / 1,000 domain whois checkeds
Go to Apify Store
llms.txt Generator & Website AI Readiness Scraper API
Audit any website for /llms.txt and /llms-full.txt standards or automatically generate a clean, structured llms.txt Markdown index from site navigation and docs for Claude, ChatGPT, Perplexity & Cursor ($0.50/1k sites).
Pricing
$0.50 / 1,000 domain whois checkeds
Rating
0.0
(0)
Developer
Ömürsel Ocakcı
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
a day ago
Last modified
Categories
Share
llms.txt Checker & Generator | Audit or Build llms.txt for Any Website — Modern web visibility & developer documentation tool: audits existing /llms.txt files and generates a ready-to-deploy llms.txt markdown map for any domain.
Key Capabilities & Performance Advantages
- Direct Structured Extraction: Engineered with high-speed HTTP and structured API/DOM parsers—zero headless browser overhead and minimal compute cost.
- Pay-Per-Event Billing (
llmstxt-generated): Transparent event-based pricing ($0.004 per record). - Automated Daily Reliability: Built-in fallback defaults ensure 100% dataset stability for scheduled pipelines, Make, n8n, Zapier, Clay, and REST API workflows.
Sample Input JSON
{"domains": ["apify.com","cloudflare.com"],"maxItemsPerTarget": 10}