AI Readiness Audit Example: llms.txt and AI Crawler Check

Created by

Howth Technology Factory

Actor

llms.txt Checker: AI Search Readiness Audit

Live example auditing docs.anthropic.com, docs.stripe.com, wordpress.org and irishtimes.com for llms.txt, AI crawler access and sitemaps, scored 0 to 100.

Try for free

llms.txt Checker: AI Search Readiness Auditapifmcpfactory/llms-txt-checker

URL

AI readiness (0-100)

Reasons

Error

Input

Website URLs(required):https://docs.anthropic.com+3

Max concurrency:10

Output fields

URL

AI readiness (0-100)

Reasons

Error

How it works

Sign up on Apify or log in

The llms.txt Checker: AI Search Readiness Audit Actor is ready to run with the inputs already set for "AI Readiness Audit Example: llms.txt and AI Crawler Check". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "AI Readiness Audit Example: llms.txt and AI Crawler Check" task

The llms.txt Checker: AI Search Readiness Audit Actor will start running based on the input automatically. You can also change all the input fields, like website urls and max concurrency, to match your specific use case.

Receive the "AI Readiness Audit Example: llms.txt and AI Crawler Check" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as URL, AI readiness (0-100), reasons, and more.