Go to example tasks
Generate and validate an llms.txt draft
Created by
Checksmith Cats
Create llms.txt and robots.txt snippets from submitted resources, validate their basic shape, and review an evidence pack before publishing any files.
llms.txt Generator + Validatorchecksmithcats/llms-txt-generator-validator
Product
Check id
Title
Severity
+3 fieldsTextNumberBooleanListObject
Input
Site name(required):Example Docs
Site URL:https://example.com
Site description:Documentation and public resources for Example Docs.
Policy notes:This file lists the public resources that Example Docs wants to make easy to inspect.
Resource entries
Resource title(required):Documentation+1
Resource URL(required):https://example.com/docs+1
Resource description:Primary documentation entry point.+1
Section:Docs+1
robots.txt crawler rules
User-agent(required):GPTBot+1
Directive(required):Disallow+1
Path:/+1
Generate robots.txt snippet:true
Output fields
Product
Check id
Title
Severity
Subject id
Summary
Generated at
Sign up on Apify01
Create your Apify account to access the llms.txt Generator + Validator.
Start the run02
The Actor will start running based on the input automatically.
Receive the output03
Monitor the progress in real-time. You will be notified as soon as your dataset is complete and ready for review.
Integrate into your workflow04
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow.
