AI llm.txt File Generator API
Pricing
$30.00 / 1,000 llm.txt file generations
Go to Apify Store
AI llm.txt File Generator API
Generate llm.txt files automatically for any website. Map website directories and convert documentation into clean markdown structured llm.txt files for LLM agents.
llm.txt File Generator Actor
Map directories and compile website documentation pages into the standard llm.txt markdown format optimized for LLMs and AI agents (such as Cursor, ChatGPT, and Copilot).
Features
- URL Mapping: Automatically crawls and lists all sub-URLs for a target base URL to compile documentation context.
- AI-Agent Ready Markdown: Converts website HTML/content into formatted markdown, stripping header/footer noise.
- Pay-Per-Event pricing: Monetized per event at a cost of $0.005 (half a cent) per successful generation.
- Flexible Options: Specify custom lists of sub-pages manually or let the directory crawler auto-discover them.
Input Configuration
The actor accepts the following JSON input parameters:
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
url | string | Yes | - | Website base URL to map and convert (e.g. https://apify.com/). |
urls | array | No | - | Explicit list of sub-URLs to parse. Auto-discovered if omitted. |
Example Input
Dataset Output
Each execution pushes matched song records directly to the Apify dataset:
| Field | Type | Description |
|---|---|---|
success | boolean | Indicates if the generator succeeded. |
baseUrl | string | Base URL of the crawled website. |
mappedUrlsCount | integer | Number of child pages included. |
mappedUrls | array | List of all child URLs included. |
llmTxtContent | string | Compiled raw markdown output representing the llm.txt file. |
