Llms Txt Generator

Pricing

Pay per usage

Try for free

Go to Apify Store

Llms Txt Generator

Try for free

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Francis Marzyński

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

llms.txt Generator - Apify Actor

Generate world-class llms.txt files for any website using AI.

What is llms.txt?

The llms.txt standard helps AI assistants understand your website content. It's like robots.txt, but for LLMs.

Features

🕷️ Smart Crawling: Uses sitemap when available, falls back to link following
🤖 AI-Powered: LLM generates semantically perfect descriptions
📊 World-Class Output: Quick facts, service disambiguation, contact info
⚡ Fast: Parallel crawling with rate limiting

Input

{
    "url": "https://example.com",
    "apiKey": "sk-or-v1-xxx",
    "maxPages": 20,
    "model": "openai/gpt-oss-120b:free"
}

Output

The generated llms.txt is available in:

Dataset: Full JSON with metadata
Key-Value Store: Raw llms.txt file

Example Output

# Example Corp

> Leading provider of cloud solutions for enterprise customers.

## Quick Facts
- Industry: Cloud Computing
- Location: San Francisco, CA
- Key offerings: Cloud hosting, DevOps tools, managed databases

## Services
- [Cloud Hosting](url): Scalable infrastructure for applications of any size.
- [DevOps Platform](url): CI/CD pipelines and deployment automation.

## Topics
cloud computing, hosting, devops, enterprise, saas

Getting an API Key

Go to openrouter.ai
Sign up for free
Get your API key
Use free models like openai/gpt-oss-120b:free

/llms.txt Generator

jakub.kopecky/llmstxt-generator

The /llms.txt Generator 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

Jakub Kopecký

696

4.7

(3)

LLMs.txt generator

antonio_espresso/llms-txt-generator

Generates a clean and structured markdown format for your AI Agents LLMs.txt file. Helps define AI agent interactions, improve SEO, and ensure compatibility across platforms. Ready to integrate into your website for better transparency and control.

Antonio Blago

The LLMS.TXT Generator | Hi LLMS

onescales/the-llms-txt-generator

The most powerful tool online to generate LLMS - llms.txt , llms-full.txt and markdown .md files within seconds! Get your website discovered, and recommended by ChatGPT, Claude, Google Gemini, Perplexity, Grok, and every AI. (Great for AEO, AIO, GEO, SEO) Transform your site to AI-friendly today!

One Scales

5.0

(3)

LLMs.txt File Generator

justa/llms-txt-file-generator

Generate an llms.txt file from a website sitemap. Crawls all URLs, extracts titles and meta descriptions, and creates a Markdown-formatted file following the llms.txt specification. Upload then the output of your file directly on your website (Webflow, Wordpress etc.)

Benoit Eveillard

Html to Markdown Converter

antonio_espresso/html-to-markdown-converter

Crawl a target URL and convert its HTML content into clean, structured Markdown with optional heading-based chunking.

Antonio Blago

AI Technical SEO MCP Server

alizarin_refrigerator-owner/ai-technical-seo-mcp-server

AI-ready technical SEO auditing with 7 specialized tools. Check robots.txt, llms.txt, generate sitemaps, run Lighthouse & GTmetrix audits, test rich results, and perform comprehensive technical SEO audits - all through a unified MCP interface.

John Rippy

Robots.txt Checker - CMS-Aware Analysis with AI Recommendations

alizarin_refrigerator-owner/robots-txt-checker

The Robots.txt Checker provides comprehensive analysis of your robots.txt file: Syntax Validation CMS Detection - Identify WordPress, Shopify, Drupal,& 6+ other CMS platforms Best Practice Check Companion File Checks - sitemap.xml, llms.txt, security.txt AI Recommendations - CMS-specific suggestions

John Rippy

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

codescraper/website-metadata-extractor

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $3/month.

CodeScraper

5.0

(1)

Mcp Server Generator

fiery_dream/mcp-server-generator

Cody Churchwell

Markdown Maker: HTML to Text 📝

shahidirfan/Markdown-Maker

Instantly convert complex HTML into clean, structured Markdown. This lightweight actor is optimized to render web content into a format that is easily readable for AI LLMs, reducing token usage and improving context. Perfect for RAG pipelines and preparing data for training.