Under maintenance

Pricing

Pay per usage

Try for free

Go to Apify Store

Llms Txt Generator

Under maintenance

Try for free

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Francis Marzyński

Actor stats

Bookmarked

Total users

Monthly active users

9 days ago

Last modified

llms.txt Generator - Apify Actor

Generate world-class llms.txt files for any website using AI.

What is llms.txt?

The llms.txt standard helps AI assistants understand your website content. It's like robots.txt, but for LLMs.

Features

🕷️ Smart Crawling: Uses sitemap when available, falls back to link following
🤖 AI-Powered: LLM generates semantically perfect descriptions
📊 World-Class Output: Quick facts, service disambiguation, contact info
⚡ Fast: Parallel crawling with rate limiting

Input

{
    "url": "https://example.com",
    "apiKey": "sk-or-v1-xxx",
    "maxPages": 20,
    "model": "openai/gpt-oss-120b:free"
}

Output

The generated llms.txt is available in:

Dataset: Full JSON with metadata
Key-Value Store: Raw llms.txt file

Example Output

# Example Corp

> Leading provider of cloud solutions for enterprise customers.

## Quick Facts
- Industry: Cloud Computing
- Location: San Francisco, CA
- Key offerings: Cloud hosting, DevOps tools, managed databases

## Services
- [Cloud Hosting](url): Scalable infrastructure for applications of any size.
- [DevOps Platform](url): CI/CD pipelines and deployment automation.

## Topics
cloud computing, hosting, devops, enterprise, saas

Getting an API Key

Go to openrouter.ai
Sign up for free
Get your API key
Use free models like openai/gpt-oss-120b:free

/llms.txt Generator

jakub.kopecky/llmstxt-generator

The /llms.txt Generator 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

Jakub Kopecký

712

4.7

The LLMS.TXT Generator | Hi LLMS

onescales/the-llms-txt-generator

The most powerful tool online to generate LLMS - llms.txt , llms-full.txt and markdown .md files within seconds! Get your website discovered, and recommended by ChatGPT, Claude, Google Gemini, Perplexity, Grok, and every AI. (Great for AEO, AIO, GEO, SEO) Transform your site to AI-friendly today!

One Scales

5.0

LLMs.txt File Generator

justa/llms-txt-file-generator

Generate an llms.txt file from a website sitemap. Crawls all URLs, extracts titles and meta descriptions, and creates a Markdown-formatted file following the llms.txt specification. Upload then the output of your file directly on your website (Webflow, Wordpress etc.)

Benoit Eveillard

LLMs.txt generator

antonio_espresso/llms-txt-generator

Generates a clean and structured markdown format for your AI Agents LLMs.txt file. Helps define AI agent interactions, improve SEO, and ensure compatibility across platforms. Ready to integrate into your website for better transparency and control.

Antonio Blago

LLMs.txt Checker - AI Readiness Scanner

alizarin_refrigerator-owner/llms-txt-checker

Batch check websites for llms.txt files & identify AI optimization opportunities. A emerging standard that websites use to communicate with AI systems. It helps LLMs understand, What the company does, How to present information about the business, Contact information & key pages Brand guidelines

John Rippy

Robots.txt Checker - CMS-Aware Analysis with AI Recommendations

alizarin_refrigerator-owner/robots-txt-checker

The Robots.txt Checker provides comprehensive analysis of your robots.txt file: Syntax Validation CMS Detection - Identify WordPress, Shopify, Drupal,& 6+ other CMS platforms Best Practice Check Companion File Checks - sitemap.xml, llms.txt, security.txt AI Recommendations - CMS-specific suggestions

John Rippy

Ai Visibility Suite - Dark Visitors Alternative

alizarin_refrigerator-owner/ai-visibility-suite---dark-visitors-alternative

Comprehensive AI bot monitoring, robots.txt analysis, LLMs.txt generation & AI shopping optimization. Monitor AI crawlers visits, check AI compliance, generate AI-friendly configurations, and optimize for AI shopping agents. AI Bot Directory Robots.txt LLMs.txt AI Shopping Competitor AI Audit

John Rippy

Fast Sitemap Generator

eunit/sitemap-generator

Boost SEO with this automatic Sitemap Generator. Crawl any site to create XML, HTML, & TXT sitemaps. Supports custom depth, regex filters, & robots.txt. Compatible with Google Search Console.

Emmanuel Uchenna

5.0

AI Readiness Checker - Website Scanner

alizarin_refrigerator-owner/ai-readiness-checker

Analyze any website for AI optimization readiness. Check robots.txt, llms.txt, structured data, meta tags & content quality. Get actionable recommendations to improve AI crawler accessibility.

John Rippy