Deprecated

Pricing

Pay per usage

See alternative Actors

Go to Apify Store

Llms Txt Generator

Deprecated

See alternative Actors

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Francis Marzyński

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

Categories

SEO tools

Developer tools

Website URL

url

Required

The URL of the website to generate llms.txt for

Type:string

OpenRouter API Key (Optional if OpenAI key provided)

apiKey

Optional

Your OpenRouter API key (get one free at openrouter.ai). Required unless you provide an OpenAI API key.

Type:string

OpenAI API Key (Optional if OpenRouter key provided)

openaiApiKey

Optional

Your OpenAI API key. If provided, this will be used instead of OpenRouter. Required unless you provide an OpenRouter API key.

Type:string

Max Pages

maxPages

Optional

Maximum number of pages to crawl (15 is usually enough)

Type:integer

Minimum:1

Maximum:50

Default:15

LLM Model

model

Optional

Model to use. Selected model will be automatically adapted for the chosen provider (OpenRouter or OpenAI).

Type:string

Default:openai/gpt-oss-120b:free

Options:

openai/gpt-oss-120b:freegoogle/gemini-2.0-flash-exp:freemeta-llama/llama-3.1-8b-instruct:freeopenai/gpt-4o-minianthropic/claude-3.5-sonnetgpt-4ogpt-4o-minigpt-3.5-turbogpt-5.2-chat-latestgpt-5.1

Render JavaScript

renderJavaScript

Optional

Enable for JavaScript-heavy sites (SPAs, React, Vue, etc.). Uses a headless browser which is slower but can handle dynamic content. Leave OFF for static sites.

Type:boolean

Default:false

Generate llms.txt

generateLlmsTxt

Optional

Generate the main llms.txt file for AI assistants to understand your website.

Type:boolean

Default:true

Generate Organization Schema (schema.json)

generateOrganizationSchema

Optional

Generate JSON-LD Organization schema markup for search engines (Google, Bing). Improves SEO and knowledge panel appearance.

Type:boolean

Default:false

Generate FAQ Schema (faq-schema.json)

generateFaqSchema

Optional

Generate JSON-LD FAQPage schema from extracted content. Helps achieve rich FAQ snippets in search results and voice search optimization.

Type:boolean

Default:false

Number of FAQ Questions

faqQuestionCount

Optional

How many FAQ questions to generate. 6-15 recommended for rich results.

Type:integer

Minimum:3

Maximum:20

Default:8

FAQ Categories (Optional)

faqCategories

Optional

Organize FAQs by category. Leave empty for auto-detection. Examples: Pricing, Features, Getting Started, Support, Security.

Type:array

Default:

[]

Include Rich Metadata

faqIncludeMetadata

Optional

Add author, publication dates, and speakable sections for voice search optimization (Google Assistant, Alexa, Siri).

Type:boolean

Default:true

FAQ Writing Style

faqStyle

Optional

Tone and style for FAQ answers.

Type:string

Default:professional

Options:

professionalfriendlytechnicalconversational

Generate robots.txt

generateRobotsTxt

Optional

Generate an optimized robots.txt file with AI crawler directives. Includes rules for GPTBot, Google-Extended, CCBot, etc.

Type:boolean

Default:false

Generate sitemap.xml

generateSitemap

Optional

Generate a standard XML sitemap for search engines.

Type:boolean

Default:false

Generate HowTo Schema

generateHowToSchema

Optional

Extract and generate 'HowTo' schema markup from content (great for DIY, recipes, tutorials).

Type:boolean

Default:false

Generate llms-full.txt

generateLlmsFullTxt

Optional

Generate a detailed llms-full.txt companion file with extended page content (~10KB). The main llms.txt remains a concise summary (~2KB).

Type:boolean

Default:false

Content Validity (Days)

contentValidityDays

Optional

Number of days the generated content should be considered valid. Used for freshness signals in metadata.

Type:integer

Minimum:7

Maximum:365

Default:90

/llms.txt Generator

jakub.kopecky/llmstxt-generator

The /llms.txt Generator 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

Jakub Kopecký

738

3.1

(2)

LLMs.txt generator

antonio_espresso/llms-txt-generator

Generates a clean and structured markdown format for your AI Agents LLMs.txt file. Helps define AI agent interactions, improve SEO, and ensure compatibility across platforms. Ready to integrate into your website for better transparency and control.

Antonio Blago

The LLMS.TXT Generator | Hi LLMS

onescales/the-llms-txt-generator

The most powerful tool online to generate LLMS - llms.txt , llms-full.txt and markdown .md files within seconds! Get your website discovered, and recommended by ChatGPT, Claude, Google Gemini, Perplexity, Grok, and every AI. (Great for AEO, AIO, GEO, SEO) Transform your site to AI-friendly today!

One Scales

5.0

(2)

LLMs.txt File Generator

justa/llms-txt-file-generator

Generate an llms.txt file from a website sitemap. Crawls all URLs, extracts titles and meta descriptions, and creates a Markdown-formatted file following the llms.txt specification. Upload then the output of your file directly on your website (Webflow, Wordpress etc.)

Benoit Eveillard

Html to Markdown Converter

antonio_espresso/html-to-markdown-converter

Crawl a target URL and convert its HTML content into clean, structured Markdown with optional heading-based chunking.

Antonio Blago

Ai Visibility Suite - Dark Visitors Alternative

alizarin_refrigerator-owner/ai-visibility-suite---dark-visitors-alternative

Comprehensive AI bot monitoring, robots.txt analysis, LLMs.txt generation & AI shopping optimization. Monitor AI crawlers visits, check AI compliance, generate AI-friendly configurations, and optimize for AI shopping agents. AI Bot Directory Robots.txt LLMs.txt AI Shopping Competitor AI Audit

The Howlers

Documentation Crawler for RAG

liquid_bark/docs-crawler-for-rag

Specialized crawler for developer documentation sites. Detects frameworks (Docusaurus, GitBook, ReadTheDocs, MkDocs, Sphinx), extracts clean content, and outputs semantically chunked Markdown optimized for RAG pipelines.

Izz

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

codescraper/website-metadata-extractor

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $3/month.

CodeScraper

SyntheticFlow API - LLM-Powered Contextual Data Generator

fresh_cliff/syntheticflow-api---llm-powered-contextual-data-generator

Generate AI-powered synthetic data with LLM intelligence for business contexts. Create realistic customer profiles, documents, market data for AI agents. Privacy-compliant, multimodal, trend-aware synthetic data generation.

Brennan Crawford

Contextslim AI-Agent Context Generator

coherent_naturalist/contextslim

Architect messy websites into high-density, "Agent-Ready" knowledge bases. ContextSlim strips site noise to cut token bloat by 90%, saving you real money on every LLM prompt. Export perfect context for Claude & GPTs. Why pay for noise when you can pay $0.10 for pure signal?