/llms.txt Generator

Pricing

Pay per usage

Try for free

Go to Apify Store

/llms.txt Generator

Try for free

Developed by

Jakub Kopecký

Maintained by Community

The /llms.txt Generator 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

4.7 (3)

Pricing

Pay per usage

548

Issues response

1.1 hours

Last modified

2 days ago

Automation

Open source

Start URL

startUrlstringRequired

The URL from which the crawler will start to generate the /llms.txt file.

Max crawl depth

maxCrawlDepthintegerOptional

The maximum depth of the crawl. Default is 1.

Default value of this property is 1

Max crawl pages

maxCrawlPagesintegerOptional

The maximum number of pages to crawl. Default is 50.

Default value of this property is 50

LLMs.txt generator

antonio_espresso/llms-txt-generator

Generates a clean and structured markdown format for your AI Agents LLMs.txt file. Helps define AI agent interactions, improve SEO, and ensure compatibility across platforms. Ready to integrate into your website for better transparency and control.

Antonio Blago

AI Markdown Maker

onescales/bulk-ai-markdown-maker

This actor allows you to convert any list of web pages into a clean, structured markdown format for AI. It uses the powerful and free [Jina AI Reader API](https://jina.ai/reader/) to intelligently parse web content, removing ads, navigation, and other clutter.

One Scales

5.0

Seo Report Generator

trudax/seo-report-generator

Gustavo Rudiger

Mastra.ai MCP Agent

jakub.kopecky/actor-mastra-mcp-agent

🤖 AI agent using mastra.ai with Apify MCP Server. 🚀 Runs queries via OpenAI models, taps Apify Actors for web data, and outputs to datasets. 🛠️

Jakub Kopecký

Ikea Product Search

pintostudio/ikea-product-search

This Apify actor allows you to search for IKEA products with advanced filtering options and pagination support.

Pinto Studio

Ai Ready Web Page To Markdown Converter

mustafa.irshaid.113/ai-ready-web-page-to-markdown-converter

Convert any webpage into structured Markdown and HTML using just a URL. Get the page title, link, and content—perfect for SEO, devs, and AI crawlers. Fast, clean, and ideal for repurposing or analysis. Start turning websites into Markdown instantly.

Mustafa Irshaid

Firecrawl MCP Server

mcp-servers/firecrawl-mcp-server

A Model Context Protocol (MCP) server implementation that integrates with Firecrawl MCP for web scraping capabilities

MCP servers

Parsera

parsera-labs/parsera

Extract data from any website using just a URL and column descriptions

Parsera Labs

393

4.0

Tester MCP Client

jiri.spilka/tester-mcp-client

A model context protocol (MCP) client that connects to any MCP server using Server-Sent Events (SSE) and displays the conversation in a chat-like UI. It is a standalone Actor server designed for testing MCP servers over SSE.

Jiří Spilka

717

5.0

Actors MCP Server

apify/actors-mcp-server

⚠️ Legacy: This Actor is outdated. For the latest features and full documentation, visit https://mcp.apify.com. Easily connect any Apify Actor to AI agents using Anthropic’s Model Context Protocol (MCP) with our actively maintained MCP server.