Pricing

from $1.00 / 1,000 page converted to markdowns

Try for free

Go to Apify Store

Web to Markdown & llms.txt Generator for LLMs

Try for free

Convert public web pages to clean Markdown for LLMs, RAG and AI agents, with optional chunks, and generate llms.txt / llms-full.txt for a website from its sitemap. No browser; robots.txt and AI opt-outs respected.

Pricing

from $1.00 / 1,000 page converted to markdowns

Rating

0.0

(0)

Developer

Adrian LHH

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

You can access the Web to Markdown & llms.txt Generator for LLMs programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "urls": [
10        { "url": "https://www.python.org/about/" },
11        { "url": "https://en.wikipedia.org/wiki/Markdown" },
12    ],
13    "llmsTxtSites": [],
14}
15
16# Run the Actor and wait for it to finish
17run = client.actor("thriving_adder/web-to-markdown-llms-txt").call(run_input=run_input)
18
19# Fetch and print Actor results from the run's dataset (if there are any)
20print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
21for item in client.dataset(run.default_dataset_id).iterate_items():
22    print(item)
23
24# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Website to Markdown for LLMs & llms.txt Generator API in Python

The Apify API client for Python is the official library that allows you to use Web to Markdown & llms.txt Generator for LLMs API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Web to Markdown & llms.txt Generator for LLMs API in JavaScript

Web to Markdown & llms.txt Generator for LLMs API through CLI

Web to Markdown & llms.txt Generator for LLMs OpenAPI definition

Web to Markdown & llms.txt Generator for LLMs API

Website Content to Markdown for LLM Training

easyapi/website-content-to-markdown-for-llm-training

🚀 Transform web content into clean, LLM-ready Markdown! 📘 Scrape multiple pages, extract main content, and convert to Markdown format. Perfect for AI researchers, data scientists, and LLM developers. Fast, efficient, and customizable. Supercharge your AI training data today! 🌐📝🧠

EasyApi

341

5.0

(2)

Ai Ready Web Page To Markdown Converter

mustafa.irshaid.113/ai-ready-web-page-to-markdown-converter

Convert any webpage into structured Markdown and HTML using just a URL. Get the page title, link, and content—perfect for SEO, devs, and AI crawlers. Fast, clean, and ideal for repurposing or analysis. Start turning websites into Markdown instantly.

Mustafa Irshaid

Llm Ready Documentation Scraper

direct_duty/llm-ready-documentation-scraper

Developers and AI agents need to read documentation (e.g. Stripe Docs, Next.js Docs), but standard scrapers return noisy HTML that includes: navigation bars headers / footers ads / cookie banners This Actor must return pure content-only Markdown, suitable for vectorization and semantic search.

Sean

OpenAI Web Scraper

dtrungtin/openai-web-scraper

Crawl web pages and extract structured information using OpenAI

Tin

X (Twitter) Article to Markdown Scraper - Long Form Posts

seemuapps/x-article-to-markdown-scraper

Convert any X (Twitter) long-form Article or Notes post into clean Markdown, ready for AI, RAG, and LLM ingestion pipelines.

Seemu Scraping

llms.txt Generator: llms-full.txt for Any Website (AI SEO)

fayoussef/llms-txt-generator

Generate a spec-compliant llms.txt and llms-full.txt for any website in one run. Crawls your sitemap or internal links, extracts every page's title, meta description and full Markdown content, and outputs two ready-to-upload files for ChatGPT, Claude, Perplexity and Gemini.

Youssef Farhan

Website Content Crawler — Markdown for LLM & RAG

brilliant_gum/web-content-crawler

Deep-crawl websites and extract LLM-ready Markdown with OG tags, JSON-LD, author, dates, token estimates, native RAG chunking, language filtering, content-hash dedup, and per-page error reporting. Enforced timeouts. Zero silent failures.

Yuliia Kulakova

LLM-Ready Web Scraper

devoted_helix/llm-web-scraper

Convert web pages to clean, LLM-friendly text. Perfect for RAG pipelines, AI chatbot training, and fine-tuning datasets. Removes ads,menus, and clutter automatically.

batuhan senavci

Website to Markdown for LLM & RAG — Crawl4AI URL to Clean

bikram07/web-to-markdown-crawl4ai

Convert any URL, sitemap, or whole website into clean, LLM-ready Markdown for RAG, vector databases, and AI agents. Hosted Crawl4AI in a real Chromium browser — renders JavaScript and SPAs, strips boilerplate, and exports JSON/CSV. Callable over MCP from Claude and Cursor.

Bikram

Doc2RAG AI - Documentation to LLM-Ready Markdown Converter

automation_studio/doc-to-rag-markdown-converter

Convert technical documentation websites (Stripe, Supabase, Next.js, Mintlify, Docusaurus) into clean, LLM-ready Markdown with preserved multi-language code blocks, tables, and RAG frontmatter. Exports JSON dataset, single llms-full.txt, and ZIP archive.