Pricing

from $1.00 / 1,000 page converteds

Try for free

Go to Apify Store

Website to Markdown for AI & RAG (Fast, No Browser)

Try for free

Turn any web page or whole website into clean Markdown for LLMs, RAG and AI agents. Removes menus, ads and footers, keeps headings, lists and tables. Adds title, author, date. Fast and cheap: no browser.

Pricing

from $1.00 / 1,000 page converteds

Rating

0.0

(0)

Developer

Pankaj Bhatia

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

Website to Markdown for AI & RAG

Turn any web page, or a whole website, into clean Markdown ready for LLMs, RAG pipelines, vector databases and AI agents.

Main content only: strips menus, cookie banners, ads, sidebars and footers. Keeps headings, lists, tables, bold/italic.
Metadata included: title, description, author, published date, site name, language and word count.
One page or a whole site: paste URLs, or turn on Follow links to crawl the same website (with depth, page limit and URL filters).
Fast and cheap: plain HTTP, no browser, so hundreds of pages take a minute.
Polite: respects robots.txt by default.
Pay only for pages that worked: failed, blocked or empty pages come back as a free row with an error explaining why.

Who is it for?

AI / RAG builders loading docs, blogs or help centers into a vector database.
AI agents that need to read a web page as clean text over the API.
Content and SEO teams archiving or analyzing competitor content.

Tip: pair it with our Sitemap & URL Extractor to get every URL of a site first, then convert them all here.

How to use it

Paste one or more Start URLs.
To convert a whole site, turn on Follow links and set Max pages and Max depth. Optionally limit it with URL include/exclude patterns.
Click Start, then download the Markdown as JSON, CSV or Excel, or load it straight into your vector database through the API.

Input example

{
  "startUrls": [{ "url": "https://docs.apify.com/academy" }],
  "followLinks": true,
  "maxPages": 100,
  "maxDepth": 2,
  "includePatterns": ["/academy/"]
}

Output example

{
  "url": "https://en.wikipedia.org/wiki/Web_scraping",
  "statusCode": 200,
  "title": "Web scraping - Wikipedia",
  "description": "…",
  "author": null,
  "publishedDate": "2026-09-30",
  "language": "en",
  "markdown": "# Web scraping\n\n**Web scraping**, **web harvesting**, or **web data extraction** is data scraping used for extracting data from websites…",
  "wordCount": 4326,
  "depth": 0,
  "crawledAt": "2026-10-08T18:55:01Z"
}

How much does it cost?

Pay-per-event: a small fee per page converted plus a tiny per-run start fee. For example, 1,000 pages cost about $1. Failed pages are free. Set Maximum cost per run to cap spending; the Actor stops cleanly at your limit.

Limits

Pages that only show content after running JavaScript (some single-page apps) may return "No readable main content". Those rows are free.
Only the same website is crawled when Follow links is on.
Respect each website's terms of use; only convert content you're allowed to use.

Use it through the API, integrations or AI agents

Run it from the Apify API, on a schedule, or connect it to Make, Zapier, n8n or Google Sheets. AI agents can find and call it through the Apify MCP server. Output is clean JSON with the same fields on every run.

FAQ

Is it legal? It reads publicly available pages and respects robots.txt by default. Only convert content you're allowed to use, and respect each website's terms.

Can I get plain text instead? Markdown is plain text with light formatting; strip # and * if you need raw text.

Is there a size limit? Pages up to 15 MB of HTML.

Found a page it can't read? Open an issue with the URL. We usually reply within 24 hours.

More tools from this developer

SAM.gov Contract Opportunities Finder & Bid Alerts: federal contract opportunities and bid alerts
Sitemap & URL Extractor: get every URL of a website from its sitemaps
Tech Stack Detector: find what any website is built with
Apple App Store Reviews Scraper: App Store reviews and ratings for any app
ATS Jobs Scraper: jobs from Greenhouse, Lever, Ashby, Workable and more
Website Screenshot: full-page, mobile and PDF screenshots in bulk
PDF to Text & Markdown Extractor: extract text from PDFs for AI and search
Domain WHOIS, DNS & SSL Checker: bulk domain, DNS, email security and SSL checks
SEO Meta Tags & On-Page Audit: bulk on-page SEO audit with fixes
Bulk URL Status & Broken Link Checker: status codes, redirect chains and broken links
RSS & Atom Feed Reader: merge and filter many news feeds
Hacker News Scraper: HN stories, comments and Who is hiring jobs
Academic Paper Search: papers from Crossref, arXiv and PubMed
SEC EDGAR Filings & Financials: 10-K, 10-Q, 8-K filings and company financials

Website Content to Markdown for LLM Training

easyapi/website-content-to-markdown-for-llm-training

🚀 Transform web content into clean, LLM-ready Markdown! 📘 Scrape multiple pages, extract main content, and convert to Markdown format. Perfect for AI researchers, data scientists, and LLM developers. Fast, efficient, and customizable. Supercharge your AI training data today! 🌐📝🧠

EasyApi

338

5.0

(2)

Simple Website Scrapper (markdown format)

manojaditya64/simple-website-scrapper-markdown-format

A simple website scrapper that scrapes websites and converts it into markdown format which is easy to use with LLM. You can feed markdown data to LLM for easy analysis.

Manojaditya Nadar

5.0

(1)

Universal Web to Markdown (Bulk & AI-Ready)

lentic_october/web-to-markdown-converter

Bulk convert any website URLs to clean Markdown for AI & LLMs. Universal scraper that removes ads, scripts, and clutter. Optimized for RAG, ChatGPT, Claude, and LangChain. Fast, async, and API-ready.

kalthireddy Abhishek

Website to Markdown Converter

lofomachines/website-to-markdown-converter

Best faster and cheaper way to convert any web page into clean, structured, LLM-ready Markdown.

Lofomachines

Knowledge Intelligence Engine — Website to Markdown for RAG

ryanclinton/website-content-to-markdown

Turn any website, documentation site or help centre into a retrieval-ready knowledge corpus for RAG and AI search. Clean Markdown plus chunks, change detection, deduplication, retrieval scoring, version awareness and a full corpus audit, in one run.

Ryan Clinton

Website to Markdown for LLM & RAG — Crawl4AI URL to Clean

bikram07/web-to-markdown-crawl4ai

Convert any URL, sitemap, or whole website into clean, LLM-ready Markdown for RAG, vector databases, and AI agents. Hosted Crawl4AI in a real Chromium browser — renders JavaScript and SPAs, strips boilerplate, and exports JSON/CSV. Callable over MCP from Claude and Cursor.

Bikram

Website Content Crawler — Markdown for LLM & RAG

brilliant_gum/web-content-crawler

Deep-crawl websites and extract LLM-ready Markdown with OG tags, JSON-LD, author, dates, token estimates, native RAG chunking, language filtering, content-hash dedup, and per-page error reporting. Enforced timeouts. Zero silent failures.