Pricing

$0.80 / 1,000 pages

Try for free

Go to Apify Store

URL to Markdown - Clean Page Text for AI, RAG & LLMs

Try for free

Turn any list of web pages into clean Markdown, plain text and metadata for AI agents, RAG pipelines and LLM prompts. Main-content extraction removes menus and ads. Obeys robots.txt. Pay only per page converted.

Pricing

$0.80 / 1,000 pages

Rating

0.0

(0)

Developer

Conor Wilson

Actor stats

Bookmarked

Total users

Monthly active users

13 days ago

Last modified

URL to Markdown

Turn any list of web pages into clean Markdown (plus optional plain text) with title, description, author, language and word count. Built for AI agents, RAG pipelines, LLM prompts and knowledge bases.

$0.80 per 1,000 pages. Pages that fail, are blocked or are disallowed by robots.txt are returned with the reason and never charged.

Why this one

Main-content extraction. A readability algorithm removes menus, cookie bars, footers and sidebars, so you pay for fewer LLM tokens. Switch it off to convert the whole page.
Clean, consistent Markdown. ATX headings, fenced code blocks, absolute links, optional images, collapsed whitespace.
Cheap and fast. Plain HTTP fetching with no browser, so runs finish in seconds.
Token control. maxCharacters truncates long pages and flags them with truncated: true.
Respectful by design. Obeys robots.txt, identifies itself honestly, and never bypasses logins, paywalls or bot protection.

Quick start

{
    "urls": [{ "url": "https://en.wikipedia.org/wiki/Markdown" }, { "url": "https://docs.apify.com/platform/actors" }],
    "mainContentOnly": true,
    "includeLinks": true,
    "maxCharacters": 20000
}

Call it from code (one row per page comes back):

curl -X POST "https://api.apify.com/v2/acts/ennobling_spray~url-to-markdown/run-sync-get-dataset-items?token=<YOUR_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"urls":[{"url":"https://en.wikipedia.org/wiki/Markdown"}]}'

Output

Field	Description
`markdown`	Page content as Markdown
`text`	Plain text, if `includeText` is on
`title`, `description`, `author`, `siteName`, `language`, `publishedTime`	Page metadata when available
`wordCount`, `truncated`	Size of the extracted content
`url`, `finalUrl`, `statusCode`, `fetchedAt`	Request details
`ok`, `error`	Whether conversion succeeded, and why not

Input options

Option	Default	Notes
`urls`	required	Pages to convert
`mainContentOnly`	`true`	Readability extraction; off converts the whole `<body>`
`includeLinks`	`true`	Keep hyperlinks (absolute URLs)
`includeImages`	`false`	Keep image references
`includeText`	`false`	Also return plain text
`maxCharacters`	`0`	Truncate Markdown above this length (0 = no limit)
`maxConcurrency`	`8`	Parallel requests; a per-site pace of about 4 requests per second always applies

Limits and good use

JavaScript-only pages (content rendered entirely in the browser) may come back short. Most news, docs, blogs and reference sites work well.
PDFs are not converted here. Use PDF to Text from the same author.
The actor fetches only what robots.txt allows for its user agent WilsDataTools. Disallowed or bot-protected pages are reported, not bypassed.
You are responsible for having the right to use the content you convert, for example under the site's terms or a licence.

Pricing

Pay per event: one event per page successfully converted. Set a maximum cost per run to cap spend.

Website To Markdown

smart_api/website-to-markdown

Convert any webpage into clean, LLM-ready Markdown in seconds — perfect for AI training data, RAG pipelines, and content archiving.

SmartApi

5.0

(1)

Website Content Crawler - Clean Text, Markdown & RAG Chunks

topapi/website-content-crawler

Crawl any website or URL list for $1.20 per 1,000 pages: one row per page with clean text, Markdown, HTML, metadata, links, headings, tables and RAG chunks. Plain HTTP first, headless Chrome only for JavaScript pages. Sitemaps, llms.txt, PDF/DOCX text, Bing/DuckDuckGo search, change monitor.

Top Api

PDF & DOCX to Markdown — Document Extractor for LLM/RAG

fetchbase/document-to-markdown

Convert PDF and Word (DOCX) documents into clean Markdown, text, or JSON. Smart PDF paragraph reflow, page markers for RAG citations, full DOCX structure (headings, lists, tables), custom auth headers. No browser — parses in seconds. Charged per page processed — no startup fee.

Fetchbase

Llm Ready Documentation Scraper

direct_duty/llm-ready-documentation-scraper

Developers and AI agents need to read documentation (e.g. Stripe Docs, Next.js Docs), but standard scrapers return noisy HTML that includes: navigation bars headers / footers ads / cookie banners This Actor must return pure content-only Markdown, suitable for vectorization and semantic search.

Sean

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Manas Mantri

Website to Markdown for LLM & RAG — Crawl4AI URL to Clean

bikram07/web-to-markdown-crawl4ai

Convert any URL, sitemap, or whole website into clean, LLM-ready Markdown for RAG, vector databases, and AI agents. Hosted Crawl4AI in a real Chromium browser — renders JavaScript and SPAs, strips boilerplate, and exports JSON/CSV. Callable over MCP from Claude and Cursor.

Bikram

AI Markdown Maker

onescales/bulk-ai-markdown-maker

Convert any web page into clean, AI ready markdown format in seconds. This markdown generator is perfect for content for AI models, creating documentation, or archiving web content. It intelligently parses web content, removing ads, navigation, and other clutter. Generate Markdown Today!

One Scales

153

5.0

(2)

URL to Markdown (JustHTML) - Clean Markdown Extractor

macheta/justhtml-link-to-markdown

Convert webpages to clean Markdown for RAG and archiving. Uses JustHTML and supports optional Cloudflare/Turnstile bypass plus CSS selector extraction.

Anass

5.0

(1)

Website to Markdown — Clean Page Text for LLMs

sourcedirect/website-to-markdown

Fetch any URL and return clean markdown/text plus links. No headless browser for most pages. Free demo: https://vaytric.com/page-to-markdown/ — bulk URL lists here.

Kurt Landman

HTML to Markdown Converter - Bulk Web Content to MD

santamaria-automations/html-to-markdown

Extract main article content from any website and convert to clean Markdown including headings, links, images, tables, and code blocks. Perfect for LLM training, AI pipelines, and documentation. Export data, run via API, schedule and monitor runs, or integrate with other tools.