Web Page to Markdown for AI & RAG: Bulk, Clean, Chunked avatar

Web Page to Markdown for AI & RAG: Bulk, Clean, Chunked

Pricing

$1.00 / 1,000 page converteds

Go to Apify Store
Web Page to Markdown for AI & RAG: Bulk, Clean, Chunked

Web Page to Markdown for AI & RAG: Bulk, Clean, Chunked

Convert any list of URLs or a whole sitemap into clean, LLM-ready Markdown. Main content only, metadata (author, dates, language), token counts and optional RAG chunks. Fast HTTP with automatic browser fallback for JavaScript sites. Pay only for pages converted.

Pricing

$1.00 / 1,000 page converteds

Rating

0.0

(0)

Developer

Rabii Slimane

Rabii Slimane

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

0

Monthly active users

2 hours ago

Last modified

Features

Limited permissions

Share

Turn any list of URLs, or a whole sitemap, into clean Markdown that LLMs love: no menus, cookie banners, ads or footers. Each page comes with metadata, word and token counts, and optional RAG-ready chunks.

Why this one

This ActorTypical alternatives
Many URLs per run✅ List or sitemap, up to 100k pagesSome fetch one URL per run
Price$1 per 1,000 pages, failed pages freePay-per-page or unpredictable compute costs
JavaScript sites✅ Auto: fast HTTP first, Chrome only when neededAlways-browser (slow, costly) or never
Main content extraction✅ Mozilla Readability + menu/ad/cookie removalOften whole-page dumps
Metadata✅ Title, description, author, published/modified dates, language, canonical URL, site name, imageUsually title only
RAG chunks with heading path✅ Optional, with overlap and token countsRare
Token estimate per page✅Rare
Simple setup✅ Sensible defaults, ~10 optionsOften 50+ options

Output

{
"url": "https://react.dev",
"status": "ok",
"title": "React",
"description": "React is the library for web and native user interfaces...",
"author": null,
"publishedAt": null,
"language": "en",
"canonicalUrl": "https://react.dev/",
"markdown": "# React\n\nThe library for web and native user interfaces\n\n## Create user interfaces from components\n...",
"wordCount": 588,
"approxTokens": 1050,
"renderedWithBrowser": true,
"chunks": [{ "index": 0, "headingPath": "React > Create user interfaces from components", "text": "...", "approxTokens": 480 }]
}

Pages that fail (404, timeout, blocked, empty) are returned with "status": "failed" and an error message, and are not charged.

Tips

  • Content: Main content only is best for articles, docs and blogs. Use Full page for homepages, listings and product pages.
  • Turn on RAG chunk size (e.g. 500) to get chunks ready for Pinecone, Weaviate, Qdrant, pgvector, LangChain or LlamaIndex.
  • Use Sitemaps to convert a whole docs site in one run.
  • Plain-text and .md URLs (like GitHub raw files) are passed through as-is.

Pricing

$1 per 1,000 pages converted ($0.001 per page), compute included. Failed pages are free. Set "Maximum cost per run" in Apify to cap spending.

Responsible use

Respect each website's terms and copyright. This tool reads public pages only and does not bypass logins or CAPTCHAs.