Web Page to Markdown for AI & RAG: Bulk, Clean, Chunked
Pricing
$1.00 / 1,000 page converteds
Web Page to Markdown for AI & RAG: Bulk, Clean, Chunked
Convert any list of URLs or a whole sitemap into clean, LLM-ready Markdown. Main content only, metadata (author, dates, language), token counts and optional RAG chunks. Fast HTTP with automatic browser fallback for JavaScript sites. Pay only for pages converted.
Pricing
$1.00 / 1,000 page converteds
Rating
0.0
(0)
Developer
Rabii Slimane
Maintained by CommunityActor stats
0
Bookmarked
1
Total users
0
Monthly active users
2 hours ago
Last modified
Categories
Features
Share
Turn any list of URLs, or a whole sitemap, into clean Markdown that LLMs love: no menus, cookie banners, ads or footers. Each page comes with metadata, word and token counts, and optional RAG-ready chunks.
Why this one
| This Actor | Typical alternatives | |
|---|---|---|
| Many URLs per run | ✅ List or sitemap, up to 100k pages | Some fetch one URL per run |
| Price | $1 per 1,000 pages, failed pages free | Pay-per-page or unpredictable compute costs |
| JavaScript sites | ✅ Auto: fast HTTP first, Chrome only when needed | Always-browser (slow, costly) or never |
| Main content extraction | ✅ Mozilla Readability + menu/ad/cookie removal | Often whole-page dumps |
| Metadata | ✅ Title, description, author, published/modified dates, language, canonical URL, site name, image | Usually title only |
| RAG chunks with heading path | ✅ Optional, with overlap and token counts | Rare |
| Token estimate per page | ✅ | Rare |
| Simple setup | ✅ Sensible defaults, ~10 options | Often 50+ options |
Output
{"url": "https://react.dev","status": "ok","title": "React","description": "React is the library for web and native user interfaces...","author": null,"publishedAt": null,"language": "en","canonicalUrl": "https://react.dev/","markdown": "# React\n\nThe library for web and native user interfaces\n\n## Create user interfaces from components\n...","wordCount": 588,"approxTokens": 1050,"renderedWithBrowser": true,"chunks": [{ "index": 0, "headingPath": "React > Create user interfaces from components", "text": "...", "approxTokens": 480 }]}
Pages that fail (404, timeout, blocked, empty) are returned with "status": "failed" and an error message, and are not charged.
Tips
- Content: Main content only is best for articles, docs and blogs. Use Full page for homepages, listings and product pages.
- Turn on RAG chunk size (e.g. 500) to get chunks ready for Pinecone, Weaviate, Qdrant, pgvector, LangChain or LlamaIndex.
- Use Sitemaps to convert a whole docs site in one run.
- Plain-text and
.mdURLs (like GitHub raw files) are passed through as-is.
Pricing
$1 per 1,000 pages converted ($0.001 per page), compute included. Failed pages are free. Set "Maximum cost per run" in Apify to cap spending.
Responsible use
Respect each website's terms and copyright. This tool reads public pages only and does not bypass logins or CAPTCHAs.