AI Website to Clean Markdown & RAG Chunk Extractor
Pricing
Pay per usage
Go to Apify Store
AI Website to Clean Markdown & RAG Chunk Extractor
Converts websites, documentation portals, and articles into clean LLM-ready Markdown and token-sized RAG chunks for OpenAI, Claude, LangChain, and vector databases.
Pricing
Pay per usage
Rating
0.0
(0)
Developer
Kabeer Ahmed
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
9 hours ago
Last modified
Categories
Share
Fast, lightweight converter that strips website boilerplate (navigation bars, footers, scripts, cookie banners, ads) and transforms web pages or technical documentation into clean LLM-ready Markdown and token-sized RAG chunks.
Key Features
- Clean Boilerplate Removal: Automatically focuses on
<main>/<article>content and strips noisy DOM nodes (<script>,<style>,<nav>,<footer>, cookie banners). - Structured Markdown Output: Preserves heading hierarchies (
H1-H6), bulleted/numbered lists, blockquotes, and fenced code blocks. - Ready-to-Embed RAG Chunks: Splits long pages into configurable word/token chunks with
sectionHeading,wordCount, andestimatedTokensmetadata for direct ingestion into OpenAI Embeddings, Pinecone, Qdrant, LangChain, or LlamaIndex. - Optional Same-Domain Subpage Crawling: Enable
crawlSubpagesto ingest entire documentation portals in a single run.
Output Example
{"url": "https://kabeer.site","domain": "kabeer.site","title": "Kabeer Ahmed | Full-Stack Developer & UI/UX Engineer","wordCount": 420,"estimatedTokens": 559,"totalChunks": 2,"headingsCount": 8,"codeBlocksCount": 0,"markdown": "# Kabeer Ahmed\n\nFull-Stack Developer & UI/UX Engineer...","ragChunks": [{"chunkIndex": 0,"sourceUrl": "https://kabeer.site","sectionHeading": "Kabeer Ahmed","wordCount": 280,"estimatedTokens": 373,"content": "..."}]}
Built By
Kabeer Ahmed — Full-Stack Engineer & Automation Developer (kabeer.site)