AI Website to Clean Markdown & RAG Chunk Extractor
Pricing
from $2.00 / 1,000 results
Go to Apify Store
AI Website to Clean Markdown & RAG Chunk Extractor
Converts websites, documentation portals, and articles into clean LLM-ready Markdown and token-sized RAG chunks for OpenAI, Claude, LangChain, and vector databases.
Pricing
from $2.00 / 1,000 results
Rating
0.0
(0)
Developer
Kabeer Ahmed
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
6 days ago
Last modified
Categories
Features
Limited permissions
Share
Fast, lightweight converter that strips website boilerplate (navigation bars, footers, scripts, cookie banners, ads) and transforms web pages or technical documentation into clean LLM-ready Markdown and token-sized RAG chunks.
Key Features
- Clean Boilerplate Removal: Automatically focuses on
<main>/<article>content and strips noisy DOM nodes (<script>,<style>,<nav>,<footer>, cookie banners). - Structured Markdown Output: Preserves heading hierarchies (
H1-H6), bulleted/numbered lists, blockquotes, and fenced code blocks. - Ready-to-Embed RAG Chunks: Splits long pages into configurable word/token chunks with
sectionHeading,wordCount, andestimatedTokensmetadata for direct ingestion into OpenAI Embeddings, Pinecone, Qdrant, LangChain, or LlamaIndex. - Optional Same-Domain Subpage Crawling: Enable
crawlSubpagesto ingest entire documentation portals in a single run.
Output Example
{"url": "https://kabeer.site","domain": "kabeer.site","title": "Kabeer Ahmed | Full-Stack Developer & UI/UX Engineer","wordCount": 420,"estimatedTokens": 559,"totalChunks": 2,"headingsCount": 8,"codeBlocksCount": 0,"markdown": "# Kabeer Ahmed\n\nFull-Stack Developer & UI/UX Engineer...","ragChunks": [{"chunkIndex": 0,"sourceUrl": "https://kabeer.site","sectionHeading": "Kabeer Ahmed","wordCount": 280,"estimatedTokens": 373,"content": "..."}]}
Built By
Kabeer Ahmed — Full-Stack Engineer & Automation Developer (kabeer.site)