AI Website to Clean Markdown & RAG Chunk Extractor avatar

AI Website to Clean Markdown & RAG Chunk Extractor

Pricing

Pay per usage

Go to Apify Store
AI Website to Clean Markdown & RAG Chunk Extractor

AI Website to Clean Markdown & RAG Chunk Extractor

Converts websites, documentation portals, and articles into clean LLM-ready Markdown and token-sized RAG chunks for OpenAI, Claude, LangChain, and vector databases.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Kabeer Ahmed

Kabeer Ahmed

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

9 hours ago

Last modified

Share

Fast, lightweight converter that strips website boilerplate (navigation bars, footers, scripts, cookie banners, ads) and transforms web pages or technical documentation into clean LLM-ready Markdown and token-sized RAG chunks.

Key Features

  • Clean Boilerplate Removal: Automatically focuses on <main> / <article> content and strips noisy DOM nodes (<script>, <style>, <nav>, <footer>, cookie banners).
  • Structured Markdown Output: Preserves heading hierarchies (H1-H6), bulleted/numbered lists, blockquotes, and fenced code blocks.
  • Ready-to-Embed RAG Chunks: Splits long pages into configurable word/token chunks with sectionHeading, wordCount, and estimatedTokens metadata for direct ingestion into OpenAI Embeddings, Pinecone, Qdrant, LangChain, or LlamaIndex.
  • Optional Same-Domain Subpage Crawling: Enable crawlSubpages to ingest entire documentation portals in a single run.

Output Example

{
"url": "https://kabeer.site",
"domain": "kabeer.site",
"title": "Kabeer Ahmed | Full-Stack Developer & UI/UX Engineer",
"wordCount": 420,
"estimatedTokens": 559,
"totalChunks": 2,
"headingsCount": 8,
"codeBlocksCount": 0,
"markdown": "# Kabeer Ahmed\n\nFull-Stack Developer & UI/UX Engineer...",
"ragChunks": [
{
"chunkIndex": 0,
"sourceUrl": "https://kabeer.site",
"sectionHeading": "Kabeer Ahmed",
"wordCount": 280,
"estimatedTokens": 373,
"content": "..."
}
]
}

Built By

Kabeer Ahmed — Full-Stack Engineer & Automation Developer (kabeer.site)