AI Website to Clean Markdown & RAG Chunk Extractor avatar

AI Website to Clean Markdown & RAG Chunk Extractor

Pricing

from $2.00 / 1,000 results

Go to Apify Store
AI Website to Clean Markdown & RAG Chunk Extractor

AI Website to Clean Markdown & RAG Chunk Extractor

Converts websites, documentation portals, and articles into clean LLM-ready Markdown and token-sized RAG chunks for OpenAI, Claude, LangChain, and vector databases.

Pricing

from $2.00 / 1,000 results

Rating

0.0

(0)

Developer

Kabeer Ahmed

Kabeer Ahmed

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

6 days ago

Last modified

Features

Limited permissions

Share

Fast, lightweight converter that strips website boilerplate (navigation bars, footers, scripts, cookie banners, ads) and transforms web pages or technical documentation into clean LLM-ready Markdown and token-sized RAG chunks.

Key Features

  • Clean Boilerplate Removal: Automatically focuses on <main> / <article> content and strips noisy DOM nodes (<script>, <style>, <nav>, <footer>, cookie banners).
  • Structured Markdown Output: Preserves heading hierarchies (H1-H6), bulleted/numbered lists, blockquotes, and fenced code blocks.
  • Ready-to-Embed RAG Chunks: Splits long pages into configurable word/token chunks with sectionHeading, wordCount, and estimatedTokens metadata for direct ingestion into OpenAI Embeddings, Pinecone, Qdrant, LangChain, or LlamaIndex.
  • Optional Same-Domain Subpage Crawling: Enable crawlSubpages to ingest entire documentation portals in a single run.

Output Example

{
"url": "https://kabeer.site",
"domain": "kabeer.site",
"title": "Kabeer Ahmed | Full-Stack Developer & UI/UX Engineer",
"wordCount": 420,
"estimatedTokens": 559,
"totalChunks": 2,
"headingsCount": 8,
"codeBlocksCount": 0,
"markdown": "# Kabeer Ahmed\n\nFull-Stack Developer & UI/UX Engineer...",
"ragChunks": [
{
"chunkIndex": 0,
"sourceUrl": "https://kabeer.site",
"sectionHeading": "Kabeer Ahmed",
"wordCount": 280,
"estimatedTokens": 373,
"content": "..."
}
]
}

Built By

Kabeer Ahmed — Full-Stack Engineer & Automation Developer (kabeer.site)