Pricing

$10.00 / 1,000 rag chunks

MCP Website RAG Ingestion Tool

MCP-ready website ingestion for AI agents using a prompt-first interface that turns public webpages into source-linked RAG chunks with markdown and token estimates.

Pricing

$10.00 / 1,000 rag chunks

Rating

0.0

(0)

Developer

Ushba Khan

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

What it does

MCP-ready tool for AI agents to crawl public webpages, clean text, and return source-linked chunks for RAG and knowledge-base workflows.

This is packaged for Apify deployment and exposed to AI clients through the Apify MCP server as a callable MCP tool. The public-facing name, schema, output, pricing, and listing copy are MCP-first.

Buyer

AI agencies, RAG builders, SaaS documentation teams

Input

See input_schema.json and .actor/input_schema.json for the exact MCP-compatible input schema.

Output

See output_schema.json for the structured result contract. Outputs include status/warnings fields so AI agents can reason about partial or failed records.

Pricing

Recommended pricing: USD 1.50 per 1,000 chunks or USD 0.60 per 1,000 pages.

Local testing

ash npm install npm test npm run validate apify validate-schema npm start

Apify MCP usage

After deployment, connect an MCP client to https://mcp.apify.com and include this tool by selecting it in the Apify MCP configurator or by adding it to the MCP ools parameter.

Marketplace note

This is MCP-ready display copy. Marketplace publication still requires Ushba's business approval.

Apify deployment

This MCP tool is deployed to Apify so it can be exposed through https://mcp.apify.com to MCP clients.

Deployment checks:

npm test
npm run validate
apify validate-schema
apify info
apify push

Marketplace publication is separate and requires Ushba's business approval.

RAG Data Ingestion: Website to AI Knowledge Base

0xysn/rag-data-ingestion-website-to-ai-knowledge-base

Master complex documentation with a premium scraper that flattens Shadow DOM and handles modern web components. Delivers clean, token-accurate Markdown pre-chunked for immediate RAG ingestion into Pinecone, Weaviate, or LangChain. Optimized for high-fidelity LLM training data.

tekk

Website to RAG Markdown Crawler

knotted_tussock/rag-markdown-crawler

Crawl any website or docs site and export clean Markdown plus JSONL-style chunks for RAG, LLM apps, and AI agents.

Ralph T

News to Markdown — RAG-Ready News Chunks API

nexgendata/news-announcements-rag-markdown

Convert news and announcements into RAG-ready Markdown chunks. Clean JSON for PR, media-monitoring teams and AI agents.

NexGenData

Website Markdown Crawler

moorish-dev/website-markdown-crawler

Crawls a website and converts every page to clean Markdown optimized for LLM ingestion.

Ziad Tarik

Website to Text & Markdown — AI / RAG Content Crawler

inexhaustible_glass/rag-website-crawler

Scrape any website into clean text & Markdown with RAG-ready chunks and token counts for LLMs, vector databases (Pinecone, Qdrant) and AI chatbots. Also extracts linked PDF/Word/Excel. Anti-block, robots.txt-aware. Website-to-text for beginners, full RAG pipeline for pros. CPU only, no API key.

Hitman studio

Docs Markdown Rag Ready Crawler

devwithbobby/docs-markdown-rag-ready-crawler

Turn any documentation site or website into clean, structured markdown—ready for RAG, embeddings, and AI agents.

Dev with Bobby

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Manas Mantri

RAG Website Crawler - Markdown Chunks for LLMs & MCP

themineworks/rag-crawler

Crawl any website into clean, pre-chunked Markdown with per-chunk token counts for RAG pipelines, vector DBs (Pinecone, Qdrant) and LLM context. MCP-native for Claude & ChatGPT. SPA support via Playwright. Pay only for pages that crawl. A Firecrawl alternative.

The Mine Works

Website to Markdown for LLMs and RAG

rodrgds/website-to-markdown

Convert webpages into clean markdown for LLMs, RAG pipelines, AI datasets, archives, and content extraction. Simple pay-per-page pricing.

Rodrigo Dias

Ecommerce RAG Ingestion Engine

blukaze/ecommerce-rag-ingestion-engine

Stop feeding your LLMs noisy HTML and irrelevant UI clutter. The Ecommerce RAG Ingestion Engine is a production-ready Apify Actor designed to transform entire ecommerce domains with a specialized focus on Shopify into clean, AI-ready knowledge bases.