MCP Website RAG Ingestion Tool

Techionik Website RAG MCP

seeb/techionik-website-rag-mcp

Prompt-first MCP-ready Apify tool for AI agents to crawl public websites and return clean RAG chunks with URLs, titles, markdown, and token estimates.

Extract text and metadata from PDF URLs for AI agents, RAG pipelines, research workflows, legal documents, reports, and knowledge-base ingestion.

Convert a website sitemap into clean text and markdown rows for RAG, AI search, chatbots, and knowledge base workflows.

Website RAG Knowledge Builder

glowing_glove/website-rag-knowledge-builder

Crawl public website pages and build clean RAG-ready knowledge records with page summaries, key facts, FAQs, links, and retrieval chunks.

Crawl any website or docs site and export clean Markdown plus JSONL-style chunks for RAG, LLM apps, and AI agents.

AI / RAG Web Crawler

groupoject/ai-rag-web-crawler

Crawl any website and extract clean, LLM-ready Markdown chunks to feed AI agents, chatbots, and RAG pipelines. One row per embeddable chunk.

RAG Web Extractor — Clean Markdown, HTML & Chunks

junipr/rag-web-extractor

Extract clean website content for RAG and AI search. Crawl pages, remove boilerplate, preserve structure, and export markdown, HTML, text, JSON, and chunks.

Website Content Scraper

qaseemiqbal/website-content-scraper

Extract clean Markdown, plain text, linked files, and RAG-ready chunks from websites, documentation, help centers, knowledge bases, and authenticated portals. Preserve structure, metadata, URLs, and crawl context for AI search, training, and retrieval workflows.

Extract clean, RAG-ready Markdown from any knowledge base for LLM training and AI chatbots.

Convert news and announcements into RAG-ready Markdown chunks. Clean JSON for PR, media-monitoring teams and AI agents.