Website to RAG Chunks

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Rag Knowledge Graph Builder

cspnair/rag-knowledge-graph-builder

Transform websites into RAG-ready datasets. Crawls pages, chunks content into semantic segments (500-1000 tokens), and generates hypothetical questions for each chunk. No API key needed with native mode. Output: pre-indexed JSON optimized for AI retrieval with 3x better accuracy than raw text.

RAG Web Browser

parseforge/rag-web-browser

Fetches web pages from search queries or direct URLs and returns clean content as markdown, text, and optional HTML. Designed to feed RAG pipelines and LLMs with structured data.

Website Content Crawler Pro — Markdown & RAG Chunks for AI

hipersoft/web-content-crawler-pro

Crawl any website to clean Markdown, text or HTML for AI, LLMs and RAG. Heading-aware chunks, sitemap and llms.txt discovery, URL filters, duplicate removal, PDF link capture, rich metadata and incremental crawls. Fast HTTP or JavaScript rendering. Pay only for pages delivered.

AI RAG Feeder V2

mickeywmoore/ai-rag-feeder-v2

Turn any website into AI-ready Markdown. Scrapes entire domains, removes ads/clutter, and formats text specifically for RAG pipelines and LLM training data.

Docs To Rag

gabrielaxy/docs-to-rag

Transform documentation websites into RAG-ready chunks with semantic understanding, quality scoring, and direct vector database integration.

Crawl any website and extract clean text, Markdown, and HTML from every page — ready for LLM, RAG, and AI ingestion.

arXiv Papers Extractor

cynix_dev/arxiv-papers

Search arXiv and extract papers as clean typed records: title, abstract, authors, categories, DOI, and direct PDF links. No API key required.

Paste webpage and PDF URLs and get Markdown, JSONL chunks, PDF inventory, source warnings, and RAG-ready records.

RAG Web Browser — URL & Website to Markdown for LLM & RAG

s-r/rag-web-browser

Search the web or pass URLs and get each page as clean Markdown, plain text or HTML with title and source URL, ready for LLM and RAG pipelines. Crawls links up to 3 hops, up to 1000 URLs per run, pay only per converted page.