Agent Memory Feeder - Web to Clean Markdown Chunks

AST Website Content Crawler for RAG

lukas459/ai-web-to-markdown-crawler-llm-rag-optimized

Advanced web crawler extracting token-chunked Markdown for LLMs & RAG. Features dual-engine hybrid parsing (IBM Docling & Trafilatura) to preserve tables and layouts. Delivers clean text split by native tiktoken counts with rich metadata (headings, levels, tokens) for instant vector search.

P2M AI Feeder – PDF to Markdown Converter

gtgyani206/p2m-aifeeder

Convert digital and scanned PDFs into clean Markdown, structured JSON, and deterministic chunks for AI agents and RAG pipelines. Supports OCR, tables, image descriptions, batch processing, and downloadable artifacts.

Knowledge Intelligence Engine — Website to Markdown for RAG

ryanclinton/website-content-to-markdown

Turn any website, documentation site or help centre into a retrieval-ready knowledge corpus for RAG and AI search. Clean Markdown plus chunks, change detection, deduplication, retrieval scoring, version awareness and a full corpus audit, in one run.

PDF to Markdown & JSON (RAG-Ready)

basisweb/pdf-to-markdown-rag

Convert PDFs to clean Markdown and structured JSON (text + tables) for RAG, LLMs, and vector DBs. Batch URLs, pay per page.

Website to Markdown Crawler | Pre-Chunked for RAG

themineworks/rag-crawler

Crawl any website into clean, pre-chunked Markdown with per-chunk token counts for RAG pipelines, vector DBs (Pinecone, Qdrant) and LLM context. MCP native for Claude & ChatGPT. SPA support via Playwright. Pay only for pages that crawl. A Firecrawl alternative.

Reddit RAG Dataset — LLM Training Data

blackfalcondata/reddit-rag-dataset

Scrape reddit.com — build clean LLM and RAG datasets from posts with full comment threads as ready-to-chunk text · HTML & Markdown · only text-bearing records with parent/child thread structure. Mix subreddit, keyword-search and direct-post inputs in one run.

AI Web Scraper - Powered by Crawl4AI

raizen/ai-web-scraper

A blazing-fast AI web scraper powered by Crawl4AI. Perfect for LLMs, AI agents, AI automation, model training, sentiment analysis, and content generation. Supports deep crawling, multiple extraction strategies and flexible output (Markdown/JSON). Seamlessly integrates with Make.com, n8n, and Zapier.

Web Search API for RAG — Search & Extract

tugelbay/rag-web-browser

Web search API that turns Google results and public URLs into Markdown, text, or HTML for RAG and AI agents. Guide: https://konabayev.com/tools/rag-web-browser/?utm_source=apify_info&utm_medium=referral&utm_campaign=rag-web-browser

TheCrawler — validated extraction contracts for AI agents

accurate_pouch/the-crawler

Validated extraction contracts for AI agents: crawl pages, diagnose readiness before LLM calls, and extract typed JSON with validation evidence. Markdown, structured errors, PDF/DOCX.

PDF URL to Markdown, Tables & RAG Extractor

thescrapelab/Apify-PDF-url-scraper

Extract clean Markdown, page text, tables, metadata, summaries, and AI-ready RAG chunks from PDF URLs.