RAG Index Sync Reconciler

Website to Markdown Converter & Crawler for LLMs and RAG

s3nafps/ai-ready-webpage-extractor

Website to Markdown Crawler is an Apify Actor that turns web pages, docs sites and blogs into clean Markdown and RAG chunks for LLMs. $3 per 1,000 pages.

Google Index Checker — Bulk URL Indexing Status

maged120/google-index-checker

Bulk-check whether your pages and domains are indexed by Google, with the indexed title, snippet and an estimate of indexed pages per domain.

Quick Website Content Scraper ( Extract Text for RAG & LLMs )

automateitplease/ai-web-content-scraper-extract-text-for-rag-llms

Extract clean text from any website for AI/LLM applications. Supports both static and JavaScript-rendered sites (React, Vue, Angular). Perfect for RAG systems, chatbot training, and content analysis.

Notion Scraper - Markdown Export & RAG Sync

fetchfinch/notion-scraper-knowledge-base-sync

[🔄 Incremental sync] Export public Notion pages and databases to Markdown, JSON, HTML or RAG chunks. Crawl subpages and sync only changed content. Public pages need no login; connected private pages use your read-only Notion integration token.

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Markdown RAG Chunker: Document Text Splitter

codepoetry/markdown-rag-chunker

RAG chunking for PDFs, Word, PowerPoint, Excel, EPUB and web pages. A header-aware text splitter keeps each chunk inside one section, caps it at 512 tokens by default, and adds its header path, source, stable ID and exact token count. Ready to embed into Pinecone, Qdrant or pgvector.

Website Content Crawler | Markdown for RAG

xtech/news-source-crawler

Turn public news, blog, and documentation pages into clean Markdown or plain text. Discover pages through sitemaps and feeds, or extract known URLs directly. Export content, metadata, and change-tracking fields for RAG and monitoring, while respecting robots.txt and website boundaries.

YouTube Channel Transcript Scraper - Whole Channel to Text

vonsensey/youtube-channel-transcript-scraper

Hand it a channel and get that channel's words back. Every upload is expanded, transcribed and returned as one clean dataset with timings and chapters - a full back catalogue ready for search, analysis or an AI pipeline. Set how many videos per channel, and pay per transcript that lands.

PubMed Scraper for RAG: Papers as Chunked JSON

getascraper/pubmed-rag-extractor

Scrape PubMed citations by search term, MeSH, and article type. Returns RAG-ready JSON with full-text chunks from PMC Open Access (cl100k_base, 512/50) and abstract fallback. Drop-in for LangChain, LlamaIndex, Qdrant, Pinecone, Weaviate, pgvector. Skip GROBID / Pubmed Parser.

Website to RAG Chunks

cynix_dev/web-to-rag-chunks

Crawl any website and turn its pages into clean, chunked, metadata-rich Markdown records ready for RAG pipelines, vector stores, and custom GPTs.