Docs To Rag

gabrielaxy/docs-to-rag

Transform documentation websites into RAG-ready chunks with semantic understanding, quality scoring, and direct vector database integration.

AI Training Data Scraper

blukaze/apify-AI-Training-Data-Scraper

AI Training Data Scraper converts websites into clean, semantically-chunked, vector-ready data for LLMs, RAG pipelines, and AI search. Built for documentation, tutorials, and code-heavy content, with smart chunking and rich metadata.

Ai Training Data Curator

lanky_quantifier/ai-training-data-curator

Curate high-quality training datasets for AI/ML models. Extract, clean & format text data from websites, papers & forums. Perfect for LLM training, RAG systems & research.

GitHub README Globalizer

lenient_grove/GitHub-README-Globalizer

🌍 Translate GitHub docs (README, CONTRIBUTING, CHANGELOG) into 16+ languages without breaking code! 🛡️ AI-powered by Lingo.dev with AST parsing to protect code blocks. 📄 Multi-file, 🌿 branch selection, 📥 one-click downloads. Code stays safe!

Docs Markdown Rag Ready Crawler

devwithbobby/docs-markdown-rag-ready-crawler

Turn any documentation site or website into clean, structured markdown—ready for RAG, embeddings, and AI agents.

Docs to Markdown + AI Embeddings → Vector DB Crawler

badruddeen/docs-to-markdown-ai-embeddings---vector-db-crawler

Turn any documentation site into clean Markdown, intelligently chunked content with embeddings (Azure/OpenAI), and directly upsert into MongoDB Atlas, Pinecone, Weaviate, Qdrant, or Milvus — ready for RAG, AI assistants, and semantic search in minutes.

Arxiv Semantic Search

draouadmohamed/arxiv-semantic-search

Scrape arXiv papers by category and find relevant research using AI-powered semantic search. Get papers from any field (AI, physics, biology, economics, etc.) with embeddings for RAG systems. Find your categories at: https://arxiv.org/category_taxonomy

YouTube To Social AI - X Threads, LinkedIn Posts, Better Titles

openfrontier_ai/YouTube-to-Social-AI-X-Threads-LinkedIn-Posts-Better-Titles

Turn YouTube videos into viral social content with ViralVantage AI. Automatically generate high-engagement X threads, value-driven LinkedIn posts, and 5 optimized titles using AI. Includes built-in transcript extraction for a seamless, all-in-one repurposing workflow.