Website Embeddings for RAG - Vector DB, Pinecone, Qdrant

Qdrant Integration

apify/qdrant-integration

Transfer data from Apify Actors to a Qdrant vector database.

Website Content Crawler - Clean Text, Markdown & RAG Chunks

topapi/website-content-crawler

Crawl any website or URL list for $1.20 per 1,000 pages: one row per page with clean text, Markdown, HTML, metadata, links, headings, tables and RAG chunks. Plain HTTP first, headless Chrome only for JavaScript pages. Sitemaps, llms.txt, PDF/DOCX text, Bing/DuckDuckGo search, change monitor.

Tech Docs to LLM-Ready Markdown

hedelka/tech-docs-scraper

Scrapes technical documentation sites (Docusaurus, GitBook, MkDocs, ReadTheDocs) and converts them to clean, structured Markdown for RAG pipelines, LLM training, and AI assistants. Automatically detects documentation framework and removes navigation elements.

PDF & Image to Text OCR for AI Agents - No Login

cliqtomedia/pdf-text-ocr

Extract clean text or Markdown from PDF and image URLs. Uses the PDF text layer when present and Tesseract OCR for scanned pages, per page. 20 languages, page ranges, per-page rows. No login, no API key.

Tripadvisor Reviews Scraper

blueskyscraper/tripadvisor-reviews-scraper

[$4/1K reviews, 20% below the leader, paid plans down to $0.72/1K] Scrape Tripadvisor reviews of hotels, restaurants and attractions: rating, title, text, review date, visit month, reviewer, photos, owner response with date. Filter by stars, traveller type, month. Only-new mode. No start fee.

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Text Chunker & Embeddings for RAG (LangChain, LlamaIndex)

steady_kahikatea/text-chunker-embeddings

Split Markdown, text and web pages into heading-aware, token-sized chunks with overlap, and optionally embed them with a local CPU model (bge-small, MiniLM). No API key. Output works with LangChain, LlamaIndex, Pinecone, Qdrant and pgvector.

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.