Pinecone All-in-One Integration

YouTube All-in-One Downloader & Scraper

jy-labs/youtube-all-in-one-downloader-scraper

Download YouTube videos, Shorts, playlists, and channels as MP4. Up to 10 concurrent downloads with no browser needed. Extract comments, captions, and rich metadata. Metadata-only mode for fast, cheap research. Quality selection with automatic fallback. From $0.10/video.

Docs to Markdown + AI Embeddings → Vector DB Crawler

badruddeen/docs-to-markdown-ai-embeddings---vector-db-crawler

Turn any documentation site into clean Markdown, intelligently chunked content with embeddings (Azure/OpenAI), and directly upsert into MongoDB Atlas, Pinecone, Weaviate, Qdrant, or Milvus — ready for RAG, AI assistants, and semantic search in minutes.

Video Transcript Scraper

automation-lab/video-transcript-scraper

Extract transcripts and captions from YouTube, TikTok, Instagram Reels, and Facebook Reels. Get full text with timestamps. Supports 6+ languages.

RAG Web Browser

tugelbay/rag-web-browser

RAG web browser for AI agents. Search Google, scrape top results, return clean Markdown. One API call replaces Tavily + scraper combo. 256MB memory, 10x lighter than alternatives. Works with LangChain, Claude MCP, OpenAI.

RAG Pipeline

labrat011/rag-pipeline

One-click RAG pipeline: chunks text, generates embeddings, and stores vectors in Pinecone or Qdrant. Provide your content and API keys -- the orchestrator handles the rest.

Greenhouse Jobs Scraper

automation-lab/greenhouse-jobs-scraper

Scrape job listings from 220,000+ companies using Greenhouse ATS. Get titles, locations, departments, descriptions, and application questions from Airbnb, Stripe, Figma, and more. Fast HTTP-only API, no browser needed.

G2 Reviews & Products Scraper

automation-lab/g2-scraper

Scrape G2.com reviews, ratings, and product data. Extract NPS scores, reviewer sentiment, ease-of-use ratings, and competitive switching data from 5M+ reviews across 220K+ products. 3 modes: reviews, product search, category browse.

LLM Data Pipeline Pro

sanztheo/llm-data-pipeline-pro

Transform websites into LLM training data. Scrape, validate, deduplicate, chunk for RAG, and export to OpenAI/Anthropic/Mistral formats. Built-in PII detection and GDPR compliance. Vector DB export to Pinecone & Qdrant.

bioRxiv + medRxiv Scraper for RAG

devanshlive/biorxiv-medrxiv-rag-extractor

Scrape bioRxiv and medRxiv preprints by server, category, and date range. Returns RAG-ready JSON with JATS full-text chunks (cl100k_base, 512/50) when available and abstract fallback otherwise. Drop-in for LangChain, LlamaIndex, Qdrant, Pinecone, Weaviate, pgvector. $0.02 per preprint.

arXiv Scraper for RAG: Papers as Chunked JSON

devanshlive/arxiv-rag-extractor

Scrape arXiv papers by date and category. Strips LaTeX and returns RAG-ready JSON with tokenizer-aware chunks (cl100k_base, 512/50). Drop-in for LangChain, LlamaIndex, Qdrant, Pinecone, Weaviate, pgvector, Chroma. Skip GROBID / Nougat / pandoc. $0.015 per paper.

Reddit Scraper

automation-lab/reddit-scraper

Extract Reddit posts, comments, and user profiles from any subreddit. No login, no API key, no code needed. Filter by keywords, sort by new/hot/top. AI-ready JSON output for LLM pipelines. Export to CSV, Excel, or connect via API.