Rag Pipeline Manager Mcp

Web Crawler & Semantic Schema-Enhanced Extractor

devil_port369-owner/web-crawler

Depth-controlled web crawler that transforms websites into structured analytics-ready data. Starting from one or more URLs, it crawls internal links up to a configurable depth and outputs detailed JSON records per page

Stock News Scraper - Finviz

michael_b/finviz-ticker-news

Get real-time stock and company news for any ticker symbol. Returns headlines, sources, publication dates, and full article text as clean markdown. Powered by Finviz data. Supports multiple tickers per run. Built for AI agents, LLM pipelines, sentiment analysis, and automated market monitoring.

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs.

Chat With Website

happitap/chat-with-website

Chat with Website enables your AI chatbots and assistants to access real-time web content. It accepts search queries or URLs, retrieves relevant pages, and converts them to clean text or Markdown that your AI can understand and use in conversations.

Documents → embeddings → vector DB. Chunking, embedding generation, and ingestion for Pinecone, Weaviate, or Chroma.

Justjoin Jobs Search Scraper

stealth_mode/justjoin-jobs-search-scraper

Streamline your recruitment pipeline with automated job search scraping from JustJoin.it. Extract bulk job listings with filters, categories, and real-time market data. Ideal for tracking hiring trends, competitive analysis, and building comprehensive tech talent databases across Central Europe.

Ai Memory Engine

ruv/ai-memory-engine

Give your AI persistent memory. Store conversations, search semantically, build knowledge graphs, and watch your AI get smarter with every interaction.

Rag Pipeline

labrat011/rag-pipeline

One-click RAG pipeline: chunks text, generates embeddings, and stores vectors in Pinecone or Qdrant. Provide your content and API keys -- the orchestrator handles the rest.

Markitdown Mcp Server

rector_labs/markitdown-mcp-server

Cloud-hosted MCP server converting 29+ document formats (PDF, DOCX, PPTX, images, audio) to AI-ready Markdown. Zero Python setup. Perfect for RAG pipelines and AI agents. Pay-per-use: $0.02/conversion. Built on Microsoft's Markitdown (82k+ ⭐).

Crawl any website and convert every page to clean, structured Markdown. Perfect for RAG pipelines, LLM training data, vector database ingestion, knowledge base building, and AI-powered search. Extracts main content, strips boilerplate, handles metadata, and chunks output for embeddings. Works with L