Pricing

Pay per usage

GitHub Repo Docs Scraper for RAG & AI Agents

Fetch documentation from GitHub repositories — READMEs, docs folders, wikis — and convert to clean, chunked markdown optimized for RAG pipelines. Use via Apify Console/API or connect as an MCP server for Claude, Cursor, and other AI agents.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Aaron Hampton

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

API Documentation Crawler for RAG & AI Agents

ahampton83/api-docs-rag-crawler

Crawl API documentation sites and extract structured, LLM-ready content. Use via Apify Console/API or connect as an MCP server for Claude, Cursor, and other AI agents.

Aaron Hampton

YouTube Transcript Scraper — Subtitles & Captions for RAG

ahampton83/youtube-transcript-scraper

Fetch YouTube video transcripts and subtitles as clean text or timestamped segments. Perfect for RAG pipelines, content analysis, and AI agents. Use via Apify Console/API or connect as an MCP server for Claude, Cursor, and other AI agents.

Aaron Hampton

News Article & RSS Crawler — Clean Text for RAG

ahampton83/news-article-crawler

Fetch news from RSS feeds and Google News search, then extract clean article text and metadata. Perfect for RAG pipelines, newsletters, trend monitoring, and AI agents. Use via Apify Console/API or connect as an MCP server for Claude, Cursor, and other AI agents.

Aaron Hampton

Docs Markdown Rag Ready Crawler

devwithbobby/docs-markdown-rag-ready-crawler

Turn any documentation site or website into clean, structured markdown—ready for RAG, embeddings, and AI agents.

Dev with Bobby

GitHub MCP — Repo Search, Stats & Compare for AI Agents

nexgendata/github-mcp-server

MCP server exposing GitHub repo search, stats, language breakdown and comparison as agent tools. Connect Claude, Cursor, n8n or the OpenAI Agents SDK.

NexGenData

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Manas Mantri

Website to RAG Markdown Crawler

knotted_tussock/rag-markdown-crawler

Crawl any website or docs site and export clean Markdown plus JSONL-style chunks for RAG, LLM apps, and AI agents.

Ralph T

Docs MCP Server Starter — Live Docs: Claude, Cursor & AI Agents

joeslade/docs-mcp-server-starter

Persistent MCP server that gives Claude, Cursor, and any MCP-compatible AI assistant queryable access to technical documentation. Indexes any docs site, exposes search and fetch tools over MCP, caches pages for speed. Ships with templates for Next.js, Tailwind, React, TypeScript, Prisma.

Joe Slade

GitHub Repository Analyzer for AI Agents

project_bbb/github-repo-analyzer

Extracts structured data from GitHub repositories for AI agents and RAG pipelines. Supports README, file tree, dependencies, issues, contributors extraction with multiple output formats.