Pricing

from $5.00 / 1,000 page crawleds

API Documentation Crawler for RAG & AI Agents

Crawl API documentation sites and extract structured, LLM-ready content. Use via Apify Console/API or connect as an MCP server for Claude, Cursor, and other AI agents.

Pricing

from $5.00 / 1,000 page crawleds

Rating

0.0

(0)

Developer

Aaron Hampton

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

Developer tools

MCP servers

This Actor‘s pricing details are outlined in the table below. The unit prices you pay depend on your Apify subscription plan, with higher tiers offering better rates. Visit our pricing page to compare plans and see how much you can save.

Pricing	Free No discount	Starter Bronze discount	Scale Silver discount	Business Gold discount

Page crawled	$5.00 / 1,000	$5.00 / 1,000	$5.00 / 1,000	$5.00 / 1,000
Chunk generated	$1.00 / 1,000	$1.00 / 1,000	$1.00 / 1,000	$1.00 / 1,000
Mcp tool call Infrequent	$0.01	$0.01	$0.01	$0.01
Actor start Infrequent	$0.00005	$0.00005	$0.00005	$0.00005
Additional costs
Compute units (CU)	$0.20 / CU	$0.20 / CU	$0.16 / CU	$0.13 / CU
Actor RAM	16 GB	64 GB	256 GB	512 GB
Max concurrent runs	25	32	128	256
Rented Actors		Deducted from prepaid usage	Deducted from prepaid usage	Deducted from prepaid usage
Residential proxies	$8.00 / GB	$8.00 / GB	$7.50 / GB	$7.00 / GB
Datacenter proxies	5 IPs included	30 IPs included then $1.00 / IP	200 IPs included then $0.80 / IP	500 IPs included then $0.60 / IP
SERPs proxy	$2.50 / 1,000 SERPs	$2.50 / 1,000 SERPs	$2.00 / 1,000 SERPs	$1.70 / 1,000 SERPs

This Actor's pricing details are outlined in the table below. The unit prices you pay depend on your Apify subscription plan, with higher tiers offering better rates. Visit our pricing page to compare plans and see how much you can save.

Pricing

Page crawled Charged for each API documentation page successfully crawled and extracted. First 10 pages per run or MCP tool call are free.	$5.00 / 1,000
Chunk generated Charged for each RAG-ready text chunk generated from crawled pages. First 10 chunks per run or MCP tool call are free.	$1.00 / 1,000
Mcp tool callInfrequent Flat fee for each MCP tool call (crawl_api_docs or get_page_chunks).	$0.01
Actor startInfrequent Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).	$0.00005
Additional costs
Platform usage Platform usage costs are tied to the Actor's performance in terms of the underlying platform resources it consumes. Learn more	Variable costs cheaper for higher plans.

Compliance-Grade Web Intelligence for AI Agents

ai_solutionist/compliance-web-intel

The scraper AI agents trust. Extract grounded facts with citations, entities, claims & RAG chunks. Built for LangChain, LlamaIndex, AutoGPT. Quality scoring, auto-citations, 6 task modes.

Jason Pellerin

NPS Park Conditions, Alerts & Data Scraper

jungle_synthesizer/nps-park-conditions-alerts-api-scraper

Scrape the NPS API for parks, alerts, campgrounds, events, news, things to do, and visitor centers. Filter by state or park code. Returns unified records with coordinates, entrance fees, hours, and more. Ideal for trip planning apps and AI agents monitoring closures and danger advisories.

BowTiedRaccoon

Arxiv Semantic Search

draouadmohamed/arxiv-semantic-search

Scrape arXiv papers by category and find relevant research using AI-powered semantic search. Get papers from any field (AI, physics, biology, economics, etc.) with embeddings for RAG systems. Find your categories at: https://arxiv.org/category_taxonomy

Mohamed Aouad

OpenAPI Spec Scraper — APIs to LLM Agent Tools (MCP-Ready)

scrapersdelight/openapi-spec-scraper

Bulk-scrape machine-readable API specs from the apis.guru directory (2,500+ APIs) or any spec URL, normalized into LLM-agent-ready rows — one per endpoint: method, path, summary, parameters, auth, tags. Build agent-tool / RAG datasets in one run. $4 per 1,000 endpoints.

Scrapers Delight

RAG Website Crawler - Markdown Chunks for LLMs & MCP

themineworks/rag-crawler

Crawl any website into clean, pre-chunked Markdown with per-chunk token counts for RAG pipelines, vector DBs (Pinecone, Qdrant) and LLM context. MCP-native for Claude & ChatGPT. SPA support via Playwright. Pay only for pages that crawl. A Firecrawl alternative.

The Mine Works

YouTube Transcript API & Bulk Subtitle Downloader

tugelbay/youtube-transcript

Bulk YouTube transcript API for SRT/VTT, Markdown, JSON, and text exports with metadata for AI/RAG, research, subtitles, and content workflows. Guide: https://konabayev.com/tools/youtube-transcript-scraper/?utm_source=apify_info&utm_medium=referral&utm_campaign=youtube-transcript

Tugelbay Konabayev

Article Extraction API

tugelbay/article-extractor

Extract clean article text and metadata from URLs as Markdown, text, or HTML for RAG, AI agents, monitoring, and research. Guide: https://konabayev.com/tools/article-extractor/?utm_source=apify_info&utm_medium=referral&utm_campaign=article-extractor

Tugelbay Konabayev

Web Content Extractor API — URL to JSON

george.the.developer/web-content-extractor-api

Extract structured JSON from any webpage. Articles, products, recipes, jobs. Auto-detects content type. Returns metadata, headings, images, links. For AI agents and RAG.

George Kioko

GitHub Trending Scraper

automation-lab/github-trending-scraper

Scrape GitHub Trending repositories by language and time range: today, this week, or this month. Extracts repo names, star counts, forks, star gains, and top contributors. Great for dev trend tracking, tech newsletters, and investment research. Export to JSON, CSV, or Excel.

Stas Persiianenko

AI Web Crawler

hounderd/ai-web-crawler

Crawl websites and extract clean, LLM-ready markdown content with stealth browser rendering, anti-bot hardening, smart content filtering, and structured metadata extraction. Built for RAG pipelines, AI agents, and data workflows.