Pricing

from $5.00 / 1,000 clean markdown pages

Go to Apify Store

AI-Ready Documentation Crawler

Try for free

Scrapes developer docs and outputs perfectly formatted Markdown for LLM fine-tuning.

Pricing

from $5.00 / 1,000 clean markdown pages

Rating

0.0

(0)

Developer

Milton Gardener

Actor stats

Bookmarked

Total users

Monthly active users

12 hours ago

Last modified

My beautiful actor

Contains a documentation what your Actor does and how to use it, which is then displayed in the app or library. It's always a good idea to write a good README.md, in a few months not even you will remember all the details about the Actor.

You can use Markdown language for rich formatting.

Llm Ready Documentation Scraper

direct_duty/llm-ready-documentation-scraper

Developers and AI agents need to read documentation (e.g. Stripe Docs, Next.js Docs), but standard scrapers return noisy HTML that includes: navigation bars headers / footers ads / cookie banners This Actor must return pure content-only Markdown, suitable for vectorization and semantic search.

Sean

rag-docs-scraper

marbled_jury/my-actor

Extract clean, RAG-optimized Markdown from any technical documentation. Built for LLMs and AI agents. No noise, just high-fidelity data.

Hastin S.

Context Layer

evertools/context-layer

Transforms documentation sites into a clean, structured context layer for AI systems—handling crawling, extraction, intelligent chunking, and optional enrichment for RAG, fine-tuning, and semantic search.

Mike

Markdownify MCP Server

crawlerbros/markdownify-mcp-server

Convert any webpage to clean, formatted Markdown perfect for AI consumption. Ideal for building knowledge bases, documentation scrapers, and content migration tools.

Crawler Bros

5.0

(28)

Ai Content Scraper Cleaner

dashjeevanthedev/ai-content-scraper-cleaner

AI Content Scraper & Cleaner — Scrapes structured content (documentation, articles, FAQs, blog posts) and converts it into clean, normalized JSON datasets for LLM training. Extracts text, detects content types, estimates tokens, and removes boilerplate to produce ready-to-use training data.

JEEVAN JYOTI DASH

Loom Scraper

automation-lab/loom-scraper

Extract Loom video transcripts, metadata, and direct download URLs. All-in-one: transcript with timestamps + owner/view data + MP4 URL. Pure HTTP — fast and cheap. No API key needed.

Stas Persiianenko

/llms.txt Generator

jakub.kopecky/llmstxt-generator

The /llms.txt Generator 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

Jakub Kopecký

772

3.1

(2)

Website Content Crawler Pro

datascoutapi/website-content-crawler-pro

Crawl websites and extract clean, structured content in Markdown, JSON, or plain text for AI models, LLMs, vector DBs, or RAG pipelines. Fast, reliable, and stealthy, with bulk processing, advanced metadata extraction, and seamless integration with LangChain, LlamaIndex, and AI workflows.

halam

538

2.1

(3)

Reddit Scraper

automation-lab/reddit-scraper

Extract Reddit posts, comments, and user profiles from any subreddit. No login, no API key, no code needed. Filter by keywords, sort by new/hot/top. AI-ready JSON output for LLM pipelines. Export to CSV, Excel, or connect via API.

Stas Persiianenko

992

4.8

(3)

Instagram Hashtag Scraper

scrapesmith/instagram-hashtag-scraper

⚡ Instagram Hashtag Scraper – Extract posts & reels from any public hashtag. Get captions, likes, views, comments, timestamps & media URLs. Bulk hashtag support, no login needed. Export to JSON, CSV or Excel. $0.50/1,000 results.