Pricing

Pay per usage

Website Content Crawler for AI — Clean Markdown, 4x Cheaper

Crawl any website and extract clean text/markdown for LLMs, RAG pipelines, vector databases. BFS crawl with depth control, robots.txt support, boilerplate removal. Perfect for feeding AI models. $0.001/page — 4x cheaper than the official Apify crawler.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Ken Digital

Actor stats

Bookmarked

Total users

Monthly active users

29 minutes ago

Last modified

Categories

This Actor‘s pricing details are outlined in the table below. The unit prices you pay depend on your Apify subscription plan, with higher tiers offering better rates. Visit our pricing page to compare plans and see how much you can save.

Pricing	Free No discount	Starter Bronze discount	Scale Silver discount	Business Gold discount
Compute units (CU)	$0.30 / CU	$0.30 / CU	$0.25 / CU	$0.20 / CU
Actor RAM	8 GB	32 GB	128 GB	256 GB
Max concurrent runs	25	32	128	256
Rented Actors		Deducted from prepaid usage	Deducted from prepaid usage	Deducted from prepaid usage
Residential proxies	$8.00 / GB	$8.00 / GB	$7.50 / GB	$7.00 / GB
Datacenter proxies	5 IPs included	30 IPs included then $1.00 / IP	200 IPs included then $0.80 / IP	500 IPs included then $0.60 / IP
SERPs proxy	$2.50 / 1,000 SERPs	$2.50 / 1,000 SERPs	$2.00 / 1,000 SERPs	$1.70 / 1,000 SERPs

This Actor's pricing details are outlined in the table below. The unit prices you pay depend on your Apify subscription plan, with higher tiers offering better rates. Visit our pricing page to compare plans and see how much you can save.

Costs
Platform usage Platform usage costs are tied to the Actor's performance in terms of the underlying platform resources it consumes. Learn more	Variable costs cheaper for higher plans.

Website Content Crawler

mikolabs/website-content-crawler

Deep-crawl websites to extract clean text, Markdown, or HTML for AI/LLM apps, RAG pipelines, and vector databases. Supports adaptive crawling, HTML cleaning, file downloads, and structured dataset output. Easily integrates with LangChain, LlamaIndex, and other LLM tools.

mikolabs

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

112K

4.4

(179)

RAG Web Extractor

junipr/rag-web-extractor

Extract clean markdown from websites for RAG pipelines. Strip nav, ads, boilerplate. Preserve headings, links, images. Recursive crawling with depth control. Chunked output for embedding pipelines. Build AI knowledge bases.

junipr

AI Training Data Scraper - LLM and RAG-Ready

george.the.developer/ai-training-data-scraper

Extract web content formatted for LLM fine-tuning and RAG pipelines. Output in OpenAI JSONL, Claude JSONL, Markdown, or raw text.

George Kioko

Clean Web Scraper - Markdown for AI via Firecrawl

clearpath/web-to-markdown

Convert any website to clean, LLM-optimized markdown using Firecrawl. Perfect for RAG pipelines, AI training data, and knowledge bases. No login required, 25% cheaper than Firecrawl direct. Batch process hundreds of URLs. Supports PDF/DOCX. Pay only $0.004 per page - no monthly fees.

ClearPath

Reddit Scraper

automation-lab/reddit-scraper

Extract Reddit posts, comments, and user profiles from any subreddit. No login, no API key, no code needed. Filter by keywords, sort by new/hot/top. AI-ready JSON output for LLM pipelines. Export to CSV, Excel, or connect via API.

Stas Persiianenko

265

4.3

(2)

Rag Architect

ai_solutionist/rag-architect

Transform any website into vector-store-ready knowledge chunks for Pinecone, Weaviate, LangChain, LlamaIndex, Supabase, n8n & more. AI-generated Q&A pairs, smart chunking, PII scrubbing. Build hallucination-free RAG chatbots in minutes.

Jason Pellerin

Sitemap to URL Crawler

logiover/sitemap-to-url-crawler

nstantly extract all public URLs from any website's sitemap.xml recursively. Handles nested sitemap indexes automatically. The fastest & cheapest way to build URL lists for RAG pipelines, LLM training, and SEO audits. Zero-config & blazing fast.