Pricing

$1.20 / 1,000 markdown page delivereds

Try for free

Go to Apify Store

Website to Markdown Scraper — Pages for AI / RAG

Try for free

Convert public website pages to clean Markdown, CSV and AI-ready chunks for RAG. Lightweight HTML crawler with robots.txt checks and success-based pricing.

Pricing

$1.20 / 1,000 markdown page delivereds

Rating

0.0

(0)

Developer

Practical AI Lab

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Quick start

Enter up to 10 HTTPS URLs, set up to 50 pages per run and internal crawl depth 0–2. Start with one page and depth 0 to minimize cost.

The Actor reads robots.txt before each page; it doesn't log in, follow redirects or scrape blocked pages. It skips private addresses and non-HTML pages. JavaScript-only sites, consent walls and blocked sites aren't supported, and no content is invented.

Outputs: per-page Markdown, word count, page title, verified original URL, same-domain public links, AI chunks; downloadable CSV.

Search relevance: website scraper, website to markdown, webpage to text, markdown web scraper, RAG web crawler, scrape website to CSV.

Pricing

$0.0012 per successfully delivered result, billed by the markdown-page event. The event price includes platform run usage. No Actor monthly subscription or additional Actor-start/dataset-item event is configured. Failed or blocked requests do not trigger this successful-result event. Check the current Pricing tab before running, and set your run charge cap.

Small input example

{
  "startUrls": [
    "https://example.com/"
  ],
  "maxPages": 1,
  "maxDepth": 0
}

Dataset fields

url, title, markdown, wordCount, links, status, depth, aiChunks.

The structured dataset and CSV download are available from the run output. Use only data you are entitled to process and respect source-site terms, privacy obligations and intellectual-property rights. Contact Practical AI Lab through the Actor issue/message interface for support.

Website to Markdown for LLM — Crawl Website to Markdown

nexgendata/website-content-crawler

Website to markdown for LLM use: crawl website to markdown, text or HTML — entire sites, JS-rendered pages included. A website to markdown crawler for RAG pipelines, LLM context and AI training. Firecrawl & Jina alternative. Pay per page.

NexGenData

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Manas Mantri

Website Content Crawler to Markdown for RAG & LLMs

rod_analytics/website-to-markdown

Low-cost website content crawler: turn any site into clean Markdown for RAG, LLMs and AI agents at a flat $0.30 per 1,000 pages. Main-content extraction, GFM tables, RAG chunks, llms.txt per domain, robots.txt respected.

Rod Services

Website Content Crawler

pumpkinapi/website-content-crawler

Website content crawler for RAG and LLMs: crawls a website and saves each page as clean Markdown text, with menus, footers and cookie banners removed and duplicate pages skipped. Optional chunks with heading paths for vector databases. Reads sitemaps, respects robots.txt.

Pumpkin Farm

Website to Markdown Crawler: LLM and RAG Ready Markdown

smallgearsco/website-to-markdown

LLM and RAG ready Markdown from any website at $1.50 per 1,000 pages ($3 with JS rendering). Same-domain crawl, respects robots.txt.

Small Gears Co

Website to Markdown Scraper for AI & LLMs

quaking_pail/ai-website-content-markdown-scraper

Crawl a website and get clean Markdown of each page's main content, with URL and title. Ready for LLMs, RAG, vector databases and AI agents. Headless Chrome, same-domain crawl, API access.

AI_Builder

946

5.0

(1)

Knowledge Intelligence Engine — Website to Markdown for RAG

ryanclinton/website-content-to-markdown

Turn any website, documentation site or help centre into a retrieval-ready knowledge corpus for RAG and AI search. Clean Markdown plus chunks, change detection, deduplication, retrieval scoring, version awareness and a full corpus audit, in one run.

Ryan Clinton

Site Crawler: Website → Markdown Corpus for LLM/RAG

boxbox10/site-crawler

Crawl a whole website or docs site and get one clean, LLM-ready Markdown + JSON record per page (title, headings, content, links, token count). Built for RAG ingestion and AI knowledge bases.

Marvin Eguilos

Website to RAG Markdown Crawler

knotted_tussock/rag-markdown-crawler

Crawl any website or docs site and export clean Markdown plus JSONL-style chunks for RAG, LLM apps, and AI agents.

Ralph T

Website to Markdown Crawler for AI & RAG

aolmo/website-to-markdown

Crawls a website or one section of it and returns every page as clean Markdown (main content only) with title, description, language and dates, ready for LLMs, vector databases and RAG. Include and exclude URL patterns, robots.txt respected. $0.0005 per page.