Website to Markdown Scraper — Pages for AI / RAG

Website to Markdown for LLM — Crawl Website to Markdown

nexgendata/website-content-crawler

Website to markdown for LLM use: crawl website to markdown, text or HTML — entire sites, JS-rendered pages included. A website to markdown crawler for RAG pipelines, LLM context and AI training. Firecrawl & Jina alternative. Pay per page.

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Website Content Crawler to Markdown for RAG & LLMs

rod_analytics/website-to-markdown

Low-cost website content crawler: turn any site into clean Markdown for RAG, LLMs and AI agents at a flat $0.30 per 1,000 pages. Main-content extraction, GFM tables, RAG chunks, llms.txt per domain, robots.txt respected.

Website Content Crawler

pumpkinapi/website-content-crawler

Website content crawler for RAG and LLMs: crawls a website and saves each page as clean Markdown text, with menus, footers and cookie banners removed and duplicate pages skipped. Optional chunks with heading paths for vector databases. Reads sitemaps, respects robots.txt.

LLM and RAG ready Markdown from any website at $1.50 per 1,000 pages ($3 with JS rendering). Same-domain crawl, respects robots.txt.

Website to Markdown Scraper for AI & LLMs

quaking_pail/ai-website-content-markdown-scraper

Crawl a website and get clean Markdown of each page's main content, with URL and title. Ready for LLMs, RAG, vector databases and AI agents. Headless Chrome, same-domain crawl, API access.

Knowledge Intelligence Engine — Website to Markdown for RAG

ryanclinton/website-content-to-markdown

Turn any website, documentation site or help centre into a retrieval-ready knowledge corpus for RAG and AI search. Clean Markdown plus chunks, change detection, deduplication, retrieval scoring, version awareness and a full corpus audit, in one run.

Crawl a whole website or docs site and get one clean, LLM-ready Markdown + JSON record per page (title, headings, content, links, token count). Built for RAG ingestion and AI knowledge bases.

Crawl any website or docs site and export clean Markdown plus JSONL-style chunks for RAG, LLM apps, and AI agents.

Website to Markdown Crawler for AI & RAG

aolmo/website-to-markdown

Crawls a website or one section of it and returns every page as clean Markdown (main content only) with title, description, language and dates, ready for LLMs, vector databases and RAG. Include and exclude URL patterns, robots.txt respected. $0.0005 per page.