URL to Markdown for AI Agents and RAG

Website & Page to Markdown for RAG and LLMs

humble-echidna/page-to-markdown

Turn web pages or whole sites into clean Markdown for RAG and LLMs: main content only, with title, links and word count. Whole-site mode reads the sitemap first, can return only changed pages, and splits pages into heading-based chunks. Respects robots.txt and AI opt-outs. No browser.

Website Content Crawler – Markdown for AI, Emails & Contacts

locomint/website-crawler-content-contacts

Website content crawler that turns a whole site into clean Markdown for LLM and RAG pipelines, with the role emails, social profiles and WhatsApp numbers found on each page. Seeded from the sitemap, honours robots.txt, plain HTTP with no browser.

Webpage to Markdown

epicscrapers/webpage-to-markdown

Get the main content of any page as Markdown. Great for LLMs and AI agent workflows.

Website to Markdown Scraper for AI & LLMs

quaking_pail/ai-website-content-markdown-scraper

Crawl a website and get clean Markdown of each page's main content, with URL and title. Ready for LLMs, RAG, vector databases and AI agents. Headless Chrome, same-domain crawl, API access.

Website Content Extractor — Pages to Markdown for LLM/RAG

taroyamada/website-content-extractor

Turn docs, help centers and pricing pages into clean Markdown for LLM and RAG: one row per URL with main text, title, word count and a content-quality score. No API key or login.

Convert web pages into clean Markdown for LLM and RAG pipelines, using 77% fewer tokens than a raw crawl while keeping every content section. Works in any language.

Extract clean, readable Markdown content from any URL. Strips ads, navigation, and clutter. Perfect for feeding web content into AI agents, RAG pipelines, or LLM training data.

Web to Markdown for LLMs

george.the.developer/web-to-markdown-llm

Convert any URL to clean LLM-ready markdown. 60-70% fewer tokens than raw HTML. Built for AI agents and RAG pipelines.

Extract website and documentation content as clean Markdown for RAG and AI knowledge bases. Crawl selected paths, keep source URLs and export JSON or CSV. $2 per 1,000 successful pages; failed pages are not charged.

Convert a webpage to Markdown and extract the main content from any URL. Turns HTML into clean Markdown for LLM context and RAG ingestion: strips nav, ads and boilerplate, keeps headings, lists and tables, returns title, byline, date and word count. No headless browser. Pay per page extracted.