Refinery — HTML to Text Cleaner for RAG Pipelines

⚡ Web to LLM Clean Markdown & RAG Crawler

unrivaled_fortress/llm-markdown-clean-web-crawler

Convert any webpage into clean, LLM-ready markdown. Strips ads, navbars, and cookie banners to optimize AI context tokens for ChatGPT, Claude, and RAG.

HTML Readability to Markdown Converter

automation-lab/html-readability-markdown-converter

Convert raw HTML or one anonymous public webpage into clean Markdown with headings, links, source metadata, and a content hash for RAG ingestion or archives.

🧩 LLM Dataset Builder - Site to Embedding-Ready Chunks

that_red_bird/llm-dataset-builder

⚡ Turn any site into a RAG dataset in one run. ✅ Clean markdown (code blocks, tables, headings kept; nav and cookie banners stripped), split into semantic chunks on heading boundaries with token estimates, configurable overlap and a source URL on every chunk. ✅ Ready to embed, no post-processing.

Convert PDFs to clean markdown with real reading order. Handles two-column layouts, detects headings and paragraphs. Built for RAG pipelines and LLM ingestion.

Convert one public web page or JavaScript-rendered article into clean Markdown for LLM, RAG, and AI-agent pipelines using lightweight HTTP fetching with an SSRF-hardened Playwright fallback.

AI Web Search Scraper - SERP & Page Content for LLM RAG

get_anything/ai-web-search-scraper

Web search API for LLMs: query -> clean results (title, URL, snippet, position, domain) and OPTIONALLY each page's full content as LLM-ready Markdown. Ground ChatGPT/Claude and RAG pipelines with live web results. Google (browser-rendered) or DuckDuckGo engine. Export JSON, CSV or Markdown.

You pay only for pages actually extracted. Nothing extracted, nothing charged. Turn PDF, HTML and text documents into clean plain text, optionally chunked with page numbers for retrieval. Ligatures expanded, hyphenation repaired, markup removed. You supply the URLs.

Website Text Extractor — Clean Text & Source Fingerprints

gertner-data/clean-website-text

Turn web pages into clean text for AI/RAG, content migration and ETL. Get title, author/date tags, word count and a SHA-256 content fingerprint in one JSON. Batch up to 100 URLs, up to 50,000 text characters per page. Launch price: $0.50/1,000 URL reports.

HTML Tables to Excel Exporter

automation-lab/html-table-to-excel-exporter

Convert native HTML tables from public webpages into one formatted XLSX workbook with a worksheet per page.

Turn any documentation site into a clean Markdown corpus: one file per page with front matter (title, URL, breadcrumbs), headings, code blocks with languages, tables and absolute links, plus an INDEX.json. Built for LLM wikis, RAG and offline docs. Pay per page.