Scraped Text Sanitizer

Extract clean plain text from any HTML content. Strip tags, scripts, and boilerplate automatically. Essential for NLP, content analysis, and data pipelines.

Normalize Japanese text for data pipelines: Unicode NFKC (full/half-width unification), wave-dash unification, whitespace cleanup, hiragana/katakana conversion, Japanese-aware sentence splitting, and per-script character stats.

HTML Scraper

making-data-meaningful/html-scraper

Access and extract full HTML source code from any webpage instantly. The HTML Scraper API lets you retrieve clean, accurate page HTML for SEO analysis, web scraping, and content monitoring - all without being blocked.

Minify HTML by removing whitespace, comments, and optional attributes. Configurable compression.

Format and clean messy CSV data in one click. Fix delimiters, remove whitespace, normalize headers. Essential tool for data analysts and engineers.

Encode and decode text across Base64, URL-encoding, HTML-entities and hex in one pass. Handy for developers and data cleaning. Offline, no API keys.

Clean and token-optimise HTML, JSON, scraped text, or URLs for LLM pipelines. Strip boilerplate, chunk by semantics, get token counts — feed your agents clean data, not nav bars.

Refinery — HTML to LLM Text (Cut RAG Token Cost)

larelabs/refinery-html-to-llm-cleaner

HTML to LLM text cleaner for RAG pipelines. Strip scripts, nav & layout junk after Firecrawl or your fetch. BeautifulSoup-alternative speed. $0.002/page · 3 README demos in Console.

Clean and normalize JSON/CSV data: trim whitespace, lowercase emails, normalize phone numbers and dates, drop empty values/rows, and deduplicate by a field.

Text Cleaner For RAG

junipr/text-cleaner-for-rag

Clean web text for RAG by removing boilerplate, normalizing whitespace, and producing chunk-ready text.