Unicode Normalizer — Accent Strip & Transliterate

Scraped Text Sanitizer

nibble/scraped-text-sanitizer

Fix mojibake, decode HTML entities, strip HTML tags, NFKC-normalize, and collapse whitespace in text records you supply.

Unicode Text Inspector — codepoint, normalize, homoglyph

perryay/unicode-inspector

Deep Unicode inspection: reveals every codepoint as U+XXXX with block/name. Detects invisible chars (zero-width, BOM, RTL/LTR overrides). Identifies mixed encodings and mojibake. Performs NFC/NFD/NFKC/NFKD normalization. Security mode detects homoglyph/confusable characters.

Domain List Cleaner — Normalize & Dedupe URLs

night111/domain-list-cleaner

Clean messy domain and URL lists: normalize, strip paths, remove social-only hosts, dedupe. Perfect prep step before contact enrichment.

Unicode Text Inspector

maximedupre/unicode-text-inspector

Inspect pasted text for hidden Unicode characters, zero-width spaces, bidi controls, control characters, and homoglyphs. Get risk levels, issue evidence, category counts, cleaned text, and batch summaries.

Normalize Japanese text for data pipelines: Unicode NFKC (full/half-width unification), wave-dash unification, whitespace cleanup, hiragana/katakana conversion, Japanese-aware sentence splitting, and per-script character stats.

AI Website Content Extractor

scrapeai/ai-website-content-extractor

Crawl website pages, strip noise, and convert the main content to clean Markdown for RAG/LLM training.

Clean and token-optimise HTML, JSON, scraped text, or URLs for LLM pipelines. Strip boilerplate, chunk by semantics, get token counts — feed your agents clean data, not nav bars.

LLM Markdown Crawler

sleek_waveform/llm-markdown-crawler

Crawl any website and extract clean, boilerplate-free Markdown optimized for LLMs, RAG pipelines, and AI training datasets. Uses Mozilla Readability to strip navigation and ads, then converts to clean Markdown. No browser required — fast and cheap.

Scan webpages or text for prompt injection, secret exfiltration, hidden instructions and Unicode control characters.