Text Cleaner For RAG
Pricing
from $3.90 / 1,000 item checkeds
Text Cleaner For RAG
Clean web text for RAG by removing boilerplate, normalizing whitespace, and producing chunk-ready text.
Text Cleaner For RAG
Pricing
from $3.90 / 1,000 item checkeds
Clean web text for RAG by removing boilerplate, normalizing whitespace, and producing chunk-ready text.
Chunk ID
chunkId
Optional
Stable identifier for the cleaned chunk.
Document ID
documentId
Optional
Source document identifier.
Title
title
Optional
Source document title.
Source URL
sourceUrl
Optional
Optional source URL.
Chunk Index
chunkIndex
Optional
Zero-based chunk index within the source document.
Chunk Text
chunkText
Optional
Cleaned chunk text ready for embedding or retrieval.
Character Count
charCount
Optional
Characters in the chunk.
Word Count
wordCount
Optional
Words in the chunk.
Token Estimate
tokenEstimate
Optional
Approximate token count using four characters per token.
Status
status
Optional
Chunk generation status.
Removed Line Count
removedLineCount
Optional
Lines removed from the source document.
Duplicate Line Count
duplicateLineCount
Optional
Repeated lines removed from the source document.
Boilerplate Line Count
boilerplateLineCount
Optional
Boilerplate-pattern lines removed from the source document.
Issues
issues
Optional
Structured document or chunk issues.
Processed At
processedAt
Optional
ISO timestamp when the chunk was generated.
Recommendation
recommendation
Optional
Suggested next step.