Pricing

from $0.10 / actor start

Agent Ready Data Cleaner

Clean and token-optimise HTML, JSON, scraped text, or URLs for LLM pipelines. Strip boilerplate, chunk by semantics, get token counts — feed your agents clean data, not nav bars.

Pricing

from $0.10 / actor start

Rating

0.0

(0)

Developer

Les

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

Agent-Ready Data Cleaner

Apify Actor that transforms noisy URL/HTML/JSON/text inputs into clean, token-optimized chunks for LLM pipelines.

Features

URL input fetch (10s timeout, redirects followed) then clean as HTML
HTML cleanup with configurable boilerplate removal
JSON flattening with null/empty removal
Text sanitization (control chars + blank-line dedupe)
Semantic/fixed/none chunking
Token counting via gpt-tokenizer (per chunk + total)
Metadata extraction + cleanliness scoring

Input

See INPUT_SCHEMA.json.

Output

One dataset item per input record with:

chunks[] with tokenCount and chunkType
totalTokens
size/compression stats
optional metadata (title, description, canonicalUrl, wordCount, cleanlinessScore)

Pricing hint

$0.10 per start
$0.003 per result item

Local test

npm install
node test-local.js

Web Scraper RAG Ready

traorealexy/Web-Sraper-RAG-Ready

Turn any website into clean, token-efficient Markdown ready for RAG and LLM pipelines. Removes boilerplate, handles JavaScript rendering, and outputs structured JSON for LangChain, LlamaIndex, and vector databases.

Alexy Traore

Article Extractor

tugelbay/article-extractor

Extract clean article content from any URL. Get title, author, date, text, images, and metadata as Markdown or plain text. Removes ads and boilerplate. Perfect for LLM training data, RAG pipelines, and AI agents.

Tugelbay Konabayev

RAG Web Extractor — Chunked Content for AI Pipelines

junipr/rag-web-extractor

Extract clean markdown from websites for RAG pipelines. Strip nav, ads, boilerplate. Preserve headings, links, images. Recursive crawling with depth control. Chunked output for embedding pipelines. Build AI knowledge bases.

junipr

Ai Content Scraper Cleaner

dashjeevanthedev/ai-content-scraper-cleaner

AI Content Scraper & Cleaner — Scrapes structured content (documentation, articles, FAQs, blog posts) and converts it into clean, normalized JSON datasets for LLM training. Extracts text, detects content types, estimates tokens, and removes boilerplate to produce ready-to-use training data.

JEEVAN JYOTI DASH

AI Data Pipeline — Crawl, Chunk & Export to Vector DB

ozapp/ai-data-pipeline

Crawl any website, extract clean text, split into chunks with quality scoring, and export to JSON, Pinecone, or Qdrant. Built for RAG pipelines and AI training data. Includes language detection, content type classification, and token counting.

Ozapp

LLM Markdown Crawler

sleek_waveform/llm-markdown-crawler

Crawl any website and extract clean, boilerplate-free Markdown optimized for LLMs, RAG pipelines, and AI training datasets. Uses Mozilla Readability to strip navigation and ads, then converts to clean Markdown. No browser required — fast and cheap.

Daniel Dimitrov

DexScreener Scraper - Token Prices, Liquidity & Trades

sourabhbgp/dexscreener-scraper

Extract real-time crypto token prices, trading volume, liquidity, and transaction data from DexScreener across 80+ blockchains. 5 modes: search tokens, lookup pairs, get token pairs, browse boosted tokens, and fetch token profiles. Pay-per-event pricing at $2.00 per 1,000 results.