Under maintenance

Pricing

Pay per usage

Try for free

Go to Apify Store

Refinery — HTML to LLM Text (Cut RAG Token Cost)

Under maintenance

Try for free

HTML to LLM text cleaner for RAG pipelines. Strip scripts, nav & layout junk after Firecrawl or your fetch. BeautifulSoup-alternative speed. $0.002/page · 3 README demos in Console.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Lare Labs

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Categories

Developer tools

Agents

You can access the Refinery — HTML to LLM Text (Cut RAG Token Cost) programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "urls": [],
10    "raw_payload": "",
11}
12
13# Run the Actor and wait for it to finish
14run = client.actor("larelabs/refinery-html-to-llm-cleaner").call(run_input=run_input)
15
16# Fetch and print Actor results from the run's dataset (if there are any)
17print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
18for item in client.dataset(run["defaultDatasetId"]).iterate_items():
19    print(item)
20
21# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

RAG HTML Cleaner — Reduce LLM Tokens | Apify Actor API in Python

The Apify API client for Python is the official library that allows you to use Refinery — HTML to LLM Text (Cut RAG Token Cost) API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Refinery — HTML to LLM Text (Cut RAG Token Cost) API in JavaScript

Refinery — HTML to LLM Text (Cut RAG Token Cost) API through CLI

Refinery — HTML to LLM Text (Cut RAG Token Cost) OpenAPI definition

Refinery — HTML to LLM Text (Cut RAG Token Cost) API

Website to Markdown for LLM and RAG

jeweled_jockstrap/my-actor-3

Convert any URL to clean Markdown text for AI applications. Strips HTML extracts content. For LLM training RAG pipelines and vector databases. Free Firecrawl alternative.

Juan Triviño

Agent Ready Data Cleaner

topnetworks/agent-ready-data-cleaner

Clean and token-optimise HTML, JSON, scraped text, or URLs for LLM pipelines. Strip boilerplate, chunk by semantics, get token counts — feed your agents clean data, not nav bars.

Les

Website to Markdown Crawler for LLM & RAG

logiover/website-text-markdown-crawler

Crawl any website to clean Markdown and plain text for LLM training and RAG. HTML to Markdown, no API or login. Export website text to CSV or JSON.

Logiover

HTML to Markdown/Text

wowo51/html-to-md

Convert html to md or txt. Perfect for AI agents that need to cut expensive LLM costs.

Warren Harding

LLM-Ready Web Scraper – RAG & Vertical Data Extraction

conceivable_extension/llm-ready-web-scraper

Scrapes any URL and returns clean LLM-ready content. Strips ads, nav, and boilerplate. Returns markdown, chunked text, token estimates, and metadata. Vertical modes for Legal, Medical, Property, E-commerce, Research, and News. Firecrawl alternative at $0.005 per URL.

joseph fadero

Reddit RAG Dataset — LLM Training Data from Posts & Comments

blackfalcondata/reddit-rag-dataset

Build clean LLM and RAG datasets from Reddit. Export posts with full comment threads as ready-to-chunk text, HTML and Markdown — only text-bearing records with parent/child thread structure. No login or developer token needed.

Black Falcon Data

AI Training Data Scraper - LLM and RAG-Ready

george.the.developer/ai-training-data-scraper

Extract web content formatted for LLM fine-tuning and RAG pipelines. Output in OpenAI JSONL, Claude JSONL, Markdown, or raw text.

George Kioko

Website Content Crawler

crawlerbros/website-content-crawler

Crawls websites and extracts clean text, markdown, or HTML content. Ideal for LLM training data, RAG pipelines, and knowledge base building.

Crawler Bros

Website to Markdown Converter for LLM Training

pink_comic/website-content-to-markdown

Convert any web page to clean Markdown. Strips nav, ads, scripts, styling. Preserves headings, lists, tables, code blocks, links. Perfect for LLM training data, RAG pipelines, content migration, documentation archival, and text analysis. Bulk processing with word/link/image counts.