Pricing

from $0.98 / 1,000 results

Try for free

Go to Apify Store

⚡ Web to LLM Clean Markdown & RAG Crawler

Try for free

Convert any webpage into clean, LLM-ready markdown. Strips ads, navbars, and cookie banners to optimize AI context tokens for ChatGPT, Claude, and RAG.

Pricing

from $0.98 / 1,000 results

Rating

0.0

(0)

Developer

David A

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

🤖 LLM Markdown Web Scraper — Firecrawl & Jina Reader Alternative

Token-optimized web scraper and HTML-to-Markdown purifier designed specifically for AI Agents, RAG pipelines, LLM fine-tuning, and vector databases. Strips cookie banners, navigation menus, ads, and CSS/JS clutter to deliver pristine, GitHub-flavored Markdown.

⚡ Key Features

🧼 Intelligent Boilerplate Stripping: Automatically detects and purges navigation headers, footers, cookie banners, advertisements, and sidebar clutter.
🧠 Token-Efficient LLM Ingestion: Reduces prompt token usage by 60%–80% compared to raw HTML or generic text dumps.
📊 RAG Metadata Included: Preserves canonical URLs, page titles, author credits, OpenGraph preview images, and estimated LLM token counts.
📑 Structure Preservation: Keeps tables, code blocks, lists, blockquotes, and relevant links intact.
💰 Cost Effective: Pay-Per-Event pricing at just $0.0015 / page ($1.50 / 1,000 pages).

📥 Input Parameters

Field	Type	Description	Default
`urls`	Array of strings	List of target web page URLs	`["https://news.ycombinator.com"]`
`stripBoilerplate`	Boolean	Remove navigation, headers & footers	`true`
`includeImages`	Boolean	Keep markdown image tags `![alt](url)`	`true`

📤 Output Format

{
  "url": "https://apify.com/about",
  "resolvedUrl": "https://apify.com/about",
  "canonicalUrl": "https://apify.com/about",
  "title": "About Apify | The web scraping and automation platform",
  "description": "We are building the world's leading web scraping and data extraction platform.",
  "author": "Apify Technologies",
  "ogImage": "https://apify.com/og-image.jpg",
  "httpStatus": 200,
  "wordCount": 642,
  "characterCount": 4210,
  "estimatedLlmTokens": 1107,
  "markdown": "# About Apify\n\nApify is the cloud platform for web scraping..."
}

🔥 The B2B Contact & OSINT Intelligence Suite

Combine these actors to build a full-spectrum OSINT & lead intelligence stack:

Tool	Purpose	Pricing	Link
🕵️‍♂️ Digital Footprint & OSINT Investigator	Trace emails, usernames & phones across 30+ sites	$3.00 / 1K	View on Store →
💼 B2B Tech Stack & Lead Enricher	BuiltWith alternative — detect 120+ technologies	$3.00 / 1K	View on Store →
📺 YouTube Subtitles & AI LLM Context	Instant transcript & timestamp extractor for RAG	$1.50 / 1K	View on Store →
📣 Meta Ads Library Creative Spy	Scrape competitor Facebook & Instagram ads	$2.00 / 1K	View on Store →
🤖 LLM Markdown Clean Web Crawler	Firecrawl alternative — token-optimized Markdown	$1.50 / 1K	View on Store →
🔥 LinkedIn Employees Scraper	Extract decision makers & team members	$5.00 / 1K	View on Store →
📍 Google Maps Business Leads	Extract local businesses, addresses & phones	$2.00 / 1K	View on Store →
🛡️ Email Data Breach Hunter	Detect compromised credentials & database leaks	$3.00 / 1K	View on Store →

⭐ Loved using this Actor?

If this Actor powered your data pipelines or saved you hours of manual research, please take 10 seconds to leave a 5-star rating! It helps independent creators maintain high-speed public tools.

👉 Click here to leave a review & rating on Apify Store

Crafted with precision by David Ahn · High-velocity data intelligence

AI Web Crawler

hounderd/ai-web-crawler

Crawl websites and extract clean, LLM-ready markdown content with stealth browser rendering, anti-bot hardening, smart content filtering, and structured metadata extraction. Built for RAG pipelines, AI agents, and data workflows.

Hounderd

Ai Ready Web Page To Markdown Converter

mustafa.irshaid.113/ai-ready-web-page-to-markdown-converter

Convert any webpage into structured Markdown and HTML using just a URL. Get the page title, link, and content—perfect for SEO, devs, and AI crawlers. Fast, clean, and ideal for repurposing or analysis. Start turning websites into Markdown instantly.

Mustafa Irshaid

Website To Markdown

smart_api/website-to-markdown

Convert any webpage into clean, LLM-ready Markdown in seconds — perfect for AI training data, RAG pipelines, and content archiving.

SmartApi

5.0

(1)

X (Twitter) Article to Markdown Scraper - Long Form Posts

seemuapps/x-article-to-markdown-scraper

Convert any X (Twitter) long-form Article or Notes post into clean Markdown, ready for AI, RAG, and LLM ingestion pipelines.

Seemu Scraping

Website Content Crawler — Markdown for LLM & RAG

brilliant_gum/web-content-crawler

Deep-crawl websites and extract LLM-ready Markdown with OG tags, JSON-LD, author, dates, token estimates, native RAG chunking, language filtering, content-hash dedup, and per-page error reporting. Enforced timeouts. Zero silent failures.

Yuliia Kulakova

Universal Web to Markdown (Bulk & AI-Ready)

lentic_october/web-to-markdown-converter

Bulk convert any website URLs to clean Markdown for AI & LLMs. Universal scraper that removes ads, scripts, and clutter. Optimized for RAG, ChatGPT, Claude, and LangChain. Fast, async, and API-ready.

kalthireddy Abhishek

Web-to-Markdown Generator for AI & RAG Pipelines

profitstack/web-to-markdown-generator-for-ai-rag-pipelines

Convert any website into clean, heading-based chunking, LLM-ready Markdown for RAG and AI agents.

Manas Mantri

Simple Website Scrapper (markdown format)

manojaditya64/simple-website-scrapper-markdown-format

A simple website scrapper that scrapes websites and converts it into markdown format which is easy to use with LLM. You can feed markdown data to LLM for easy analysis.

Manojaditya Nadar

5.0

(1)

Markdown Maker: HTML to Markdown 📝

shahidirfan/Markdown-Maker

Instantly convert complex HTML into clean, structured Markdown. This lightweight actor is optimized to render web content into a format that is easily readable for AI LLMs, reducing token usage and improving context. Perfect for RAG pipelines and preparing data for training.