🤖 LLM Markdown Web Scraper — Firecrawl & Jina Reader Alternative

Token-optimized web scraper and HTML-to-Markdown purifier designed specifically for AI Agents, RAG pipelines, LLM fine-tuning, and vector databases. Strips cookie banners, navigation menus, ads, and CSS/JS clutter to deliver pristine, GitHub-flavored Markdown.

---

⚡ Key Features

• 🧼 Intelligent Boilerplate Stripping: Automatically detects and purges navigation headers, footers, cookie banners, advertisements, and sidebar clutter.
• 🧠 Token-Efficient LLM Ingestion: Reduces prompt token usage by 60%–80% compared to raw HTML or generic text dumps.
• 📊 RAG Metadata Included: Preserves canonical URLs, page titles, author credits, OpenGraph preview images, and estimated LLM token counts.
• 📑 Structure Preservation: Keeps tables, code blocks, lists, blockquotes, and relevant links intact.
• 💰 Cost Effective: Pay-Per-Event pricing at just $0.0015 / page ($1.50 / 1,000 pages).

---

📥 Input Parameters

Field	Type	Description	Default
urls	Array of strings	List of target web page URLs	["https://news.ycombinator.com"]
stripBoilerplate	Boolean	Remove navigation, headers & footers	true
includeImages	Boolean	Keep markdown image tags 	true

---

📤 Output Format

{
  "url": "https://apify.com/about",
  "resolvedUrl": "https://apify.com/about",
  "canonicalUrl": "https://apify.com/about",
  "title": "About Apify | The web scraping and automation platform",
  "description": "We are building the world's leading web scraping and data extraction platform.",
  "author": "Apify Technologies",
  "ogImage": "https://apify.com/og-image.jpg",
  "httpStatus": 200,
  "wordCount": 642,
  "characterCount": 4210,
  "estimatedLlmTokens": 1107,
  "markdown": "# About Apify\n\nApify is the cloud platform for web scraping..."
}

---

🔥 The B2B Contact & OSINT Intelligence Suite

Combine these actors to build a full-spectrum OSINT & lead intelligence stack:

Tool	Purpose	Pricing	Link
🕵️‍♂️ Digital Footprint & OSINT Investigator	Trace emails, usernames & phones across 30+ sites	$3.00 / 1K	View on Store →
💼 B2B Tech Stack & Lead Enricher	BuiltWith alternative — detect 120+ technologies	$3.00 / 1K	View on Store →
📺 YouTube Subtitles & AI LLM Context	Instant transcript & timestamp extractor for RAG	$1.50 / 1K	View on Store →
📣 Meta Ads Library Creative Spy	Scrape competitor Facebook & Instagram ads	$2.00 / 1K	View on Store →
🤖 LLM Markdown Clean Web Crawler	Firecrawl alternative — token-optimized Markdown	$1.50 / 1K	View on Store →
🔥 LinkedIn Employees Scraper	Extract decision makers & team members	$5.00 / 1K	View on Store →
📍 Google Maps Business Leads	Extract local businesses, addresses & phones	$2.00 / 1K	View on Store →
🛡️ Email Data Breach Hunter	Detect compromised credentials & database leaks	$3.00 / 1K	View on Store →

---

⭐ Loved using this Actor?

If this Actor powered your data pipelines or saved you hours of manual research, please take 10 seconds to leave a 5-star rating! It helps independent creators maintain high-speed public tools.

👉 Click here to leave a review & rating on Apify Store

---

Crafted with precision by David Ahn · High-velocity data intelligence