URL to Markdown — Clean Web Reader for AI Agents & RAG (No API Key)

Turn any URL into clean, LLM-ready Markdown in a single call. URL to Markdown is a fast, keyless Firecrawl and Jina Reader alternative: give it a web page, it fetches the HTML, strips away navigation, headers, footers, sidebars, ads and cookie banners, and returns the article as tidy Markdown plus structured metadata. No API key, no headless browser, no setup — point it at a URL and get back content your LLM can actually read. Built for AI agents, RAG pipelines and MCP workflows, it's the missing "read this page for me" tool.

🏆 Why this URL → Markdown reader?

Clean article Markdown, not raw HTML · rich metadata (title, author, date, word count, reading time) · single or batch up to 500 URLs · keyless & cheap (plain HTTP) · MCP / pay-per-event ready · export to JSON / CSV / Excel. The unofficial Firecrawl / Jina Reader API alternative for LLM ingestion, agents and knowledge bases.

---

✨ What this Actor does / Key features

• 🧹 Clean output, not raw HTML — boilerplate removal isolates the main article so your model sees content, not chrome.
• 🔑 Keyless & cheap — no third-party API key; runs on plain HTTP with Apify's datacenter proxy, so it stays fast and inexpensive.
• 📝 LLM-ready Markdown — headings, lists, tables, code blocks, links and images convert to correct Markdown, perfect for embeddings and RAG.
• 🏷️ Rich metadata — title, description, author, published date, site name, language, canonical URL, word count and reading time per page.
• 📦 Batch or single — convert one URL or up to 500 in a single run with configurable concurrency.
• 🎛️ Token control — toggle links/images and cap max characters per page to control LLM token cost.
• 🤖 Agent-native (MCP) — pay-per-event pricing means an AI agent can call it, pay per page, and move on.
• 🌍 Any language — detects page language and converts content regardless of language.

🚀 Quick start (3 steps)

1. Configure — paste one or more URLs into URLs (or a single URL into Single URL). Keep Only main content on to strip menus and ads.
2. Run — click Start. Each page is fetched, cleaned and converted; records stream into your dataset.
3. Get your data — open the Output tab and export to JSON, CSV, Excel, HTML or RSS, or read the Markdown live via the Apify API.

📥 Input

Give the Actor at least one URL (batch list or single field). Everything else is optional.

Example — convert a batch of pages for RAG ingestion

{
  "urls": [
    "https://en.wikipedia.org/wiki/Model_Context_Protocol",
    "https://en.wikipedia.org/wiki/Large_language_model"
  ],
  "onlyMainContent": true,
  "includeLinks": true,
  "includeImages": false,
  "concurrency": 5
}

Example — single URL, token-capped for an agent

{
  "url": "https://news.ycombinator.com",
  "onlyMainContent": true,
  "maxCharacters": 8000
}

Example — bot-walled site via residential proxy

{
  "urls": ["https://example.com/protected-article"],
  "onlyMainContent": true,
  "proxyGroups": ["RESIDENTIAL"]
}

Field	Type	Description	Default
urls	array	Page URLs to convert (batch up to 500).	–
url	string	A single page URL (use this or the list above).	–
onlyMainContent	boolean	Strip nav/header/footer/sidebars/ads/cookie banners — keep just the article.	true
includeLinks	boolean	Keep hyperlinks in the Markdown as [text](url).	true
includeImages	boolean	Keep images in the Markdown as .	true
maxCharacters	integer	Cap Markdown length per page (0 = no cap). Controls token cost.	0
concurrency	integer	How many URLs to fetch in parallel (1–20).	5
useApifyProxy	boolean	Route through Apify datacenter proxy (AUTO).	true
proxyGroups	array	Override proxy group, e.g. RESIDENTIAL for bot-walled sites.	[]

Tip: it reads server-rendered HTML over plain HTTP — fast and cheap, and covers the vast majority of articles, docs and blogs. For heavy JavaScript apps, use a browser-based scraper. Switch to a RESIDENTIAL proxy group only for bot-walled sites.

📤 Output

One structured record per URL — feed the markdown field straight to an LLM. Here is a trimmed sample:

{
  "url": "https://en.wikipedia.org/wiki/Model_Context_Protocol",
  "finalUrl": "https://en.wikipedia.org/wiki/Model_Context_Protocol",
  "statusCode": 200,
  "title": "Model Context Protocol",
  "description": "An open standard for connecting AI assistants to tools and data.",
  "author": null,
  "publishedDate": null,
  "siteName": "Wikipedia",
  "lang": "en",
  "canonicalUrl": "https://en.wikipedia.org/wiki/Model_Context_Protocol",
  "markdown": "# Model Context Protocol\n\nThe **Model Context Protocol (MCP)** is an open standard...",
  "wordCount": 1240,
  "readingTimeMin": 6,
  "links": [{ "text": "Anthropic", "url": "https://www.anthropic.com" }],
  "images": []
}

💡 Use cases

• RAG ingestion — convert documentation, blogs and news into Markdown before chunking and embedding.
• AI agents — give an agent a "read this URL" tool it can call mid-conversation and pay per page.
• Research & summarization — feed clean article text to an LLM for summaries or Q&A.
• Content monitoring — snapshot pages as Markdown for diffing and change detection.
• Knowledge bases — bulk-convert a list of URLs into a tidy Markdown corpus.

👥 Who uses it

AI engineers building RAG pipelines · agent and MCP developers · data teams assembling knowledge bases · researchers and analysts summarizing web content · anyone tired of feeding noisy HTML into an LLM.

🤖 Use it as an MCP tool

This Actor uses Apify's pay-per-event model, so AI agents can discover and call it autonomously through the Apify MCP server — one charge per converted URL. Connect it in Claude, Cursor or any MCP client and let the agent turn URLs into Markdown on demand.

💰 Pricing

This Actor runs on a simple pay-per-result model — you're charged once per converted URL, with no separate Apify platform fees to calculate and no idle cost. Try it on the free tier first, then scale up. See the Pricing tab on this page for the current rate.

❓ Frequently Asked Questions

Is this a Firecrawl or Jina Reader alternative? Yes. It covers the core "URL → clean Markdown" job those tools are used for, without requiring their API keys. You run it on Apify and pay per converted page.

Do I need an API key? No. It's fully keyless and works out of the box using Apify's datacenter proxy. Switch to a RESIDENTIAL proxy only for bot-walled sites.

Can I convert URLs to Markdown without an API or login? Yes. No third-party API key or account is required — only an Apify account. It reads publicly reachable pages over plain HTTP.

Does it render JavaScript? No — it reads server-rendered HTML over plain HTTP, which keeps it fast and cheap and covers the vast majority of articles, docs and blogs. For heavy JavaScript apps, use a browser-based scraper.

How is it priced? Pay-per-event: you're charged once per converted URL. No monthly fee, no idle cost.

Can it handle non-English pages? Yes. It detects the page language and converts content regardless of language.

How much can I convert at once? Batch up to 500 URLs per run, with configurable concurrency. Run it on a schedule or call it repeatedly for larger corpora.

How do I export the Markdown to CSV or JSON? Run the Actor, then export the dataset as JSON, CSV, Excel, HTML or RSS from the run — or read it live via the Apify API endpoint.

🔗 More web, content & AI tools by logiover

Building a content-ingestion or web-recon pipeline? Pair URL to Markdown with these:

Actor	What it does
Website Text & Markdown Crawler	Crawl a whole site to Markdown/text
Sitemap to URL Crawler	Expand sitemaps into URL lists to feed this
Website Contact Scraper	Emails, phones & socials from pages
JSON-LD Schema & Meta Tag Extractor	Structured data & metadata from pages
Bulk URL Status Checker	HTTP status & response times at scale
Wayback Machine URL Extractor	Historical URLs from the Internet Archive
AI Web Extract	Structured extraction from any page
AI Deep Research	Multi-source research agent
Docs Knowledge Base Scraper	Ingest documentation sites for RAG
Google News Scraper	News articles by keyword to convert

👉 Browse all logiover scrapers on Apify Store — 180+ actors across real estate, jobs, crypto, social media & B2B data.

⏰ Scheduling & integration

Schedule this Actor on Apify to refresh a Markdown corpus daily or weekly. Export results to JSON, CSV or Excel, sync to Google Sheets, or push to your vector DB, database and webhooks through the Apify API. Connect it to Make, n8n or Zapier, or call it as an MCP tool inside your AI agent.

⭐ Support & feedback

Found a bug or need an extra field? Open an issue on the Issues tab — response is usually fast. If this Actor saves you time, a ★★★★★ review on the Store page genuinely helps and is hugely appreciated. 🙏

⚖️ Legal

This Actor converts only publicly reachable pages and is intended for legitimate research, ingestion and analytics use. You are responsible for complying with the terms of service of the sites you convert and any applicable local laws.

---

📝 Changelog

2026-07-06

• ✨ README overhaul: richer output sample, three ready-to-run example scenarios, expanded web/AI tool cross-links, and clearer quick-start.

Initial release

• Keyless URL → clean Markdown conversion with boilerplate removal, rich metadata, batch support and pay-per-event pricing for AI agents and RAG.