Pricing

from $0.70 / 1,000 fetched pages

Try for free

Go to Apify Store

Agent Fetch: URL to Markdown for LLMs and RAG

Try for free

Returns the main content of any web page URL as clean Markdown for LLMs, RAG and AI agents, with title, canonical URL, language, word count and links. Up to 25 URLs per run, automatic JavaScript rendering, optional JSON Schema field extraction with no LLM. Failed pages are free.

Pricing

from $0.70 / 1,000 fetched pages

Rating

0.0

(0)

Developer

Omar Nagy

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

Categories

Agents

Developer tools

Security

You can access the Agent Fetch: URL to Markdown for LLMs and RAG programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "urls": [
10        "https://en.wikipedia.org/wiki/Markdown",
11        "https://docs.python.org/3/tutorial/introduction.html",
12        "https://www.propublica.org/article/3m-forever-chemicals-pfas-pfos-inside-story",
13    ],
14    "render": False,
15    "autoRender": True,
16    "includeLinks": True,
17    "includeArticleJson": False,
18    "maxMarkdownChars": 120000,
19    "respectRobotsTxt": True,
20    "timeoutSecs": 30,
21}
22
23# Run the Actor and wait for it to finish
24run = client.actor("omargnagy/agent-fetch-markdown").call(run_input=run_input)
25
26# Fetch and print Actor results from the run's dataset (if there are any)
27print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
28for item in client.dataset(run.default_dataset_id).iterate_items():
29    print(item)
30
31# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

URL to Markdown for LLMs and RAG: Web Page Fetcher API in Python

The Apify API client for Python is the official library that allows you to use Agent Fetch: URL to Markdown for LLMs and RAG API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Agent Fetch: URL to Markdown for LLMs and RAG API in JavaScript

Agent Fetch: URL to Markdown for LLMs and RAG API through CLI

Agent Fetch: URL to Markdown for LLMs and RAG OpenAPI definition

Agent Fetch: URL to Markdown for LLMs and RAG API

Website & Page to Markdown for RAG and LLMs

humble-echidna/page-to-markdown

Turn web pages or whole sites into clean Markdown for RAG and LLMs: main content only, with title, links and word count. Whole-site mode reads the sitemap first, can return only changed pages, and splits pages into heading-based chunks. Respects robots.txt and AI opt-outs. No browser.

Michael Costa

Website to Markdown Converter & Crawler for LLMs and RAG

s3nafps/ai-ready-webpage-extractor

Website to Markdown Crawler is an Apify Actor that turns web pages, docs sites and blogs into clean Markdown and RAG chunks for LLMs. $3 per 1,000 pages.

mohamed senator

Website to Markdown for LLM & RAG — Crawl4AI URL to Clean

bikram07/web-to-markdown-crawl4ai

Convert any URL, sitemap, or whole website into clean, LLM-ready Markdown for RAG, vector databases, and AI agents. Hosted Crawl4AI in a real Chromium browser — renders JavaScript and SPAs, strips boilerplate, and exports JSON/CSV. Callable over MCP from Claude and Cursor.

Bikram

Site to Agent Feed (URL to RAG-ready Markdown)

constant_quadruped/site-to-agent-feed

Turn any URL into clean, RAG-ready Markdown + structured JSON for LLMs and AI agents. Self-healing main-content extraction (survives redesigns), headings/links/tables, optional change-detection. No paid APIs.

URL to Clean Markdown — for AI Agents

great_saint/url-to-markdown

Convert any web page into clean, LLM-ready Markdown. Charged only on successful conversion. MCP & x402 ready.

Öge

Web Fetch — Any URL to Markdown or Text for AI Agents

actor-forge/web-fetch

Fetch any URL as clean Markdown and plain text for AI agents, MCP and RAG: web pages, PDF, Word, Excel, PowerPoint, EPUB, CSV and JSON. One url in, one result with title and token estimate out. Static HTML, no JavaScript rendering. $1 per 1,000 pages.

ActorForge

Website to Markdown for LLMs & RAG — Content Extractor

fetchbase/website-to-markdown

Turn any URL or whole site into clean, LLM-ready Markdown, text, or JSON. Strips nav/ads/boilerplate; keeps headings, links, tables, code. Sitemap-aware concurrent crawl, URL filters, robots.txt respected, rich metadata. Charged only per page extracted — no startup fee.

Fetchbase

Website Content Extractor — Pages to Markdown for LLM/RAG

taroyamada/website-content-extractor

Turn docs, help centers and pricing pages into clean Markdown for LLM and RAG: one row per URL with main text, title, word count and a content-quality score. No API key or login.

naoki anzai

Web Page to Markdown Converter — Clean LLM Content

maged120/url-to-markdown-pro

Convert web pages to clean Markdown for LLMs, or extract just the article text (reader view) as plain text, HTML or Markdown with title, headings and word count. Batch URLs, no setup.

Maged

URL to Clean Markdown for LLMs & RAG

eltociear/url-to-markdown-for-llms

Convert a webpage to Markdown and extract the main content from any URL. Turns HTML into clean Markdown for LLM context and RAG ingestion: strips nav, ads and boilerplate, keeps headings, lists and tables, returns title, byline, date and word count. No headless browser. Pay per page extracted.