Pricing

from $1.00 / 1,000 page fetcheds

Try for free

Go to Apify Store

Agent Fetch: URL to Clean Markdown

Try for free

Turn any URL into clean, LLM-ready markdown: main content only, plus title, canonical URL, language, word count and links. Optional headless rendering for JavaScript pages, and deterministic JSON Schema field extraction with no LLM and no API key. robots.txt respected, failures come back labelled.

Pricing

from $1.00 / 1,000 page fetcheds

Rating

0.0

(0)

Developer

Omar Nagy

Actor stats

Bookmarked

Total users

Monthly active users

11 days ago

Last modified

Categories

Developer tools

Automation

You can access the Agent Fetch: URL to Clean Markdown programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "urls": [
12        "https://en.wikipedia.org/wiki/Markdown",
13        "https://docs.python.org/3/tutorial/introduction.html",
14        "https://www.propublica.org/article/3m-forever-chemicals-pfas-pfos-inside-story"
15    ],
16    "render": false,
17    "respectRobotsTxt": true,
18    "timeoutSecs": 30,
19    "userAgent": "Mozilla/5.0 (compatible; AgentFetchBot/1.0; +https://apify.com/omargnagy/agent-fetch-markdown)",
20    "includeLinks": true,
21    "includeArticleJson": false,
22    "maxMarkdownChars": 120000
23};
24
25// Run the Actor and wait for it to finish
26const run = await client.actor("omargnagy/agent-fetch-markdown").call(input);
27
28// Fetch and print Actor results from the run's dataset (if any)
29console.log('Results from dataset');
30console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
31const { items } = await client.dataset(run.defaultDatasetId).listItems();
32items.forEach((item) => {
33    console.dir(item);
34});
35
36// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Agent Fetch: URL to Clean Markdown for LLMs API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Agent Fetch: URL to Clean Markdown API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Agent Fetch: URL to Clean Markdown API in Python

Agent Fetch: URL to Clean Markdown API through CLI

Agent Fetch: URL to Clean Markdown OpenAPI definition

Agent Fetch: URL to Clean Markdown API

AI Web Extractor: URL → Clean Markdown + JSON for LLM/RAG

boxbox10/ai-web-extractor

Turn any URL into clean, LLM-ready Markdown + structured JSON (title, headings, main content, links, metadata, token count). Perfect for RAG pipelines, AI agents, and LLM context.

Marvin Eguilos

URL to Markdown for LLMs (polite, robots-respecting)

weltverbenzer/url-to-markdown-for-llms

Turn any URL into clean, LLM-ready Markdown for AI agents and RAG pipelines. Enforces robots.txt, extracts main content (Readability) and converts to Markdown. Returns title, byline and markdown.

Johannes Witt

Website to Markdown Scraper — LLM & RAG Ready

perforated_hummingbird/url-to-markdown

Scrape any website into clean, LLM-ready Markdown. This URL-to-Markdown converter strips ads, nav, and boilerplate with Mozilla Readability — feed your AI models and RAG pipelines only real content. Batch URLs, optional JavaScript rendering, pay only for pages scraped successfully.

Damon Williams

Article Content Extractor — Clean Text, Markdown & Metadata

haketa/article-content-extractor

Extract the main content from any article, blog or news URL: clean title, author, publish date, full text, LLM-ready Markdown, main image, language, word count & reading time — ads, menus & boilerplate removed. Ideal for RAG, LLM pipelines, research & archiving. Export JSON/CSV.

Haketa

LLM-Ready Web Extractor: URL to Clean Markdown & JSON

f0rty7even/llm-web-extractor

Turn any web page or site into clean, LLM-ready Markdown and structured JSON for RAG, agents, and fine-tuning. Strips nav/ads/boilerplate; returns main content + metadata.

Michael Yousrie

Website to Markdown for LLMs & RAG — Content Extractor

fetchbase/website-to-markdown

Turn any URL or whole site into clean, LLM-ready Markdown, text, or JSON. Strips nav/ads/boilerplate; keeps headings, links, tables, code. Sitemap-aware concurrent crawl, URL filters, robots.txt respected, rich metadata. Charged only per page extracted — no startup fee.

Fetchbase

Site to Markdown — any site to clean, LLM-ready markdown

topsail/site-to-markdown

Scrape any website to clean, LLM-ready markdown — a compliant Firecrawl alternative for RAG ingestion, robots.txt always on.

Connor Teskey

PDF Extractor: PDF → Clean Markdown + JSON for LLM/RAG

boxbox10/pdf-extractor

Turn any PDF URL into clean, LLM-ready Markdown + structured JSON (title, metadata, per-page text, page count, word count, token count). Perfect for RAG pipelines, AI agents, and LLM document ingestion.

Marvin Eguilos

URL to Clean Markdown for LLMs & RAG

eltociear/url-to-markdown-for-llms

Convert a webpage to Markdown and extract the main content from any URL. Turns HTML into clean Markdown for LLM context and RAG ingestion: strips nav, ads and boilerplate, keeps headings, lists and tables, returns title, byline, date and word count. No headless browser. Pay per page extracted.

Ikko Eltociear Ashimine

Website to Markdown API & Crawler – RAG/LLM

signal_lab/website-to-markdown-crawler

Website-to-Markdown API and crawler for RAG and LLM datasets. Extract clean Markdown, SEO metadata, links, JSON-LD, sitemaps, and robots.txt-compliant pages.