Fetch developer docs as clean Markdown for an LLM

Created by

Omar Nagy

Actor

Agent Fetch: URL to Markdown for LLMs and RAG

Fetches three documentation pages every developer knows (the Python tutorial, MDN's HTTP status codes and the PostgreSQL SELECT reference) and returns each as clean Markdown with the navigation, ads and boilerplate stripped out. Plain HTTP, no browser, so it is fast and cheap. For feeding docs to an LLM or an agent. Costs $0.001 per page fetched, so this preset runs about $0.003.

Try for free

Agent Fetch: URL to Markdown for LLMs and RAGomargnagy/agent-fetch-markdown

Title

Markdown

Requested URL

Status

+12 fields

Input

URLs:https://docs.python.org/3/tutorial/introduction.html+2

Render every page in a headless browser:false

Respect robots.txt:true

Include the links list:true

Maximum Markdown characters per page:120000

Output fields

Title

Markdown

Requested URL

Status

HTTP status

Words

Language

Method

Rendered automatically

Links

Truncated

Reason

Canonical URL

Final URL

Duration

Fetched at

How it works

Sign up on Apify or log in

The Agent Fetch: URL to Markdown for LLMs and RAG Actor is ready to run with the inputs already set for "Fetch developer docs as clean Markdown for an LLM". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Fetch developer docs as clean Markdown for an LLM" task

The Agent Fetch: URL to Markdown for LLMs and RAG Actor will start running based on the input automatically. You can also change all the input fields, like URLs, render every page in a headless browser, and more, to match your specific use case.

Receive the "Fetch developer docs as clean Markdown for an LLM" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as title, markdown, requested url, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Fetch developer docs as clean Markdown for an LLM" task via API.