Crawl a docs site to Markdown for an LLM
Zaiq
Ready-made run of Website to Markdown Crawler for LLMs, RAG & AI Agents with its example input. Change the fields and run it.
Input
Output fields
Sign up on Apify or log in
The LLM Website Crawler: Clean Markdown & RAG Chunks Actor is ready to run with the inputs already set for "Crawl a docs site to Markdown for an LLM". Sign up or log in and you'll land in Apify Console with a copy of this exact task.
Start the "Crawl a docs site to Markdown for an LLM" task
The LLM Website Crawler: Clean Markdown & RAG Chunks Actor will start running based on the input automatically. You can also change all the input fields, like start urls, most pages, and more, to match your specific use case.
Receive the "Crawl a docs site to Markdown for an LLM" output
Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as page, title, words, and more.
Integrate into your workflow
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Crawl a docs site to Markdown for an LLM" task via API.
