Convert a Docs Site to Markdown for RAG
Crawl a documentation site into clean Markdown for RAG — sitemap discovery, boilerplate stripped, one file per page.
Website to Markdown for LLMs & RAG — Content Extractorfetchbase/website-to-markdown
URL
Title
Words
Description
+1 fieldTextNumberBooleanListObject
Input
URLs(required):https://docs.apify.com/platform
Output format:markdown
Extract main content only:true
Render JavaScript:true
Include links:true
Crawl the site (follow links):true
Max pages:10
Max crawl depth:1
Stay on the same domain:true
Respect robots.txt:true
Discover URLs from sitemap.xml:true
Include URL patterns
Exclude URL patterns
Max concurrency:5
Remove elements (CSS selectors)
Wait until:load
Timeout per page (ms):45000
Proxy
Output fields
URL
Title
Words
Description
Markdown
Sign up on Apify01
Create your Apify account to access the Website to Markdown for LLMs & RAG — Content Extractor.
Start the run02
The Actor will start running based on the input automatically.
Receive the output03
Monitor the progress in real-time. You will be notified as soon as your dataset is complete and ready for review.
Integrate into your workflow04
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow.
