Convert a website sitemap to Markdown for RAG

Created by

CleanData Labs

Actor

URL to Markdown for LLMs & RAG: Pages, PDFs & Sitemaps

Convert pages from a website sitemap into clean Markdown split into token-sized chunks for RAG and vector databases. Filter pages with URL patterns and limit the page count.

Try for free

URL to Markdown for LLMs & RAG: Pages, PDFs & Sitemapscleandata-labs/url-to-markdown

URL

Title

Lang

Published

+5 fields

Input

URLs(required):https://docs.apify.com/

Use sitemap:true

Include URL patterns:https://docs.apify.com/academy/*

Max pages per start URL (crawl):10

Chunk size (approx. tokens):800

Chunk overlap (approx. tokens):80

Output fields

URL

Title

Lang

Published

Words

~Tokens

Fetched with

Markdown

Error

How it works

Sign up on Apify or log in

The URL to Markdown for LLMs & RAG: Pages, PDFs & Sitemaps Actor is ready to run with the inputs already set for "Convert a website sitemap to Markdown for RAG". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Convert a website sitemap to Markdown for RAG" task

The URL to Markdown for LLMs & RAG: Pages, PDFs & Sitemaps Actor will start running based on the input automatically. You can also change all the input fields, like URLs, use sitemap, and more, to match your specific use case.

Receive the "Convert a website sitemap to Markdown for RAG" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as URL, title, lang, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Convert a website sitemap to Markdown for RAG" task via API.