Pricing

Pay per event

Website Content Extractor

Extract clean text and markdown from docs, pricing, product, policy, and help-center URLs for RAG datasets and content operations.

Pricing

Pay per event

Rating

0.0

(0)

Developer

太郎山田

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Developer tools

URLs

urls

Required

Public broad website pages to clean (max 200). Best for docs, product, pricing, policy, and knowledge-base pages; route article/news/blog URLs to article-content-extractor.

Type:array

Output Format

outputFormat

Optional

Choose markdown for the strongest first-run proof and easiest downstream reuse.

Type:string

Default:markdown

Options:

textmarkdownhtml

Include Metadata

includeMetadata

Optional

Include page metadata such as description, author, language, and published date when available.

Type:boolean

Default:true

Concurrency

concurrency

Optional

Number of pages to fetch in parallel.

Type:integer

Minimum:1

Maximum:10

Default:5

Timeout (ms)

timeoutMs

Optional

HTTP timeout per page in milliseconds.

Type:integer

Minimum:1000

Maximum:30000

Default:15000

Delivery Mode

delivery

Optional

Select dataset-only output or webhook handoff. Non-dry-run always writes canonical dataset rows first; webhook delivery runs only after dataset/PPE output succeeds.

Type:string

Default:dataset

Options:

datasetwebhook

Webhook URL

webhookUrl

Optional

Webhook destination used when delivery=webhook. The webhook is sent after canonical dataset rows and PPE output succeed, and is skipped on dryRun.

Type:string

Dry Run

dryRun

Optional

Validate the setup and write only local output. When true, dataset writes and webhook delivery are disabled.

Type:boolean

Default:false

Website Content Extractor for RAG: Markdown, HTML, Text

nezha/website-content-crawler

Turn docs sites, help centers, blogs, and websites into clean markdown, text, or HTML for RAG, AI knowledge bases, and internal search. Crawl from start URLs or sitemaps and keep the crawl in scope.

nezha

5.0

Docs Markdown Rag Ready Crawler

devwithbobby/docs-markdown-rag-ready-crawler

Turn any documentation site or website into clean, structured markdown—ready for RAG, embeddings, and AI agents.

Dev with Bobby

Website to Markdown — AI-Ready Content for RAG

ryanclinton/website-to-markdown

Website To Markdown. Available on the Apify Store with pay-per-event pricing.

Ryan Clinton

AI Website Content Extractor

scrapeai/ai-website-content-extractor

Crawl website pages, strip noise, and convert the main content to clean Markdown for RAG/LLM training.

ScrapeAI

5.0

Website Content Crawler API - Markdown for RAG

tugelbay/website-content-crawler

Crawl public websites and extract clean Markdown, text, or HTML for RAG pipelines, AI agents, documentation indexing, and content monitoring. Guide: https://konabayev.com/tools/website-content-crawler/?utm_source=apify_info&utm_medium=referral&utm_campaign=website-content-crawler

Tugelbay Konabayev

Website Content Crawler

crawlerbros/website-content-crawler

Crawls websites and extracts clean text, markdown, or HTML content. Ideal for LLM training data, RAG pipelines, and knowledge base building.

Crawler Bros

5.0

Website to Markdown and RAG Dataset Crawler

orbiscribe/website-rag-dataset-builder

Crawl public websites into clean Markdown, text, metadata, links, JSON-LD, and chunks for RAG and knowledge bases.

Orbiscribe Labs

Website Content Crawler

parseforge/website-content-crawler

Crawl any website and pull clean Markdown content ready for AI! Follow links across a whole domain and extract page text, titles, headings, images, and metadata. Perfect for building RAG pipelines, training datasets, knowledge bases, and vector databases. Start crawling content in minutes!