AST Website Content Crawler for RAG avatar

AST Website Content Crawler for RAG

Pricing

$3.00 / 1,000 results

Go to Apify Store
AST Website Content Crawler for RAG

AST Website Content Crawler for RAG

Advanced web crawler extracting token-chunked Markdown for LLMs & RAG. Features dual-engine hybrid parsing (IBM Docling & Trafilatura) to preserve tables and layouts. Delivers clean text split by native tiktoken counts with rich metadata (headings, levels, tokens) for instant vector search.

Pricing

$3.00 / 1,000 results

Rating

5.0

(2)

Developer

lukas schmeck

lukas schmeck

Maintained by Community

Actor stats

3

Bookmarked

3

Total users

0

Monthly active users

14 days ago

Last modified

Share