
Website Content Crawler
Pricing
Pay per usage
Go to Store

Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
3.9 (41)
Pricing
Pay per usage
1546
Total users
60K
Monthly users
7.8K
Runs succeeded
>99%
Issues response
7.9 days
Last modified
4 days ago
too long time for simple crawl spent too much credit
Open
liquid_jolt opened this issue
3 days ago
sane as above.
vernal_mantle
3 days ago
did you got your query solved ?