
Website Content Crawler
Pricing
Pay per usage
Go to Store

Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
3.7 (41)
Pricing
Pay per usage
1499
Total users
58K
Monthly users
8.1K
Runs succeeded
>99%
Issues response
7.6 days
Last modified
an hour ago
crawler got hung up
Open
Tmoney97 opened this issue
17 hours ago
took way too long to run. previously ran that page quickly