
Website Content Crawler
Pricing
Pay per usage
Go to Store

Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
4.0 (41)
Pricing
Pay per usage
1597
Total users
62K
Monthly users
8.1K
Runs succeeded
>99%
Issues response
8 days
Last modified
a day ago
Website Crawler keeps running after execution completes (13 hrs)
Open
revscaleai opened this issue
10 days ago
I triggered the website content crawler and it continued to run for 13 hrs after I received a response. Please fix and refund, I have been charged 43 dollars.