Website Content Crawler
No credit card required
Website Content Crawler
No credit card required
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
Do you want to learn more about this Actor?
Get a demoWhen I try to call the api for a set of links it takes 30-40 seconds but when I use the site to test the actor on the same set of links it takes 7-10 seconds. Why is that?
Hello, and thank you for your interest in the Actor! Which API do you have in mind? And I assume that by testing the Actor using the site, you mean launching Website content crawler from the Apify console?
Hi @adi-kamaraj, if you are still experiencing issues, please let us know. For now, I am closing this one.
Actor Metrics
4k monthly users
-
839 stars
>99% runs succeeded
1 days response time
Created in Mar 2023
Modified 18 hours ago