Website Content Crawler
Pricing
Pay per usage
Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
3.9 (41)
Pricing
Pay per usage
1544
Total users
60K
Monthly users
7.8K
Runs succeeded
>99%
Issues response
7.9 days
Last modified
3 days ago
The actor replace any URL including (%) with (%25) which broke the actual link.
Closed
Hello,
The actor replace any URL including (%) with (%25) which broke the link and getting no data ( Page not found).
for example If i put this URL : example.com/%D8%A3%D8
it will be replace by the actor to be like this : example.com/%25D8%25A3%25D8
Please assist on this. Thanks
Hello, and thank you for bringing this issue to our attention.
We've just released a patch (in 0.3.42) which fixes this problem.
Rerunning the Actor with the latest build tag should now work as expected.
I'll close this issue now, but let us know in case anything doesn't work for you. Cheers!
