Website Content Crawler
No credit card required
Website Content Crawler
No credit card required
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
Do you want to learn more about this Actor?
Get a demoCan't scrape any content at all
hello help!!!
Hello, and thank you for your interest in this Actor.
This seems like an input error. In the log, the cookies[0].sameSite: expected one of (Strict|Lax|None)
shows that your initialCookies
input has the sameSite
property in the wrong format. The expected formatting is capitalized, i.e. with a capital first letter (e.g. Lax
, not lax
).
Once this (and other potential cookie formatting issues) are fixed, the Actor should run as expected.
I'll close this issue now, but feel free to ask additional questions if you have any.
Actor Metrics
3.8k monthly users
-
722 stars
>99% runs succeeded
2.2 days response time
Created in Mar 2023
Modified 2 days ago