No credit card required
Website Content Crawler
No credit card required
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.
Do you want to learn more about this Actor?
Get a demoDoes not remove cookies
Closed
This crawler does not remove cookies will have to look for another one.
tituskex
If I try to set initial cookies this is the result of the scraping..
Hello @tituskex!
Before submitting issues here, always try checking the Actor Logs if it isn't trying to tell you something. In your Actor's logs, you can see the following line:
browserContext.addCookies: cookies[0].sameSite: expected one of (Strict|Lax|None)
It looks like the issue with the cookies stems from the sameSite parameter in your input. The sameSite cookie field parameter should be set to either Strict, Lax, or None.
Updating this should resolve the issue. If you continue to experience problems, feel free to ask more questions.
I'll close this issue now, but I'm here to help if you need further assistance. Cheers!
Apify- 2.8k monthly users
- 434 stars
- 99.9% runs succeeded
- 2.9 days response time
- Created in Mar 2023
- Modified 3 days ago
