
Website Content Crawler
Pricing
Pay per usage

Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
4.6 (38)
Pricing
Pay per usage
1310
Total users
49.4k
Monthly users
6.9k
Runs succeeded
>99%
Issue response
3.8 days
Last modified
7 days ago
Cookie Banner is not removed
Open
Cookies banner/warnings are still not removed and block event details from getting fetched by this actor.

Hey,
For this site, you can try adding div.bg-background\/80.backdrop-blur-sm
to the removeElementsCssSelector
input (in the HTML processing section). See my test run where the cookie banner was successfully removed: https://console.apify.com/view/runs/BxtZXutBadL9KsI4L