Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (22)
Pricing
Pay per usage
563
Monthly users
3.5k
Runs succeeded
>99%
Response time
10 days
Last modified
2 months ago
container error.
lore@LAPTOP-EOOJ6UJ0:~$ docker ps permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.47/containers/json": dial unix /var/run/docker.sock: connect: permission denied
Hello Caravel and thank you for your input!
The preNavigationHooks option expects a JavaScript array as a string (starting with [ and ending with ]). The module.exports part is unnecessary and is causing the compilation error — removing it should resolve the issue in your run.
Additionally, the Actor already applies some fingerprint obfuscation internally. Overwriting properties like the user-agent string may create inconsistencies and make detection by anti-scraping tools easier.
It's also important to note that preNavigationHooks run before the browser loads the page. While this is a good time e.g. to modify request headers, handling cookie banners or detecting captchas won't work here since the page content hasn’t loaded yet. You may want to move that logic to postNavigationHooks.
I'll be closing this issue. Feel free to open a new one if you need further assistance.
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
