
Web Scraper
Pricing
Pay per usage

Web Scraper
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (22)
Pricing
Pay per usage
707
Total users
82.8k
Monthly users
4.1k
Runs succeeded
>99%
Issue response
21 days
Last modified
22 days ago
Can not send cookies in InitialCookie
Closed
Tried to send Cookies in the intialCookie but got an error in the debug
Hello and thank you for your interest in this Actor!
In the log, you can actually find the reason why the Actor failed - the cookies need to be passed including the domain
or url
parameters (for each cookie). This requirement comes from the specification of HTTP - if cookies weren't scoped by the domain, the browsers would try to send all the (potentially private) cookies to all the servers (and that would be a massive security risk).
For more details on setting up the intialCookie
input, please refer to our documentation.
I'll close this issue now, but feel free to ask any additional questions - about cookies or anything else. Thanks!