Web Scraper avatar
Web Scraper

Pricing

Pay per usage

Go to Store
Web Scraper

Web Scraper

Developed by

Apify

Apify

Maintained by Apify

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

4.5 (22)

Pricing

Pay per usage

707

Total users

82.8k

Monthly users

4.1k

Runs succeeded

>99%

Issue response

21 days

Last modified

22 days ago

TC

Can not send cookies in InitialCookie

Closed

tasteful_coffer opened this issue
a year ago

Tried to send Cookies in the intialCookie but got an error in the debug

jindrich.bar avatar

Hello and thank you for your interest in this Actor!

In the log, you can actually find the reason why the Actor failed - the cookies need to be passed including the domain or url parameters (for each cookie). This requirement comes from the specification of HTTP - if cookies weren't scoped by the domain, the browsers would try to send all the (potentially private) cookies to all the servers (and that would be a massive security risk).

For more details on setting up the intialCookie input, please refer to our documentation.

I'll close this issue now, but feel free to ask any additional questions - about cookies or anything else. Thanks!