Web Scraper avatar
Web Scraper

Pricing

Pay per usage

Go to Store
Web Scraper

Web Scraper

Developed by

Apify

Apify

Maintained by Apify

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

4.5 (23)

Pricing

Pay per usage

906

Total users

89K

Monthly users

5K

Runs succeeded

>99%

Issues response

12 days

Last modified

a month ago

TC

Can not send cookies in InitialCookie

Closed

tasteful_coffer opened this issue
2 years ago

Tried to send Cookies in the intialCookie but got an error in the debug

jindrich.bar avatar

Hello and thank you for your interest in this Actor!

In the log, you can actually find the reason why the Actor failed - the cookies need to be passed including the domain or url parameters (for each cookie). This requirement comes from the specification of HTTP - if cookies weren't scoped by the domain, the browsers would try to send all the (potentially private) cookies to all the servers (and that would be a massive security risk).

For more details on setting up the intialCookie input, please refer to our documentation.

I'll close this issue now, but feel free to ask any additional questions - about cookies or anything else. Thanks!