Total Wine Scraper avatar

Total Wine Scraper

Deprecated
Go to Store
This Actor is deprecated

This Actor is unavailable because the developer has decided to deprecate it. Would you like to try a similar Actor instead?

See alternative Actors
Total Wine Scraper

Total Wine Scraper

oyildirim/totalwine-actor

Scrape data from Total Wine. Extract descriptions, images, reviews, stock info, and all other product details. The actor supports category URLs and/or searching across the website by any search term.

CH

Crawler is not able to scrape or working.

Closed

certified_harbor opened this issue
a year ago

It is showing error only while scrapping:

WARN BasicCrawler: Reclaiming failed request back to the list or queue. TypeError: cookieArray is not iterable 2023-11-22T05:56:03.465Z at Object.extractInitialCookie (file:///usr/src/app/src/tools.js:9:28) 2023-11-22T05:56:03.467Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-11-22T05:56:03.473Z at async BasicCrawler.requestHandler (file:///usr/src/app/src/main.js:48:9) 2023-11-22T05:56:03.479Z at async BasicCrawler._runRequestHandler (/usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:507:9)

Due to this error it is not going forward with real scrape

oyildirim avatar

I will take a look and modify the code to support runs without any shippingInfo (this is the field to set the store/location preference for the totalwine.com website.) Until then I recommend you to read this section (https://console.apify.com/actors/PkntXVtfXWfD0VHhg/information/latest/readme#tip) and use a shippingInfo (I added a default one in that section)

With the shippingInfo I tested with your URL, and it worked fine (here are the logs: https://api.apify.com/v2/logs/Hp0zBSVpIO5ydzkIZ)

CH

certified_harbor

a year ago

Okay. I will check it next time I run it. Thanks for the update.

Developer
Maintained by Community
Categories