Total Wine Scraper avatar
Total Wine Scraper

Deprecated

Pricing

$20.00/month + usage

Go to Store
Total Wine Scraper

Total Wine Scraper

Deprecated

Developed by

Onur

Onur

Maintained by Community

Scrape data from Total Wine. Extract descriptions, images, reviews, stock info, and all other product details. The actor supports category URLs and/or searching across the website by any search term.

0.0 (0)

Pricing

$20.00/month + usage

1

Total users

60

Monthly users

1

Last modified

2 months ago

CH

Crawler is not able to scrape or working.

Closed

certified_harbor opened this issue
2 years ago

It is showing error only while scrapping:

WARN BasicCrawler: Reclaiming failed request back to the list or queue. TypeError: cookieArray is not iterable 2023-11-22T05:56:03.465Z at Object.extractInitialCookie (file:///usr/src/app/src/tools.js:9:28) 2023-11-22T05:56:03.467Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-11-22T05:56:03.473Z at async BasicCrawler.requestHandler (file:///usr/src/app/src/main.js:48:9) 2023-11-22T05:56:03.479Z at async BasicCrawler._runRequestHandler (/usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:507:9)

Due to this error it is not going forward with real scrape

oyildirim avatar

Onur (oyildirim)

2 years ago

I will take a look and modify the code to support runs without any shippingInfo (this is the field to set the store/location preference for the totalwine.com website.) Until then I recommend you to read this section (https://console.apify.com/actors/PkntXVtfXWfD0VHhg/information/latest/readme#tip) and use a shippingInfo (I added a default one in that section)

With the shippingInfo I tested with your URL, and it worked fine (here are the logs: https://api.apify.com/v2/logs/Hp0zBSVpIO5ydzkIZ)

CH

certified_harbor

2 years ago

Okay. I will check it next time I run it. Thanks for the update.