2 hours trial then $20.00/month - No credit card required now
Total Wine Scraper
2 hours trial then $20.00/month - No credit card required now
Scrape data from Total Wine. Extract descriptions, images, reviews, stock info, and all other product details. The actor supports category URLs and/or searching across the website by any search term.
Crawler is not able to scrape or working.
Closed
It is showing error only while scrapping:
WARN BasicCrawler: Reclaiming failed request back to the list or queue. TypeError: cookieArray is not iterable 2023-11-22T05:56:03.465Z at Object.extractInitialCookie (file:///usr/src/app/src/tools.js:9:28) 2023-11-22T05:56:03.467Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-11-22T05:56:03.473Z at async BasicCrawler.requestHandler (file:///usr/src/app/src/main.js:48:9) 2023-11-22T05:56:03.479Z at async BasicCrawler._runRequestHandler (/usr/src/app/node_modules/@crawlee/basic/internals/basic-crawler.js:507:9)
Due to this error it is not going forward with real scrape
I will take a look and modify the code to support runs without any shippingInfo (this is the field to set the store/location preference for the totalwine.com website.) Until then I recommend you to read this section (https://console.apify.com/actors/PkntXVtfXWfD0VHhg/information/latest/readme#tip) and use a shippingInfo (I added a default one in that section)
With the shippingInfo I tested with your URL, and it worked fine (here are the logs: https://api.apify.com/v2/logs/Hp0zBSVpIO5ydzkIZ)
certified_harbor
Okay. I will check it next time I run it. Thanks for the update.
Onur- 3 monthly users
- 100.0% runs succeeded
- 0.0 days response time
- Created in Jun 2022
- Modified about 2 months ago
