Ulta Scraper
2 hours trial then $30.00/month - No credit card required now
Ulta Scraper
2 hours trial then $30.00/month - No credit card required now
The Ulta Scraper is a powerful tool built to scrape detailed product data from the Ulta. It can retrieve important product data such as product name, skuId, brand, rating, reviews, list price, and more.
Crawling not working
Closed
Error:
2025-01-31T04:20:24.619Z ERROR HttpCrawler: Request failed and reached maximum retries. HTTPError: Response code 408 (Request Time-out)
2025-01-31T04:20:24.830Z INFO HttpCrawler: Crawl finished. Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,1],"requestAvgFailedDurationMillis":99,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":14,"requestTotalDurationMillis":99,"requestsTotal":1,"crawlerRuntimeMillis":4103} 2025-01-31T04:20:24.832Z INFO HttpCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Response code 408 (Request Time-out) (/usr/src/app/node_modules/got-cjs/dist/source/as-promise/index.js:91:42)"]}
I've tried extending the timeout, changing the proxy, changing the URL, etc Unfortunately none of it is working. Please help asap - as my trial started today and ends tomorrow. Thank you!
Hey, Could you send your input json? I am asking, because default input works.
huda.dabbouseh
It was working for a few tries and then I got the error over and over, despite the URL, proxy change, timeout change, etc. I tried again later an hour later and it worked during a request and then got the same error again. I would try today since some time has passed, but looks like my trial ended. :-/
{ "proxy": { "useApifyProxy": false }, "startUrls": [ { "url": "https://www.ulta.com/shop/makeup/body-makeup", "method": "GET" } ] }
huda.dabbouseh
You'll notice in that particular input, I tried without a proxy. But I tried DataCenter, Residential, No Proxy, etc.
huda.dabbouseh
Hello, just following up on this.
{ "proxy": { "useApifyProxy": false }, "startUrls": [ { "url": "https://www.ulta.com/shop/makeup/body-makeup", "method": "GET" } ] }
You need to use proxy
"useApifyProxy": false means that you disabled it.
huda.dabbouseh
As mentioned in each of my messages, I was using the DataCenter proxy, then when that wasn't working, tried Residential. Eventually I tried no proxy. Please review each of my messages in detail. There's an issue with the scraper itself, where it works only on occasion.
I tried the Sephora scraper and that was absolutely amazing. Not only did it never experience a timeout, it also provides a lot more valuable info, such as product variations.
Well, I run it today and it just return results https://api.apify.com/v2/datasets/L4AGFiyIbel5EUllr/items?clean=true&format=json&limit=1000&view=overview Contact us on email contact@mscraper.com , and let me know what exact pages you need to scrape, I will try to help.
mscraperActor Metrics
4 monthly users
-
2 stars
>99% runs succeeded
1.3 days response time
Created in Jun 2023
Modified 5 days ago
