Ulta Scraper avatar

Ulta Scraper

Try for free

7 days trial then $30.00/month - No credit card required now

Go to Store
Ulta Scraper

Ulta Scraper

mscraper/ulta-scraper
Try for free

7 days trial then $30.00/month - No credit card required now

The Ulta Scraper is a powerful tool built to scrape detailed product data from the Ulta. It can retrieve important product data such as product name, skuId, brand, rating, reviews, list price, and more.

Developer
Maintained by Community

Actor Metrics

  • 2 monthly users

  • No reviews yet

  • 2 bookmarks

  • >99% runs succeeded

  • 1.3 days response time

  • Created in Jun 2023

  • Modified a month ago

Categories
HU

Crawling not working

Closed
huda.dabbouseh opened this issue
a month ago

Error:

2025-01-31T04:20:24.619Z ERROR HttpCrawler: Request failed and reached maximum retries. HTTPError: Response code 408 (Request Time-out)

2025-01-31T04:20:24.830Z INFO HttpCrawler: Crawl finished. Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,1],"requestAvgFailedDurationMillis":99,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":14,"requestTotalDurationMillis":99,"requestsTotal":1,"crawlerRuntimeMillis":4103} 2025-01-31T04:20:24.832Z INFO HttpCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Response code 408 (Request Time-out) (/usr/src/app/node_modules/got-cjs/dist/source/as-promise/index.js:91:42)"]}

I've tried extending the timeout, changing the proxy, changing the URL, etc Unfortunately none of it is working. Please help asap - as my trial started today and ends tomorrow. Thank you!

mscraper avatar

Hey, Could you send your input json? I am asking, because default input works.

HU

huda.dabbouseh

a month ago

It was working for a few tries and then I got the error over and over, despite the URL, proxy change, timeout change, etc. I tried again later an hour later and it worked during a request and then got the same error again. I would try today since some time has passed, but looks like my trial ended. :-/

{ "proxy": { "useApifyProxy": false }, "startUrls": [ { "url": "https://www.ulta.com/shop/makeup/body-makeup", "method": "GET" } ] }

HU

huda.dabbouseh

a month ago

You'll notice in that particular input, I tried without a proxy. But I tried DataCenter, Residential, No Proxy, etc.

HU

huda.dabbouseh

a month ago

Hello, just following up on this.

mscraper avatar

{ "proxy": { "useApifyProxy": false }, "startUrls": [ { "url": "https://www.ulta.com/shop/makeup/body-makeup", "method": "GET" } ] }

You need to use proxy "useApifyProxy": false means that you disabled it.

HU

huda.dabbouseh

a month ago

As mentioned in each of my messages, I was using the DataCenter proxy, then when that wasn't working, tried Residential. Eventually I tried no proxy. Please review each of my messages in detail. There's an issue with the scraper itself, where it works only on occasion.

I tried the Sephora scraper and that was absolutely amazing. Not only did it never experience a timeout, it also provides a lot more valuable info, such as product variations.

mscraper avatar

Well, I run it today and it just return results https://api.apify.com/v2/datasets/L4AGFiyIbel5EUllr/items?clean=true&format=json&limit=1000&view=overview Contact us on email contact@mscraper.com , and let me know what exact pages you need to scrape, I will try to help.