Amazon Product Scraper avatar
Amazon Product Scraper
Try for free

14 days trial then $40.00/month - No credit card required now

View all Actors
Amazon Product Scraper

Amazon Product Scraper

junglee/amazon-crawler
Try for free

14 days trial then $40.00/month - No credit card required now

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

SI

Scraper not pulling Amazon list price for many listings

Open

scott_intero opened this issue
2 months ago

For many of the Amazon listings I am doing a test scrape for the scraper is not pulling the list price of the item. I am able to go to the URLs and see the price for which the scraper failed to pull a price. I attached a sample output as well as the URL for the run. I am very interested in this scraping tool and want to ensure that I can pull prices reliably. I would appreciate any help you can provide.

lukas.prusa avatar

Hi Scott, thanks a lot for opening this issue!

I can confirm that the price is not scraped correctly and is not just a problem with proxies and their shown offers. We will look into this, hopefully tomorrow ;)

I will keep you updated here, thanks!

SI

scott_intero

2 months ago

Hi, Lukas.

Thanks so much for confirming the issue. Do you have an update on the status of fixing this issue? I want to be able to test this tool thoroughly once it is fully operational. Is there a way for you to help me extend my trial? Thanks.

lukas.prusa avatar

Hi, unfortunately, we had quite a busy schedule last week.

We are hopefully going to release an update tomorrow, which allows users to crawl and scrape individual product offers and sellers data. Ideally, right after that, we will fix this issue quickly :)

Btw, some of your products in fact don't have a price, because they are unavailable, e.g.:

So hopefully tomorrow with priority, thanks!

SI

scott_intero

2 months ago

Thanks so much for the update, Lukas. I want to use this tool for my company. Is it reasonable to expect that your team updates the scraper as needed or do customers need to reach out to point out issues? How quick;y do you generally resolve issues with the scraper? I would so appreciate it if you have the fix ready tomorrow so I can continue to text. Is there a way to extend my trial given the outage?

lukas.prusa avatar

Yes, we try to keep all of our scrapers up to date with their websites, but as you can imagine, we can't catch everything. Like this time, the prices are only affected for some products and our automatic tests have not caught it. We appreciate all issues reported by our users.

It depends on the issue, its complexity and our current load, but usually in a matter of a few days :)

Unfortunately, the trial is not extendable, but we won't stop you from creating a new testing account and activating it there ;)

SI

scott_intero

a month ago

Ok thanks so much for your support, Lukas. I would love to confirm with you once you have pushed a fix for the price-pulling issue. Thanks!

[SCOTT.png]

lukas.prusa avatar

Hi again, thanks for your patience.

I'm happy to inform you that we've just updated the scraper with a partial fix. We've made some significant changes in our prices extraction logic, so if you encounter any issues, please let us know! I've run the scraper for your products list and the prices are getting scraped correctly. Well mostly...

From your products, I was able to find a few products that are not available across the whole US, and differ in their availability based on the location destination. This is new to us, as we expected all products to be available throughout the entire US the same. For example, this product is available to deliver to New York 10001 but not to Portage 15946‌:

We will see if we can do something about this, as up to this point, we relied on our proxies to automatically choose the Amazon location, but we only support them in countries, not regions.

Anyway, try it out and let me know how it works now. I will keep you updated here about further progress, thanks and happy scraping!

SI

scott_intero

a month ago

Thanks for this update. I found a few more ASINs / URLs that when I visit the product page I can see a price, but the scraper output does not show the price. Here are the URLs: 1) https://www.amazon.com/dp/B09Q3PX6F7?language=en; 2) https://www.amazon.com/dp/B08KHXFXPJ?language=en; 3) https://www.amazon.com/dp/B08KGHHV4B?language=en; 4) https://www.amazon.com/dp/B01JCA4WNY?language=en

lukas.prusa avatar

Thanks for providing more ASINs :)

B09Q3PX6F7 and B01JCA4WNY are encountering the previously mentioned proxy issue with unavailability across some US locations.

Just fixed B08KHXFXPJ and B08KGHHV4B prices extraction. We didn't find the “buy only used offers” product page layout, thank you for catching it!

Anyway, some update about the location setting feature. We've found a promising solution that should be able to set an exact location. Unfortunately, the process is quite complex, so it will for sure take us some time to develop it. hard to assume how long, but most likely around 1–4 weeks.

Thank you!

SI

scott_intero

a month ago

Thanks so much for this update, Lukas. Would you be willing to update me once you implement a solution for the proxy issue?

[SCOTT.png]

Developer
Maintained by Apify
Actor metrics
  • 234 monthly users
  • 61 stars
  • 98.8% runs succeeded
  • 1.1 days response time
  • Created in Oct 2018
  • Modified 1 day ago
Categories