Amazon Product Scraper
14 days trial then $40.00/month - No credit card required now
Amazon Product Scraper
14 days trial then $40.00/month - No credit card required now
Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.
OOM (out of memory) issue
Recently, I got more and more of this issue. I have been using the scraper for months and never got this one.
Hi Ici On Aime Inc., thanks for opening this issue!
I will address two issues here, as you've encountered both of them.
- OOM issue - This is unfortunately caused by our recent implementation of a more advanced scraping system, which is able to better impersonate real browsers and hence get blocked less. We've got one feature in development, which should reduce the usage by a bit, although not that significantly. I see that you are running the scraper with 2 GB, which is a little low for this, so I would recommend you the default 4 GB.
- Failing runs with 0 results - I can see that you've experienced this in some of your runs. It was caused by a change on Amazon, it will get fixed tomorrow.
I will keep you updated here, thanks!
icionaime
Thanks for the update!
Hi again, the 2nd issue is now fixed, it was caused by a "new blocking method" (or an error on Amazon, it's hard to tell), which was causing our scraper to sometimes fail with 0 results.
I will keep you updated about the progress with the OOM issue, although as said, it will only help a little.
icionaime
Hello Lukas, please check the run Lg9yNRDTshpGu0lHh. We were running the scraper with 4 GB as recommended, and still the same issue.
icionaime
Hi again, same issue on 5 out of 7 runs tonight : https://share.zight.com/p9uogkqJ. I am wasting money here. Can you please follow-up on this.
Hi, thanks for sharing the failing runs!
We are going to look into it right now, as that is definitely not supposed to happen on 4 GB.
I will keep you posted here, thanks!
Hi again, thanks for your patience.
We've updated the scraper with the fix a few days ago. There was indeed a bug in our memory usage.
Anyway, it seems to be running pretty consistently now, so I will close this. Feel free to reopen this if you are still experiencing this issue, thanks!
JungleeActor Metrics
296 monthly users
-
106 stars
>99% runs succeeded
2.6 days response time
Created in Oct 2018
Modified 10 hours ago
