Amazon Product Scraper avatar
Amazon Product Scraper
Try for free

14 days trial then $40.00/month - No credit card required now

View all Actors
Amazon Product Scraper

Amazon Product Scraper

junglee/amazon-crawler
Try for free

14 days trial then $40.00/month - No credit card required now

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

User avatar

Blocked Error

Closed

athletic_trophy opened this issue
5 months ago

when I try to scrape a category page, I am returned a blocked error in the logs and zero results.

https://www.amazon.com/s?k=boo+dog&crid=1W385IIFCPYSF

User avatar

Hi Alex, thanks a lot for reporting this! We are currently aware of a very high increase in Amazon's blocking and are working on a solution to help decrease it ;) In the meantime, try using the useCaptchaSolver input option - note that it's not perfect and has it's own flaws, please read the field caption before using it.

On this topic, here is the warning mail in case you've missed it:

1Hello,
2
3Over the past few days, Amazon has significantly elevated its anti-bot blocking rate, even affecting residential proxies. While it may not impact all page types uniformly, the general consequences include:
4
5Prolonged execution times (attributed to frequent retries)
6Increased costs (stemming from heightened proxy traffic and extended execution times)
7Potentially missing results (if the page exhausts all retry attempts)
8This heightened blocking is possibly temporary, considering Amazon's tendency for aggressive A/B testing. Meanwhile, our development team is actively exploring avenues to enhance the success rate.
9
10We advise you to review your recent and upcoming runs to assess whether the current scraping performance aligns with your specific requirements.
11
12We will provide you with further updates on the situation in the coming days.
13
14Best regards,
User avatar

Hi again, happy to inform you that we've just updated the Actor with some improvements to our backend ;) From out testing it helps to significantly decrease the rate of Amazon's blocking.

Try it out and let me know how it works, thanks!

Developer
Maintained by Apify
Actor metrics
  • 166 monthly users
  • 90.6% runs succeeded
  • 4.5 days response time
  • Created in Oct 2018
  • Modified 6 days ago
Categories