Etsy Scraper avatar

Etsy Scraper

Try for free

3 days trial then $30.00/month - No credit card required now

Go to Store
Etsy Scraper

Etsy Scraper

epctex/etsy-scraper
Try for free

3 days trial then $30.00/month - No credit card required now

Scrape valuable data from over 4 million Etsy sellers. Extract product details, descriptions, listed date, images, seller info, and more. Customize your searches and filters to gather the desired information effortlessly.

CD

We got blocked - proxy usage

Closed

current_dogwood opened this issue
2 years ago

Hi, I constantly get the 'ERROR BasicCrawler: Request failed and reached maximum retries. Error: We got blocked.' Error. I'm currently using my own proxy - but thought that it can be useful to add some random waiting time between requests (to not get blocked) or maybe being able to randomly switch each request between a list of proxies? Any other way to overcome this issue? Thanks!

TU

tugkan

2 years ago

Hey there,

Thank you very much for reaching out. The actors are using the most advanced unblocking strategy for penetration purposes. This means that if your own proxy supports multiple IPs at the same time, it will also work. My strong recommendation will be using Residential USA proxies for the safe bet.

Best

Developer
Maintained by Community

Actor Metrics

  • 106 monthly users

  • 22 stars

  • 99% runs succeeded

  • 23 hours response time

  • Created in Mar 2021

  • Modified 3 hours ago

Categories