Clutch.co Scraper avatar

Clutch.co Scraper

Try for free

3 days trial then $25.00/month - No credit card required now

View all Actors
Clutch.co Scraper

Clutch.co Scraper

curious_coder/clutch-scraper
Try for free

3 days trial then $25.00/month - No credit card required now

Scrape clutch.co and get companies information including website, name, hourly rate, reviews, logo and many more details

does't scrape much

Closed

z1Dxjnoj5giYpBHgi opened this issue
2 months ago

Trying to crawl 5000 records in the web design category in the US. The scraper only give me about 60 records then it stops. Lots of fails in the process of scraping.

What's the trick here? Used datacenter, didn't work. Used residential proxy, didn't work. Used my own paid residential proxies and inputed 50 rotating, didn't work.

What's the formula to get the most records?

Thanks You

curious_coder avatar

Thanks for opening the issue, Let me check and get back to you

curious_coder avatar

Enable Use browser option and don't use any proxies, it will work perfectly. Example run: https://console.apify.com/actors/ue0DjiPkbPaZSlku6/runs/jTgGdqFxDTJeKAghB#log

2 months ago

I tried that but only got 208 records. Then I tried residential proxy, same thing. 167 records. I need over 1000 records.

https://console.apify.com/actors/runs/VELHV5VgFPdprAOUl#log

Developer
Maintained by Community

Actor Metrics

  • 45 monthly users

  • 5 stars

  • >99% runs succeeded

  • 14 days response time

  • Created in Jun 2023

  • Modified 7 days ago

Categories