
Clutch.co Scraper
Pricing
$40.00/month + usage

Clutch.co Scraper
Scrape clutch.co and get companies information including website, name, hourly rate, reviews, logo and many more details
1.0 (1)
Pricing
$40.00/month + usage
9
Total users
496
Monthly users
34
Runs succeeded
>99%
Last modified
5 months ago
does't scrape much
Closed
Trying to crawl 5000 records in the web design category in the US. The scraper only give me about 60 records then it stops. Lots of fails in the process of scraping.
What's the trick here? Used datacenter, didn't work. Used residential proxy, didn't work. Used my own paid residential proxies and inputed 50 rotating, didn't work.
What's the formula to get the most records?
Thanks You

Thanks for opening the issue, Let me check and get back to you

Enable Use browser
option and don't use any proxies, it will work perfectly. Example run: https://console.apify.com/actors/ue0DjiPkbPaZSlku6/runs/jTgGdqFxDTJeKAghB#log
usr-z1Dxjnoj
I tried that but only got 208 records. Then I tried residential proxy, same thing. 167 records. I need over 1000 records.