Similarweb Scraper
Pricing
Pay per event
Similarweb Scraper
A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..
4.6 (7)
Pricing
Pay per event
79
Total users
3.1K
Monthly users
152
Runs succeeded
>99%
Issues response
1.3 days
Last modified
6 days ago
Crawling erros
Closed
Hi there, I've raised this previously and was told that this its not a bug, but I can't see how this can't be deemed a bug when it fails this many times in a row and runs for 15+ minutes (when it usually takes ~ 1 minute
Hi there, if you check the log of this run, you can see the actor is facing captchas. What you can do is to decrease the number of retries in the input, the default is 10 retries.
gainful_governor
thanks for your reply .... what is the best strategy to get around the captcha? would repeated runs ever solve this? is the captcha based on the fingerprint of the current IP + container?
You can start another run with residential proxy, this works well (at least now). Here is more info about dealing with anti-scraping protection, if you would consider building your own actors in the future https://docs.apify.com/academy/anti-scraping and our discord community: https://discord.com/invite/jyEM2PRvMU
gainful_governor
thanks for your help :-) will try residential proxy
