Similarweb Scraper avatar

Similarweb Scraper

Try for free

No credit card required

Go to Store
Similarweb Scraper

Similarweb Scraper

tri_angle/similarweb-scraper
Try for free

No credit card required

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

Do you want to learn more about this Actor?

Get a demo
DY

Crawling is taking much longer than usual

Closed

dyf opened this issue
2 months ago

I notice crawling even one website is now often taking several minutes (my Make automations are breaking with synchronous runs now)

tri_angle avatar

Hi there, we pushed a new build yesterday, it is a bit better, but it generally takes longer due to increased blocking. You can try residential proxies

tri_angle avatar

Please let me know how it works for you now. Thank you

DY

dyf

2 months ago

Hi, I just gave that a go and I don't think it's making an impact: https://imgur.com/a/NSwg2yF

tri_angle avatar

I see, thanks for the message. When testing it this morning it seemed a bit better with residentials but it is really from run to run, in the meantime it started to work quite well with datacenter proxies. Next week we will try to refactor this actor - I will keep you updated

DY

dyf

2 months ago

Thanks — should I switch to datacenter then for now, you reckon?

tri_angle avatar

Yes please, try that. We are preparing a new version of the actor which will be faster, but will also have less fields in the output, but maybe it will be a better fit for you. We will send more info about that soon.

tri_angle avatar

Hi, we published the lighter and faster version of Similarweb, please test it out and let us know how it works for you: https://apify.com/tri_angle/fast-similarweb-scraper Please note that there are some differences in the output, so it depends on which fields you need for your use case.

Developer
Maintained by Apify

Actor Metrics

  • 180 monthly users

  • 36 stars

  • >99% runs succeeded

  • 1.9 days response time

  • Created in May 2022

  • Modified 2 months ago

Categories