Similarweb Scraper avatar
Similarweb Scraper
Try for free

7 days trial then $25.00/month - No credit card required now

View all Actors
Similarweb Scraper

Similarweb Scraper

m0uka/similarweb-scraper
Try for free

7 days trial then $25.00/month - No credit card required now

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

User avatar

Not getting the traffic source data for a lot of domains

Open

robynn_admin opened this issue
6 months ago

Hey,

It has been noticed while testing our application that we are not getting the traffic source data for a lot of domains including some renowned and traffic-heavy websites such as "amazon.com". Need help with this issue on priority as it is affecting the functionality of our application.

User avatar

robynn_admin

6 months ago

Please find the run code for one of the many domains below and the image attached for the issue mentioned above:

[ { "domain": "coditas.com", "title": "code is art", "description": "we are a team of engineers and designers who build beautiful applications. we believe the beauty of an application is not only in the user interface but also in the code, performance and maintainability. we participate in the entire software development life cycle of solutions.", "category": "computers_electronics_and_technology/computers_electronics_and_technology", "categoryRank": "8297", "globalRank": 4811274, "topCountryShares": [ { "Country": 356, "CountryCode": "IN", "Value": 0.2862934446972682 }, { "Country": 792, "CountryCode": "TR", "Value": 0.12711458329850114 }, { "Country": 840, "CountryCode": "US", "Value": 0.08917804545547253 }, { "Country": 170, "CountryCode": "CO", "Value": 0.08398515628062352 }, { "Country": 704, "CountryCode": "VN", "Value": 0.08093344570468188 } ], "screenshot": "https://site-images.similarcdn.com/image?url=coditas.com&t=1&s=1&h=473e92672868e0a62bdf78b2f362dfcd9f0e4a2f39b111cb9edce68acaf2205f", "bounceRate": "0.42353218112882957", "pagesPerVisit": "0.8913021410284981", "timeOnSite": "182.9500139495666", "visits": "9472", "trafficSources": { "Social": null, "Paid Referrals": null, "Mail": null, "Referrals": null, "Search": 0.3954725733958483, "Direct": 0.6045274266041517 }, "countryRank.country": 356, "countryRank.countryCode": "IN", "countryRank.rank": 280634 } ]

User avatar

Hey Robynn, thank you for reaching out. I'll have our delivery team look into it. Will keep you posted on our findings soon.

User avatar

noah_rue

3 months ago

was this fixed beacause i have the same problem?

User avatar

ocular_carpet

3 months ago

same issue, missing lots..

User avatar

noah_rue

3 months ago

im using the actor from curious_coder/similarweb-scraper now. works very clean. no problems. Only the domains that changed and are redirected are not scraped. But that is just a very very small amount compared to what this one is missing

User avatar

ocular_carpet

3 months ago

thanks for the advice @noah - i just tried it and it works much better. Much appreciated!

Developer
Maintained by Apify
Actor metrics
  • 48 monthly users
  • 23.4% runs succeeded
  • 0.0 days response time
  • Created in May 2022
  • Modified 4 months ago