7 days trial then $25.00/month - No credit card required now
Similarweb Scraper
7 days trial then $25.00/month - No credit card required now
A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..
Not getting the traffic source data for a lot of domains
Closed
Hey,
It has been noticed while testing our application that we are not getting the traffic source data for a lot of domains including some renowned and traffic-heavy websites such as "amazon.com". Need help with this issue on priority as it is affecting the functionality of our application.
robynn_admin
Please find the run code for one of the many domains below and the image attached for the issue mentioned above:
[ { "domain": "coditas.com", "title": "code is art", "description": "we are a team of engineers and designers who build beautiful applications. we believe the beauty of an application is not only in the user interface but also in the code, performance and maintainability. we participate in the entire software development life cycle of solutions.", "category": "computers_electronics_and_technology/computers_electronics_and_technology", "categoryRank": "8297", "globalRank": 4811274, "topCountryShares": [ { "Country": 356, "CountryCode": "IN", "Value": 0.2862934446972682 }, { "Country": 792, "CountryCode": "TR", "Value": 0.12711458329850114 }, { "Country": 840, "CountryCode": "US", "Value": 0.08917804545547253 }, { "Country": 170, "CountryCode": "CO", "Value": 0.08398515628062352 }, { "Country": 704, "CountryCode": "VN", "Value": 0.08093344570468188 } ], "screenshot": "https://site-images.similarcdn.com/image?url=coditas.com&t=1&s=1&h=473e92672868e0a62bdf78b2f362dfcd9f0e4a2f39b111cb9edce68acaf2205f", "bounceRate": "0.42353218112882957", "pagesPerVisit": "0.8913021410284981", "timeOnSite": "182.9500139495666", "visits": "9472", "trafficSources": { "Social": null, "Paid Referrals": null, "Mail": null, "Referrals": null, "Search": 0.3954725733958483, "Direct": 0.6045274266041517 }, "countryRank.country": 356, "countryRank.countryCode": "IN", "countryRank.rank": 280634 } ]
Hey Robynn, thank you for reaching out. I'll have our delivery team look into it. Will keep you posted on our findings soon.
noah_rue
was this fixed beacause i have the same problem?
ocular_carpet
same issue, missing lots..
noah_rue
im using the actor from curious_coder/similarweb-scraper now. works very clean. no problems. Only the domains that changed and are redirected are not scraped. But that is just a very very small amount compared to what this one is missing
ocular_carpet
thanks for the advice @noah - i just tried it and it works much better. Much appreciated!
Tri⟁angle
