Similarweb Scraper
No credit card required
Similarweb Scraper
No credit card required
A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..
Do you want to learn more about this Actor?
Get a demoAfter 25 result it starts to show no results at all even though there is data available in Similar Web
Closed
After 25 result it starts to show no results at all even though there is data available in Similar Web. Please see the attached screenshots. The first 25 results were perfectly fine. After the 25th it started to show almost no results
noah_rue
i tested it again, this time with 8 gb ram. the same story but a little bit different: until the 25th result everything was fine. After that some of the results with supposedly 0 traffic were wrong, there was traffic (as seen in the screenshots). Though there were more correct answers than in the first run. Beginning from the 77th result there were again 0 results. This started later this time then the test before
natural_xerocopier
i have the same problem. i get empty results right at the beginning - e.g. 31% of 50 requests were completed successfully; from web page #217 onwards there are only NULL values. According to the log, there are probably several problems. Firstly, the website is marked as successfully crawled, but returns NULL values. Secondly, cookie problems are probably responsible for the NULL result.
noah_rue
just look at the other issue, i made a comment which other similar web scraper works good. its the one from curius_coder, this works way better. Only fails when the domains are redirected.
eventvesta
We are also experiencing this issue, but it isn't happening predictably. It looks like we'll have a bunch of sites that will be scraped with correct results, then randomly the sites will pass or fail until our run is finished (we are currently attempting to do runs of > 500 urls).
It would be great if this was fixed, so that we don't have to refactor our code to split everything into 10-url chunks...
Tri⟁angle
