Similarweb Scraper
7 days trial then $15.00/month - No credit card required now
Similarweb Scraper
7 days trial then $15.00/month - No credit card required now
The most comprehensive Similarweb Scraper you will ever find. Obtain data on website popularity and receive it in formats such as JSON, XML, CSV, Excel, or an HTML table.
Infinite actor run with fake domain
Closed
Hi, I recently tested with a fake domain And I saw the actor retries so many times. I saw in the readme that when users input the wrong input, It would stop. But when I tested, It seems not work. So I have two questions:
- How to know if the domain input is not-existent or invalid? Because I'm about to integrate it into my business. So that I can notify my users if they input the invalid or non-existent domain and then they can check the domain or input the different domain.
- How to stop when domain input is not-existent or How to stop an infinite run? I'm thinking about retry, but I don't see that param. Remember that, I don't want to stop immediately if it fail at the first time. Because when I check the log, I saw that sometimes It needs to recaptcha.
Hey there,
Thank you very much for reaching out, and letting us know about your problem. It seems like Similarweb changed how it is handling the non-existing domains. Therefore, we just deployed a new version to resolve this problem. Let me answer your questions;
- With the latest deployment, the actor pushes an output object with an attribute called
notFound: truewhich allows the users to identify not existing domains. - The actor works as expected without any fail scenarios right now, and does not work infinitely after the deployment. Therefore, if you provide one existing and one non-existing domain to the actor, it should print out 2 outputs properly and stop.
I am closing this issue because of the project management purposes, but if your problem is not resolved properly please feel free to create a new one or reopen this. Best
epctex
