Similarweb Scraper
Pricing
$15.00/month + usage
Similarweb Scraper
The most comprehensive Similarweb Scraper you will ever find. Obtain data on website popularity and receive it in formats such as JSON, XML, CSV, Excel, or an HTML table.
0.0 (0)
Pricing
$15.00/month + usage
4
Monthly users
10
Runs succeeded
>99%
Response time
1.6 days
Last modified
17 hours ago
Infinite actor run with fake domain
Hi, I recently tested with a fake domain And I saw the actor retries so many times. I saw in the readme that when users input the wrong input, It would stop. But when I tested, It seems not work. So I have two questions:
- How to know if the domain input is not-existent or invalid? Because I'm about to integrate it into my business. So that I can notify my users if they input the invalid or non-existent domain and then they can check the domain or input the different domain.
- How to stop when domain input is not-existent or How to stop an infinite run? I'm thinking about retry, but I don't see that param. Remember that, I don't want to stop immediately if it fail at the first time. Because when I check the log, I saw that sometimes It needs to recaptcha.
Hey there,
Thank you very much for reaching out, and letting us know about your problem. It seems like Similarweb changed how it is handling the non-existing domains. Therefore, we just deployed a new version to resolve this problem. Let me answer your questions;
- With the latest deployment, the actor pushes an output object with an attribute called
notFound: truewhich allows the users to identify not existing domains. - The actor works as expected without any fail scenarios right now, and does not work infinitely after the deployment. Therefore, if you provide one existing and one non-existing domain to the actor, it should print out 2 outputs properly and stop.
I am closing this issue because of the project management purposes, but if your problem is not resolved properly please feel free to create a new one or reopen this. Best
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
7 days
Price
$15.00
