BuiltWith (Bulk URLs) avatar

BuiltWith (Bulk URLs)

Try Actor

$12.00/month

View all Actors
BuiltWith (Bulk URLs)

BuiltWith (Bulk URLs)

canadesk/builtwith-bulk
Try Actor

$12.00/month

Find out what websites are Built With (technology looker). More details, bulk URLs! It's fast and costs little.

AC

Only 1 url is successful, all others fail

Closed

aspiring_commander opened this issue
6 months ago

If I pass it a list of urls, it will randomly choose 1 and I get a successful result. all the others fail. If I pass the same list in multiple attempts, the successful result is a random url from that list. changes every time.

canadesk avatar

You are not using any proxy so Apify is getting blocked. Please set one, preferably a custom one.

See https://apify.com/proxy.

Example:

{ "maxReq": 5, "maxReqCoeff": 5, "process": "gt", "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] }, "startUrls": [ "frolicape.com", "bozell.com", "goodrobotmedia.com", "amarquez.agency", "daeandcompany.com", "havas.com", "wearestarke.com", "interexy.com", "alphagraphics.com", "intellisofttech.com" ], "waiting": 1500 }

Developer
Maintained by Community

Actor Metrics

  • 5 monthly users

  • 6 stars

  • 98% runs succeeded

  • 1.8 days response time

  • Created in Feb 2024

  • Modified a month ago