BuiltWith (Bulk URLs) avatar
BuiltWith (Bulk URLs)
Try Actor

$12.00/month

View all Actors
BuiltWith (Bulk URLs)

BuiltWith (Bulk URLs)

canadesk/builtwith-bulk
Try Actor

$12.00/month

Find out what websites are Built With (technology looker). More details, bulk URLs! It's fast and costs little.

AC

Only 1 url is successful, all others fail

Closed

aspiring_commander opened this issue
3 months ago

If I pass it a list of urls, it will randomly choose 1 and I get a successful result. all the others fail. If I pass the same list in multiple attempts, the successful result is a random url from that list. changes every time.

canadesk avatar

You are not using any proxy so Apify is getting blocked. Please set one, preferably a custom one.

See https://apify.com/proxy.

Example:

{ "maxReq": 5, "maxReqCoeff": 5, "process": "gt", "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] }, "startUrls": [ "frolicape.com", "bozell.com", "goodrobotmedia.com", "amarquez.agency", "daeandcompany.com", "havas.com", "wearestarke.com", "interexy.com", "alphagraphics.com", "intellisofttech.com" ], "waiting": 1500 }

Developer
Maintained by Community
Actor metrics
  • 2 monthly users
  • 4 stars
  • 100.0% runs succeeded
  • 0.99 hours response time
  • Created in Feb 2024
  • Modified 12 days ago