$12.00/month

BuiltWith (Bulk URLs)

canadesk/builtwith-bulk

Try Actor

$12.00/month

Find out what websites are Built With (technology looker). More details, bulk URLs! It's fast and costs little.

Back to issues Create new issue

96 success, 3 failed

Closed

acclaimed_rutabaga opened this issue

Hi,

It's me again, thank you for fixing the other bug, it's working past 5 now. I'm prepare to run a few thousand websites but first I've done a test run with 99 websites and 3 failed.

I don't know why and it's not a problem that it failed 3 times given the success rate.

But is there a way to find which websites failed to get parsed so I can include them in next runs?

If that's hard to do, maybe is there a way to run it slower, or with more proxies, so it doesn't fail?

Thank you so much for the great work

Canadesk Support (canadesk)

No worries. We see "REQUESTS 99 of 99 handled" and 99 websites in your array.

However we've added logging in case BuiltWith does not return any results:

2024-02-23T18:21:40.405Z Processing https://builtwith.com/beckettsimonon.com.. 2024-02-23T18:21:40.517Z Processing https://builtwith.com/zeaazeezaeza.zo.. 2024-02-23T18:21:41.609Z 💣 Could not reach: https://builtwith.com/zeaazeezaeza.zo

See the note about Concurrency in the Information tab for scaling.

Add comment

Developer

Canadesk Support

Actor Metrics

9 monthly users
16 bookmarks
>99% runs succeeded
2.5 hours response time
Created in Feb 2024
Modified 4 months ago

Categories

Premium X User Scraper | $0.15/1000 Users | Pay Per Result

kaitoeasyapi/premium-twitter-user-scraper-pay-per-result

Just $0.15 per 1000 profiles! Premium Twitter(X) User Data Extractor. Get instant access to comprehensive user details: bio, metrics, verified status & more. Trusted by analysts for accurate data. Lightning - fast extraction, 99.9% success rate. Blazing - fast: 40 profiles/second for bulk extraction

Kaito Easy API

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.6k

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

15.7k

484

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

74.3k

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

18.3k

284

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

29.5k

735

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

28k

321

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

120

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

25.9k

268

Similarweb Scraper

tri_angle/similarweb-scraper

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..