⚙️ [Fast & Low Cost] BuiltWith Bulk Technology Profile Scraper

---

Scrape technology stacks from any list of websites using BuiltWith — fast and at scale. Just provide a list of URLs. Perfect for marketers, developers, analysts, or sales teams looking to analyze web tech usage.

---

🧠 What It Does

This scraper collects structured technology stack data from BuiltWith profiles and outputs a clean, exportable dataset in CSV or JSON format — ready for enrichment, targeting, or analytics.

---

🔧 Inputs

• URL List (required):
  Provide a list of website URLs (e.g., stripe.com, zoom.us). The scraper will query BuiltWith for each.

⚙️ Note: You can optionally use a proxy (custom or Apify's) to rotate IPs and avoid blocks from BuiltWith.

---

🛠️ How to use

Just input all URLs manually or through a JSON file and get your data!

---

📤 Output Format

You’ll get structured technology profile data like this (CSV or JSON):

{
    "domain": "chatgpt.com",
    "Analytics and Tracking": [
      "Statsig"
    ],
    "Widgets": [
      "Cloudflare Bot Manager",
      "CrUX Dataset",
      "CrUX Top 1000",
      "CrUX Top 500k",
      "Cloudflare Radar",
      "Cloudflare Radar Top 50k",
      "Cloudflare Turnstile",
      "Smart App Banner"
    ],
    "Frameworks": [
      "Next.js",
      "Remix",
      "Java EE"
    ],
    "Mobile": [
      "Viewport Meta",
      "IPhone / Mobile Compatible",
      "Apple Mobile Web Clips Icon"
    ],
    "Content Delivery Network": [
      "jsDelivr",
      "Cloudflare",
      "Cloudflare Challenge",
      "Cloudflare Automatic Challenge",
      "Content Delivery Network"
    ],
    "Payment": [
      "Stripe"
    ],
    "JavaScript Libraries and Functions": [
      "jQuery",
      "Intersection Observer",
      "core-js",
      "React",
      "HTML5 History API"
    ],
    "Verified Link": [
      "GitHub",
      "YouTube Link",
      "Artificial Intelligence"
    ],
    "Name Server": [
      "3 to 9 ccTLD Redirects",
      "Cloudflare DNS"
    ],
    "Email Hosting Providers": [
      "Dmarcian",
      "SPF",
      "DMARC",
      "DMARC Reject"
    ],
    "SSL Certificates": [
      "LetsEncrypt",
      "SSL by Default",
      "HSTS",
      "HSTS IncludeSubdomains PreLoad"
    ],
    "Web Hosting Providers": [
      "Cloudflare Hosting",
      "403 Error"
    ],
    "Operating Systems and Servers": [
      "IPv6"
    ],
    "Web Servers": [
      "Microsoft Personal Web Server"
    ],
    "Verified CDN": [
      "Cloudflare CDN"
    ],
    "Robots.txt": [
      "Some Robots Disallow",
      "Anthropic Claude Bot Disallow",
      "ByteDance Bytespider Disallow",
      "Common Crawl Bot Disallow",
      "Facebook Bot Disallow",
      "Google Bard Disallow",
      "Webz Omgili Disallow"
    ],
    "Web Master Registration": [
      "Google Webmaster"
    ]
}

---

🎯 Common Use Cases

• 🔍 Analyze the tech stack of competitor or prospect websites
• 📊 Export clean data for market research and business intelligence
• 🧲 Build contact lists based on technology usage (e.g., Shopify users)
• ⚡ Runs fast, handles large URL lists efficiently
• 🔌 Seamless integration with Apify for scheduling, proxies, datasets and webhooks

---

🧑‍🤝‍🧑 The team

• 🐐 Developed and maintained by the ScrapeGoats.

• 💬 Reach out on Discord if you're interested in custom scrapers or want to suggest new use cases.