Pricing

from $10.00 / 1,000 domain analyzeds

Tech Stack Lookup - Company Vendor & SaaS Detection API

Give it a domain, get the SaaS vendors that company actually uses. Reads DNS verification records - the procurement trail HTML scanners miss - to surface AI tools, security, identity, CRM and collaboration vendors, plus email host and DMARC posture.

Pricing

from $10.00 / 1,000 domain analyzeds

Rating

0.0

(0)

Developer

Amit Mudaliyar

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Tech Stack · M365 & Google Workspace

corent1robert/collaboration-platform-detector

Paste company domains — see Microsoft 365, Google Workspace, or Slack per row. Confidence score, MX signals, CSV-ready. Built for outbound & HR tech sales. No API key.

Corentin Robert

Company Enrichment API - Domain to Firmographics, Tech & Email

santhej/company-intel-lookup

One domain in, one flat JSON company profile out: company name, address, emails, phones, socials, full tech stack, the back-office SaaS a company runs read from DNS, and a graded MX/SPF/DMARC/DKIM deliverability verdict. Flat price per domain, no run minimum, no free-tier penalty. Built for agents.

Santhej Kallada

5.0

(4)

Website Tech Stack & Contact Scraper

glitchbound/website-scraper

Analyse any website in bulk: detect the platform (Shopify, WordPress, Wix, Webflow, Magento…), framework, analytics, marketing tools and payment providers, plus the business contact email and social links the site publishes. Filter by platform, e-commerce, or sites running no analytics at all.

Daniel Meshulam

Welcome to the Jungle Scraper: WTJ Tech Jobs FR/EU + Salaries

dltik/welcome-to-the-jungle-scraper

Scrape Welcome to the Jungle jobs by keyword, country, contract, city, remote. Get salary, native tech stack, benefits, apply URL + ATS vendor, company profile, and — uniquely — the employer's application-form screening questions. Optional AI fit-scoring + SIREN. $0.50/1K jobs.

Walid

Glassdoor Jobs Scraper for Hiring Research

skootle/glassdoor-jobs-reviews

Scrape Glassdoor job search results for roles, companies, locations, salary snippets, URLs, and structured hiring records. Built for recruiting intelligence, labor-market research, and AI sourcing workflows.

Skootle

Auto Repair Shop Lead Finder - Tekmetric, Mitchell 1

seibs.co/auto-repair-lead-finder

Enriched Google Maps leads for US independent auto repair shops, body shops, tire shops, transmission shops, and quick lube. Detects Mitchell1, Shopmonkey, Tekmetric, AutoLeap, RO Writer, Shop-Ware, Identifix, ALLDATA, Fullbay. National chains pre-blocked.

Seibs.co

Childcare & Daycare Lead Finder - Brightwheel, Procare

seibs.co/childcare-daycare-lead-finder

Enriched Google Maps leads for US independent daycares, preschools, Montessori, after-school. Detects Brightwheel, Procare, HiMama/Lillio, Kangarootime, KidKare, SmartCare. KinderCare, Bright Horizons, Goddard, Primrose pre-blocked.

Seibs.co

Funeral Home Lead Finder - Tribute, Frazer, Passare

seibs.co/funeral-home-lead-finder

Enriched Google Maps leads for US funeral homes, mortuaries, crematories, cemeteries, pet aftercare. Detects Tribute, Continental Computing, Frazer, Passare, FAM, FuneralONE, Halcyon, ASD. SCI/Dignity, Carriage, Park Lawn, StoneMor pre-blocked.

Seibs.co

Tech Stack Detector API - BuiltWith & Wappalyzer Alternative

tugelbay/website-tech-stack-detector

Tech stack detector and website technology checker API. BuiltWith/Wappalyzer alternative for bulk URL enrichment: detect 100+ CMS, ecommerce, framework. Guide: https://konabayev.com/tools/website-tech-stack-detector/?utm_source=apify_info&utm_medium=referral&utm_campaign=website-tech-stack-detector

Tugelbay Konabayev

Job Posting Lead Finder | $3/1K | Lead Score, Hiring Signal

apivault_labs/apify-actor-job-leads

Find companies actively hiring across Indeed, LinkedIn Jobs, and Glassdoor. Extract job titles, salaries, locations, and company names. Auto-deduplication by company. Companies posting jobs = companies with budget = your best leads. $3 per 1,000 results.

Apivault Labs

{ "name": "company-tech-stack-vendor-intelligence", "version": "0.1.0", "type": "module", "description": "Detect the SaaS vendors a company actually uses, from public DNS and web signals.", "engines": { "node": ">=18" }, "dependencies": { "apify": "^3.2.6" }, "scripts": { "start": "node src/main.js", "test": "node test/smoke.js" }, "license": "ISC" }

1# Publish checklist — Tech Stack Lookup 2 3Deployed 21 Aug 2026 as **`amitmudaliyar/company-tech-stack-vendor-intelligence`**, build `0.1.1`, **private**. 4 5- Actor: https://console.apify.com/actors/7FdSE5gbbWVripwh3 6- Publication tab: https://console.apify.com/actors/7FdSE5gbbWVripwh3/publication 7 8Verified on the platform: **5/5 domains, 114 vendors, 14 seconds** (daily auto-test limit is 300s). Tests: **12/12**. 9 10You've done this once already, so this is the short version — same five sections, same order. 11 12--- 13 14## 1. Display information 15 16**Actor name** 17``` 18Tech Stack Lookup - Company Vendor & SaaS Detection API 19``` 20 21Tick **Use custom SEO details**, then: 22 23**SEO title** 24``` 25Tech Stack Lookup API - Find What SaaS a Company Uses 26``` 27 28**SEO description** (152 chars) 29``` 30Find the SaaS vendors any company uses. Detects AI tools, CRM, security and analytics from public DNS and web signals. Domain in, vendor list out. 31``` 32 33**Description** 34``` 35Give it a domain, get the SaaS vendors that company actually uses. Reads DNS verification records - the procurement trail HTML scanners miss - to surface AI tools, security, identity, CRM and collaboration vendors, plus email host and DMARC posture. 36``` 37 38**Categories:** `LEAD_GENERATION` (primary), `AUTOMATION`, `DEVELOPER_TOOLS` 39 40Upload an icon. Leave **Hide source files** unchecked. All three Actor status toggles off. 41 42--- 43 44## 2. Monetization — pay per event 45 46| Event name | Title | Price (USD) | Infrequent | 47| --- | --- | --- | --- | 48| `apify-actor-start` | Actor start | `0.001` | ✅ | 49| `domain-analyzed` | Domain analyzed | `0.01` | ☐ | 50 51**Primary event:** `domain-analyzed` → displays as **$10.00 / 1,000 domains**. 52 53**Delete `apify-default-dataset-item`** if Apify pre-adds it. The code charges `domain-analyzed` explicitly, so leaving the synthetic event active would double-bill every row — and with `outputVendorRows` on, a single domain writes 25+ rows, so the overcharge would be severe. 54 55Under **Additional options**: leave *Pay per event + usage* **off**, set **Minimum for max cost per run** to `0.05`. 56 57### Why $0.01 per domain 58 59One charge per domain regardless of how many vendors come back — simple to quote and simple to trust. For comparison, BuiltWith starts around $295/month and Clearbit-style enrichment runs $0.10–$1.00 per record. At $10 per 1,000 domains you're an order of magnitude cheaper than the category, and your cost is a handful of DNS lookups. 60 61Domains with no DNS records are **not charged**, which is already implemented. 62 63--- 64 65## 3. Remaining sections 66 67- **Input schema** — ships in the build ✅ 68- **Output schema** — ships in the build ✅ 69- **Actor permissions** — set to **limited permissions** (required for x402 agentic payments; this Actor only makes outbound HTTP calls) 70 71Then **Publish on Store**. 72 73--- 74 75## 4. Cross-promotion — the reason this Actor exists 76 77Your two Actors share an input (a company domain) and a buyer (GTM, sales, recruiting). Cross-discovery — buyers finding your other Actors from your profile — becomes a meaningful traffic source around months 5–6, and it only works if the connection is obvious. 78 79- The README here already links to the jobs Actor. 80- **Add the reverse link** to the jobs Actor's README, and mention Workday support while you're editing: 81 82> Pairs with **Tech Stack Lookup** — this one tells you who a company is hiring, that one tells you what they buy. 83 84Then redeploy that Actor: 85 86```bash 87cd C:\Users\Daichi\hiring-signal-api 88apify push 89``` 90 91--- 92 93## 5. Launch angle 94 95The strongest hook is the AI-adoption data, because it barely exists in commercial datasets yet: 96 97> *"I profiled 8 fintech and design companies. 7 of 8 have OpenAI in their DNS, 5 have Cursor, 4 have Anthropic. You can check any company's AI stack from public records in about a second."* 98 99That is a concrete, verifiable, surprising claim — anyone can confirm it with `dig`, which is exactly what makes it travel. Post it where GTM and security people already are. 100 101## 6. Growing the knowledge base 102 103Every unrecognised TXT prefix is returned in `unmatchedTxtPrefixes` (with `includeRawDns: true`) rather than dropped. That's your roadmap: run it across a few hundred domains, look at what comes back unnamed, and add the frequent ones to `src/vendors.js`. Detection quality compounds, and it's the moat a competitor would have to rebuild from scratch.

{ "actorSpecification": 1, "name": "company-tech-stack-vendor-intelligence", "title": "Tech Stack Lookup - Company Vendor & SaaS Detection API", "description": "Give it a domain, get the SaaS vendors that company actually uses - AI tools, CRM, security, analytics - detected from public DNS and web signals.", "version": "0.1", "buildTag": "latest", "meta": { "templateId": "js-empty" }, "input": "./input_schema.json", "output": "./output_schema.json", "dockerfile": "./Dockerfile", "readme": "../README.md", "storages": { "dataset": "./dataset_schema.json" }, "minMemoryMbytes": 256, "maxMemoryMbytes": 1024 }

{ "actorSpecification": 1, "fields": {}, "views": { "profiles": { "title": "Domain profiles", "description": "One row per company domain.", "transformation": { "fields": ["domain", "vendorCount", "aiTools", "emailProvider", "dnsProvider", "crmSalesTools", "securityTools", "analyticsTools", "dmarcPolicy", "siteTitle"] }, "display": { "component": "table", "properties": { "domain": { "label": "Domain" }, "vendorCount": { "label": "Vendors" }, "aiTools": { "label": "AI tools" }, "emailProvider": { "label": "Email" }, "dnsProvider": { "label": "DNS" }, "crmSalesTools": { "label": "CRM / sales" }, "securityTools": { "label": "Security" }, "analyticsTools": { "label": "Analytics" }, "dmarcPolicy": { "label": "DMARC" }, "siteTitle": { "label": "Site title" } } } }, "vendors": { "title": "Vendor rows", "description": "One row per detected vendor.", "transformation": { "fields": ["domain", "vendor", "categoryLabel", "sources", "evidence"] }, "display": { "component": "table", "properties": { "domain": { "label": "Domain" }, "vendor": { "label": "Vendor" }, "categoryLabel": { "label": "Category" }, "sources": { "label": "Detected via" }, "evidence": { "label": "Evidence" } } } } } }

FROM apify/actor-node:22 COPY package*.json ./ RUN npm --quiet set progress=false \ && npm install --omit=dev --omit=optional \ && echo "Installed NPM packages:" \ && (npm list --omit=dev --all || true) \ && echo "Node.js version:" && node --version \ && rm -r ~/.npm COPY . ./ CMD npm start --silent

{ "title": "Company Tech Stack & Vendor Intelligence", "type": "object", "schemaVersion": 1, "properties": { "domains": { "title": "Domains", "type": "array", "description": "Company domains to profile. Accepts bare domains or full URLs — figma.com, https://www.monzo.com, etc.", "editor": "stringList", "prefill": ["figma.com", "monzo.com", "gitlab.com", "ramp.com", "notion.so"], "default": ["figma.com", "monzo.com", "gitlab.com", "ramp.com", "notion.so"] }, "categories": { "title": "Only these categories", "type": "array", "description": "Keep only vendors in these categories. Leave empty for everything.", "editor": "select", "items": { "type": "string", "enum": [ "ai", "email", "email-marketing", "crm-sales", "support", "analytics", "advertising", "security", "identity-sso", "collaboration", "devtools", "observability", "cloud-hosting", "cdn-dns", "payments", "hr", "esignature", "design", "ecommerce", "cms", "framework", "automation", "communications", "legal-privacy", "workplace" ] }, "prefill": [], "sectionCaption": "Filters", "sectionDescription": "Optional. Use these to answer questions like \"which of these companies use an AI coding tool?\"" }, "vendorFilter": { "title": "Only these vendors", "type": "array", "description": "Keep only vendors whose name contains one of these strings, e.g. \"openai\", \"drift\". Great for building a target list of companies that already use a specific product.", "editor": "stringList", "prefill": [] }, "includePageSignals": { "title": "Include homepage signals", "type": "boolean", "description": "Also fetch the homepage to detect analytics, chat widgets, CMS and frameworks. Turn off for a pure DNS run, which is faster and works even when a site blocks bots.", "default": true, "sectionCaption": "Output options" }, "outputVendorRows": { "title": "Also output one row per vendor", "type": "boolean", "description": "Adds a flat row per detected vendor alongside the domain profile. Handy for CSV exports and pivot tables.", "default": false }, "includeRawDns": { "title": "Include raw DNS records", "type": "boolean", "description": "Adds MX records, nameservers, SPF includes and any unrecognised TXT prefixes to each profile.", "default": false }, "concurrency": { "title": "Concurrency", "type": "integer", "description": "How many domains to profile in parallel.", "minimum": 1, "maximum": 25, "default": 8, "sectionCaption": "Advanced" } }, "required": ["domains"] }

{ "actorOutputSchemaVersion": 1, "title": "Tech stack output", "description": "One vendor profile per domain, plus optional flat vendor rows.", "properties": { "profiles": { "type": "string", "title": "Domain profiles", "description": "One record per domain: detected vendors, category breakdown, email and DNS providers, and email-security posture.", "template": "{{links.apiDefaultDatasetUrl}}/items?view=profiles" }, "vendors": { "type": "string", "title": "Vendor rows", "description": "One flat row per detected vendor (requires the 'Also output one row per vendor' option).", "template": "{{links.apiDefaultDatasetUrl}}/items?view=vendors" }, "downloadCsv": { "type": "string", "title": "Download as CSV", "template": "{{links.apiDefaultDatasetUrl}}/items.csv" }, "runSummary": { "type": "string", "title": "Run summary", "description": "Totals, vendor-frequency leaderboard across all domains, and any domains with no DNS signal.", "template": "{{links.apiDefaultKeyValueStoreUrl}}/records/RUN_SUMMARY" } } }

1/** 2 * Fingerprinting engine. 3 * 4 * Everything here reads public infrastructure records - DNS over HTTPS plus, 5 * optionally, the homepage response. No proxies, no headless browsers, no 6 * authenticated APIs, so runs are fast, cheap and legally uncomplicated. 7 */ 8 9import { 10 SPF_VENDORS, MX_VENDORS, NS_VENDORS, HEADER_VENDORS, HTML_VENDORS, matchTxt, 11} from './vendors.js'; 12 13const UA = 'Mozilla/5.0 (compatible; TechStackBot/1.0; +https://apify.com)'; 14const DOH = 'https://cloudflare-dns.com/dns-query'; 15const DNS_TIMEOUT = 10000; 16const HTTP_TIMEOUT = 12000; 17 18/** "https://www.Figma.com/about" -> "figma.com" */ 19export function normalizeDomain(input) { 20 let s = String(input || '').trim().toLowerCase(); 21 if (!s) return null; 22 s = s.replace(/^[a-z]+:\/\//, '').replace(/^www\./, '') 23 .split('/')[0].split('?')[0].split('#')[0].replace(/\.$/, ''); 24 if (!s.includes('.') || /\s/.test(s)) return null; 25 return s; 26} 27 28/** One DNS-over-HTTPS lookup. Returns [] on any failure - callers treat it as "no signal". */ 29export async function dnsQuery(name, type) { 30 try { 31 const res = await fetch(`${DOH}?name=${encodeURIComponent(name)}&type=${type}`, { 32 headers: { accept: 'application/dns-json' }, 33 signal: AbortSignal.timeout(DNS_TIMEOUT), 34 }); 35 if (!res.ok) return []; 36 const json = await res.json(); 37 return (json.Answer || []).map((a) => String(a.data || '').replace(/^"|"$/g, '')); 38 } catch { 39 return []; 40 } 41} 42 43const addVendor = (map, vendor, category, source, evidence) => { 44 if (!vendor) return; 45 const key = vendor.toLowerCase(); 46 const existing = map.get(key); 47 if (existing) { 48 if (!existing.sources.includes(source)) existing.sources.push(source); 49 return; 50 } 51 map.set(key, { vendor, category, sources: [source], evidence: String(evidence || '').slice(0, 120) }); 52}; 53 54/** Parse SPF includes, following one level of redirects/includes is deliberately skipped. */ 55function readSpf(txtRecords, map) { 56 const spf = txtRecords.find((t) => /^v=spf1/i.test(t)); 57 const includes = []; 58 if (!spf) return { spf: null, includes }; 59 for (const m of spf.matchAll(/include:([^\s]+)/gi)) { 60 const host = m[1].toLowerCase(); 61 includes.push(host); 62 for (const [needle, vendor, category] of SPF_VENDORS) { 63 if (host.includes(needle.toLowerCase())) addVendor(map, vendor, category, 'spf', host); 64 } 65 } 66 return { spf, includes }; 67} 68 69/** Fetch the homepage once and read headers plus a bounded slice of HTML. */ 70async function readSite(domain, map) { 71 const out = { reachable: false, finalUrl: null, statusCode: null, title: null }; 72 try { 73 const res = await fetch(`https://${domain}`, { 74 headers: { 'user-agent': UA, accept: 'text/html,*/*' }, 75 redirect: 'follow', 76 signal: AbortSignal.timeout(HTTP_TIMEOUT), 77 }); 78 out.reachable = true; 79 out.statusCode = res.status; 80 out.finalUrl = res.url || null; 81 82 for (const [header, vendor, category] of HEADER_VENDORS) { 83 const value = res.headers.get(header); 84 if (value === null) continue; 85 addVendor(map, vendor || value, category, 'header', `${header}: ${value}`); 86 } 87 const server = res.headers.get('server'); 88 if (server && !/cloudflare/i.test(server)) { 89 addVendor(map, server.split('/')[0], 'cloud-hosting', 'header', `server: ${server}`); 90 } 91 92 const html = (await res.text()).slice(0, 400000); 93 const title = html.match(/<title[^>]*>([\s\S]{0,200}?)<\/title>/i); 94 if (title) out.title = title[1].replace(/\s+/g, ' ').trim(); 95 96 for (const [needle, vendor, category] of HTML_VENDORS) { 97 if (html.includes(needle)) addVendor(map, vendor, category, 'html', needle); 98 } 99 } catch { 100 /* unreachable site - DNS signals still stand on their own */ 101 } 102 return out; 103} 104 105/** 106 * Build the full vendor fingerprint for one domain. 107 * DNS lookups run in parallel; the page fetch is optional. 108 */ 109export async function fingerprintDomain(domain, { includePageSignals = true } = {}) { 110 const map = new Map(); 111 112 const [txt, mx, ns, dmarcTxt] = await Promise.all([ 113 dnsQuery(domain, 'TXT'), 114 dnsQuery(domain, 'MX'), 115 dnsQuery(domain, 'NS'), 116 dnsQuery(`_dmarc.${domain}`, 'TXT'), 117 ]); 118 119 // TXT verification tokens: the strongest signal, since a company can only 120 // publish one after proving ownership inside that vendor's product. 121 const unmatchedTxt = []; 122 for (const record of txt) { 123 // "v=spf1", "v=DMARC1", "v=verifydomain" etc. are protocol records, not vendor tokens. 124 if (/^v=/i.test(record)) continue; 125 const hit = matchTxt(record); 126 if (hit) addVendor(map, hit.vendor, hit.category, 'dns-txt', record); 127 else if (/[=:]/.test(record) && record.length < 200) unmatchedTxt.push(record.split(/[=:]/)[0]); 128 } 129 130 const { spf, includes: spfIncludes } = readSpf(txt, map); 131 132 let emailProvider = null; 133 for (const record of mx) { 134 const host = (record.split(' ').pop() || '').replace(/\.$/, '').toLowerCase(); 135 for (const [needle, vendor] of MX_VENDORS) { 136 if (host.includes(needle)) { 137 emailProvider = emailProvider || vendor; 138 addVendor(map, vendor, 'email', 'mx', host); 139 break; 140 } 141 } 142 } 143 144 let dnsProvider = null; 145 for (const record of ns) { 146 const host = record.replace(/\.$/, '').toLowerCase(); 147 for (const [needle, vendor] of NS_VENDORS) { 148 if (host.includes(needle)) { 149 dnsProvider = dnsProvider || vendor; 150 addVendor(map, vendor, 'cdn-dns', 'ns', host); 151 break; 152 } 153 } 154 } 155 156 const dmarc = dmarcTxt.find((t) => /^v=DMARC1/i.test(t)) || null; 157 const dmarcPolicy = dmarc ? (dmarc.match(/\bp=([a-z]+)/i)?.[1] || null) : null; 158 159 const site = includePageSignals ? await readSite(domain, map) : { reachable: null }; 160 161 const vendors = [...map.values()].sort((a, b) => a.category.localeCompare(b.category) 162 || a.vendor.localeCompare(b.vendor)); 163 164 return { 165 vendors, 166 emailProvider, 167 dnsProvider, 168 hasSpf: Boolean(spf), 169 spfIncludes, 170 hasDmarc: Boolean(dmarc), 171 dmarcPolicy, 172 mxRecords: mx.map((r) => (r.split(' ').pop() || '').replace(/\.$/, '')), 173 nameservers: ns.map((r) => r.replace(/\.$/, '')), 174 txtRecordCount: txt.length, 175 unmatchedTxtPrefixes: [...new Set(unmatchedTxt)].slice(0, 25), 176 site, 177 }; 178}

1import { Actor, log } from 'apify'; 2 3import { fingerprintDomain, normalizeDomain } from './fingerprint.js'; 4import { CATEGORY_LABELS } from './vendors.js'; 5 6await Actor.init(); 7 8/* ------------------------------------------------------------------ * 9 * Input 10 * ------------------------------------------------------------------ */ 11 12const input = (await Actor.getInput()) ?? {}; 13 14const { 15 domains = [], 16 categories = [], 17 vendorFilter = [], 18 includePageSignals = true, 19 outputVendorRows = false, 20 includeRawDns = false, 21 concurrency = 8, 22} = input; 23 24if (!Array.isArray(domains) || domains.length === 0) { 25 throw new Error('Input "domains" is required and must be a non-empty array, e.g. ["figma.com", "monzo.com"].'); 26} 27 28const catFilter = new Set((categories || []).map((c) => String(c).toLowerCase().trim()).filter(Boolean)); 29const venFilter = (vendorFilter || []).map((v) => String(v).toLowerCase().trim()).filter(Boolean); 30 31const cleanDomains = [...new Set( 32 domains.map((d) => normalizeDomain(d)).filter(Boolean), 33)]; 34 35const invalid = domains.length - cleanDomains.length; 36if (cleanDomains.length === 0) { 37 throw new Error('None of the supplied values look like domains. Pass values such as "figma.com" or "https://monzo.com".'); 38} 39 40log.info(`Tech Stack API starting for ${cleanDomains.length} domain(s)`, { 41 includePageSignals, 42 categoryFilter: [...catFilter], 43 vendorFilter: venFilter, 44 skippedInvalidInputs: invalid, 45}); 46 47/* ------------------------------------------------------------------ * 48 * Billing - one event per domain actually profiled. 49 * ------------------------------------------------------------------ */ 50 51let budgetExhausted = false; 52 53async function charge(eventName, count = 1) { 54 if (budgetExhausted || count <= 0) return; 55 try { 56 const res = await Actor.charge({ eventName, count }); 57 if (res?.eventChargeLimitReached) { 58 budgetExhausted = true; 59 log.warning(`Run budget reached while charging "${eventName}". Finishing early.`); 60 } 61 } catch (err) { 62 log.debug(`charge("${eventName}") skipped: ${err.message}`); 63 } 64} 65 66/* ------------------------------------------------------------------ * 67 * Per-domain pipeline 68 * ------------------------------------------------------------------ */ 69 70const stats = { 71 domainsRequested: cleanDomains.length, 72 domainsProfiled: 0, 73 domainsWithNoSignal: 0, 74 vendorsDetected: 0, 75 byCategory: {}, 76 topVendors: {}, 77}; 78 79const noSignal = []; 80 81function tally(vendors) { 82 const byCategory = {}; 83 for (const v of vendors) { 84 byCategory[v.category] = (byCategory[v.category] || 0) + 1; 85 stats.byCategory[v.category] = (stats.byCategory[v.category] || 0) + 1; 86 stats.topVendors[v.vendor] = (stats.topVendors[v.vendor] || 0) + 1; 87 } 88 return Object.fromEntries(Object.entries(byCategory).sort((a, b) => b[1] - a[1])); 89} 90 91async function processDomain(domain) { 92 if (budgetExhausted) return; 93 94 let fp; 95 try { 96 fp = await fingerprintDomain(domain, { includePageSignals }); 97 } catch (err) { 98 log.warning(`✗ ${domain} - fingerprint failed: ${err.message}`); 99 noSignal.push({ domain, reason: err.message }); 100 stats.domainsWithNoSignal++; 101 return; 102 } 103 104 let vendors = fp.vendors; 105 if (catFilter.size) vendors = vendors.filter((v) => catFilter.has(v.category)); 106 if (venFilter.length) { 107 vendors = vendors.filter((v) => venFilter.some((needle) => v.vendor.toLowerCase().includes(needle))); 108 } 109 110 // A domain with no DNS answers at all is almost certainly dead or typo'd. 111 if (fp.txtRecordCount === 0 && fp.mxRecords.length === 0 && fp.nameservers.length === 0) { 112 stats.domainsWithNoSignal++; 113 noSignal.push({ domain, reason: 'no DNS records found - domain may not exist or may be parked' }); 114 log.warning(`✗ ${domain} - no DNS records found`); 115 return; 116 } 117 118 stats.domainsProfiled++; 119 stats.vendorsDetected += vendors.length; 120 await charge('domain-analyzed'); 121 122 const byCategory = tally(vendors); 123 const pick = (cat) => vendors.filter((v) => v.category === cat).map((v) => v.vendor); 124 125 const profile = { 126 type: 'domain-profile', 127 domain, 128 siteTitle: fp.site?.title || null, 129 finalUrl: fp.site?.finalUrl || null, 130 siteReachable: fp.site?.reachable ?? null, 131 132 vendorCount: vendors.length, 133 vendors: vendors.map((v) => ({ 134 vendor: v.vendor, 135 category: v.category, 136 categoryLabel: CATEGORY_LABELS[v.category] || v.category, 137 sources: v.sources, 138 evidence: v.evidence, 139 })), 140 vendorNames: vendors.map((v) => v.vendor), 141 byCategory, 142 143 // Flattened high-interest slices, so users can filter without unnesting. 144 aiTools: pick('ai'), 145 securityTools: pick('security'), 146 analyticsTools: pick('analytics'), 147 crmSalesTools: pick('crm-sales'), 148 collaborationTools: pick('collaboration'), 149 devTools: pick('devtools'), 150 151 emailProvider: fp.emailProvider, 152 dnsProvider: fp.dnsProvider, 153 hasSpf: fp.hasSpf, 154 hasDmarc: fp.hasDmarc, 155 dmarcPolicy: fp.dmarcPolicy, 156 157 ...(includeRawDns 158 ? { 159 mxRecords: fp.mxRecords, 160 nameservers: fp.nameservers, 161 spfIncludes: fp.spfIncludes, 162 txtRecordCount: fp.txtRecordCount, 163 unmatchedTxtPrefixes: fp.unmatchedTxtPrefixes, 164 } 165 : {}), 166 167 scrapedAt: new Date().toISOString(), 168 }; 169 170 await Actor.pushData(profile); 171 172 if (outputVendorRows) { 173 const rows = vendors.map((v) => ({ 174 type: 'vendor', 175 domain, 176 vendor: v.vendor, 177 category: v.category, 178 categoryLabel: CATEGORY_LABELS[v.category] || v.category, 179 sources: v.sources, 180 evidence: v.evidence, 181 scrapedAt: profile.scrapedAt, 182 })); 183 if (rows.length) await Actor.pushData(rows); 184 } 185 186 log.info(`✓ ${domain} - ${vendors.length} vendors` 187 + `${profile.aiTools.length ? ` (AI: ${profile.aiTools.join(', ')})` : ''}`); 188} 189 190/* ------------------------------------------------------------------ * 191 * Bounded-concurrency driver 192 * ------------------------------------------------------------------ */ 193 194const queue = [...cleanDomains]; 195const workers = Array.from({ length: Math.max(1, Math.min(concurrency, 25)) }, async () => { 196 while (queue.length && !budgetExhausted) { 197 const domain = queue.shift(); 198 if (domain === undefined) break; 199 await processDomain(domain); 200 } 201}); 202 203await Promise.all(workers); 204 205/* ------------------------------------------------------------------ * 206 * Summary 207 * ------------------------------------------------------------------ */ 208 209const summary = { 210 ...stats, 211 byCategory: Object.fromEntries(Object.entries(stats.byCategory).sort((a, b) => b[1] - a[1])), 212 topVendors: Object.fromEntries(Object.entries(stats.topVendors).sort((a, b) => b[1] - a[1]).slice(0, 40)), 213 domainsWithoutSignal: noSignal, 214 finishedAt: new Date().toISOString(), 215}; 216 217await Actor.setValue('RUN_SUMMARY', summary); 218 219log.info('Done.', { 220 profiled: `${stats.domainsProfiled}/${stats.domainsRequested}`, 221 vendorsDetected: stats.vendorsDetected, 222 avgVendorsPerDomain: stats.domainsProfiled 223 ? Math.round((stats.vendorsDetected / stats.domainsProfiled) * 10) / 10 224 : 0, 225}); 226 227await Actor.exit();

1/** 2 * Vendor knowledge base. 3 * 4 * Fingerprints were sampled from live DNS records across a spread of real 5 * companies rather than invented, so the prefixes match what domains actually 6 * publish. Matching is prefix-based because most vendors append a per-tenant 7 * token ("anthropic-domain-verification-4rt01s"). 8 */ 9 10/** DNS TXT verification-record prefixes -> [vendor, category]. */ 11const TXT_VENDORS = [ 12 // --- AI / LLM tools: the fastest-moving signal in this data set --- 13 ['anthropic-domain-verification', 'Anthropic (Claude)', 'ai'], 14 ['openai-domain-verification', 'OpenAI', 'ai'], 15 ['cursor-domain-verification', 'Cursor', 'ai'], 16 ['perplexity-ai-domain-verification', 'Perplexity', 'ai'], 17 ['elevenlabs', 'ElevenLabs', 'ai'], 18 ['dust-domain-verification', 'Dust', 'ai'], 19 ['gamma-domain-verification', 'Gamma', 'ai'], 20 ['decagon-domain-verification', 'Decagon', 'ai'], 21 ['gc-ai-domain-verification', 'GC AI', 'ai'], 22 ['glean-domain-verification', 'Glean', 'ai'], 23 ['writer-domain-verification', 'Writer', 'ai'], 24 ['sierra-domain-verification', 'Sierra', 'ai'], 25 ['harvey-domain-verification', 'Harvey', 'ai'], 26 ['copy-ai-domain-verification', 'Copy.ai', 'ai'], 27 ['synthesia-domain-verification', 'Synthesia', 'ai'], 28 29 // --- Email hosting & deliverability --- 30 ['google-site-verification', 'Google Workspace', 'email'], 31 ['MS', 'Microsoft 365', 'email'], 32 ['protonmail-verification', 'Proton Mail', 'email'], 33 ['zoho-verification', 'Zoho', 'email'], 34 ['yahoo-verification-key', 'Yahoo', 'email'], 35 ['amazonses', 'Amazon SES', 'email-marketing'], 36 ['mailru-verification', 'Mail.ru', 'email'], 37 38 // --- Marketing, CRM & sales --- 39 ['hubspot-developer-verification', 'HubSpot', 'crm-sales'], 40 ['hubspot-domain-verification', 'HubSpot', 'crm-sales'], 41 ['klaviyo-site-verification', 'Klaviyo', 'email-marketing'], 42 ['drift-domain-verification', 'Drift', 'support'], 43 ['facebook-domain-verification', 'Meta Ads', 'advertising'], 44 ['tiktok-developers-site-verification', 'TikTok', 'advertising'], 45 ['pinterest-site-verification', 'Pinterest', 'advertising'], 46 ['liveramp-site-verification', 'LiveRamp', 'analytics'], 47 ['segment-site-verification', 'Segment', 'analytics'], 48 ['mixpanel-domain-verify', 'Mixpanel', 'analytics'], 49 ['amplitude-domain-verification', 'Amplitude', 'analytics'], 50 ['reachdesk-verification', 'Reachdesk', 'crm-sales'], 51 ['outreach-domain-verification', 'Outreach', 'crm-sales'], 52 53 // --- Collaboration & productivity --- 54 ['atlassian-domain-verification', 'Atlassian', 'collaboration'], 55 ['atlassian-sending-domain-verification', 'Atlassian', 'collaboration'], 56 ['slack-domain-verification', 'Slack', 'collaboration'], 57 ['zoom-domain-verification', 'Zoom', 'collaboration'], 58 ['ZOOM_verify', 'Zoom', 'collaboration'], 59 ['webexdomainverification', 'Cisco Webex', 'collaboration'], 60 ['notion-domain-verification', 'Notion', 'collaboration'], 61 ['airtable-verification', 'Airtable', 'collaboration'], 62 ['miro-verification', 'Miro', 'collaboration'], 63 ['whimsical', 'Whimsical', 'collaboration'], 64 ['canva-site-verification', 'Canva', 'design'], 65 ['figma-domain-verification', 'Figma', 'design'], 66 ['loom-verification', 'Loom', 'collaboration'], 67 ['loom-site-verification', 'Loom', 'collaboration'], 68 ['dropbox-domain-verification', 'Dropbox', 'collaboration'], 69 ['box-domain-verification', 'Box', 'collaboration'], 70 ['smartsheet-site-validation', 'Smartsheet', 'collaboration'], 71 ['monday-com-verification', 'Monday.com', 'collaboration'], 72 ['linear-domain-verification', 'Linear', 'devtools'], 73 ['asana-domain-verification', 'Asana', 'collaboration'], 74 ['lucidlink-verification', 'LucidLink', 'collaboration'], 75 ['wework-site-verification', 'WeWork', 'workplace'], 76 ['parallels-domain-verification', 'Parallels', 'devtools'], 77 ['teamviewer-sso-verification', 'TeamViewer', 'devtools'], 78 ['citrix-verification-code', 'Citrix', 'devtools'], 79 80 // --- Developer & infrastructure --- 81 ['docker-verification', 'Docker', 'devtools'], 82 ['mongodb-site-verification', 'MongoDB', 'devtools'], 83 ['postman-domain-verification', 'Postman', 'devtools'], 84 ['jetbrains-domain-verification', 'JetBrains', 'devtools'], 85 ['gradle-verification', 'Gradle', 'devtools'], 86 ['gitlab-pages-verification-code', 'GitLab', 'devtools'], 87 ['github-domain-verification', 'GitHub', 'devtools'], 88 ['vercel-domain-verification', 'Vercel', 'cloud-hosting'], 89 ['aws-domain-control-verification', 'AWS', 'cloud-hosting'], 90 ['hcp-domain-verification', 'HashiCorp', 'devtools'], 91 ['browserstack-domain-verification', 'BrowserStack', 'devtools'], 92 ['status-page-domain-verification', 'Atlassian Statuspage', 'observability'], 93 ['datadog-domain-verification', 'Datadog', 'observability'], 94 ['_visual-studio-marketplace-datadog', 'Datadog', 'observability'], 95 ['sentry-domain-verification', 'Sentry', 'observability'], 96 ['unity-sso-verification', 'Unity', 'devtools'], 97 ['autodesk-domain-verification', 'Autodesk', 'design'], 98 ['cloudflare_dashboard_sso', 'Cloudflare', 'cdn-dns'], 99 100 // --- Security, identity & compliance --- 101 ['jamf-site-verification', 'Jamf', 'security'], 102 ['wiz-domain-verification', 'Wiz', 'security'], 103 ['h1-domain-verification', 'HackerOne', 'security'], 104 ['bugcrowd-verification', 'Bugcrowd', 'security'], 105 ['1password-site-verification', '1Password', 'security'], 106 ['knowbe4-site-verification', 'KnowBe4', 'security'], 107 ['paloaltonetworks-site-verification', 'Palo Alto Networks', 'security'], 108 ['detectify-verification', 'Detectify', 'security'], 109 ['censys-domain-verification', 'Censys', 'security'], 110 ['datadome-domain-verify', 'DataDome', 'security'], 111 ['have-i-been-pwned-verification', 'Have I Been Pwned', 'security'], 112 ['onetrust-domain-verification', 'OneTrust', 'legal-privacy'], 113 ['_globalsign-domain-verification', 'GlobalSign', 'security'], 114 ['globalsign-domain-verification', 'GlobalSign', 'security'], 115 ['okta-domain-verification', 'Okta', 'identity-sso'], 116 ['duo-domain-verification', 'Cisco Duo', 'identity-sso'], 117 ['probely', 'Probely', 'security'], 118 ['heyhack-verification', 'HeyHack', 'security'], 119 ['cisco-ci-domain-verification', 'Cisco', 'security'], 120 121 // --- Finance, legal & HR --- 122 ['stripe-verification', 'Stripe', 'payments'], 123 ['docusign', 'DocuSign', 'esignature'], 124 ['adobe-idp-site-verification', 'Adobe', 'design'], 125 ['adobe-sign-verification', 'Adobe Sign', 'esignature'], 126 ['twilio-domain-verification', 'Twilio', 'communications'], 127 ['zapier-domain-verification-challenge', 'Zapier', 'automation'], 128 ['shopify-verification-code', 'Shopify', 'ecommerce'], 129 ['rzp-site-verification', 'Razorpay', 'payments'], 130 ['uber-domain-verification', 'Uber for Business', 'workplace'], 131 ['bettercomp-verify', 'BetterComp', 'hr'], 132 ['reejig-platform-domain-verification', 'Reejig', 'hr'], 133 ['fadv-validation', 'First Advantage', 'hr'], 134 ['workday-domain-verification', 'Workday', 'hr'], 135 ['apple-domain-verification', 'Apple Business Manager', 'workplace'], 136 ['mgverify', 'Mailgun', 'email-marketing'], 137 ['CKO', 'Checkout.com', 'payments'], 138 ['ecostruxure-it-verification', 'Schneider EcoStruxure', 'workplace'], 139 ['masv', 'MASV', 'collaboration'], 140 ['neat-pulse-domain-verification', 'Neat Pulse', 'workplace'], 141 ['serval-domain-verification', 'Serval', 'ai'], 142 ['pinnacle-domain-verification', 'Pinnacle', 'workplace'], 143 ['calendly-domain-verification', 'Calendly', 'collaboration'], 144 ['pendo-domain-verification', 'Pendo', 'analytics'], 145 ['snowflake-domain-verification', 'Snowflake', 'devtools'], 146 ['databricks-domain-verification', 'Databricks', 'devtools'], 147 ['ramp-domain-verification', 'Ramp', 'payments'], 148 ['brex-domain-verification', 'Brex', 'payments'], 149 ['navan-domain-verification', 'Navan', 'workplace'], 150 ['rippling-domain-verification', 'Rippling', 'hr'], 151 ['gusto-domain-verification', 'Gusto', 'hr'], 152 ['deel-domain-verification', 'Deel', 'hr'], 153 ['greenhouse-domain-verification', 'Greenhouse', 'hr'], 154 ['lattice-domain-verification', 'Lattice', 'hr'], 155]; 156 157/** SPF include: hosts -> [vendor, category]. Reveals who sends mail for them. */ 158const SPF_VENDORS = [ 159 ['_spf.google.com', 'Google Workspace', 'email'], 160 ['spf.protection.outlook.com', 'Microsoft 365', 'email'], 161 ['mail.zendesk.com', 'Zendesk', 'support'], 162 ['_spf.salesforce.com', 'Salesforce', 'crm-sales'], 163 ['amazonses.com', 'Amazon SES', 'email-marketing'], 164 ['mktomail.com', 'Marketo', 'email-marketing'], 165 ['sendgrid.net', 'SendGrid', 'email-marketing'], 166 ['servers.mcsv.net', 'Mailchimp', 'email-marketing'], 167 ['mailgun.org', 'Mailgun', 'email-marketing'], 168 ['spf.mandrillapp.com', 'Mailchimp Transactional', 'email-marketing'], 169 ['mg-spf.greenhouse.io', 'Greenhouse', 'hr'], 170 ['_spf.atlassian.net', 'Atlassian', 'collaboration'], 171 ['stspg-customer.com', 'Atlassian Statuspage', 'observability'], 172 ['spf.mailjet.com', 'Mailjet', 'email-marketing'], 173 ['_spf.hubspot.com', 'HubSpot', 'crm-sales'], 174 ['spf.mtasv.net', 'Postmark', 'email-marketing'], 175 ['helpscoutemail.com', 'Help Scout', 'support'], 176 ['_spf.intercom.io', 'Intercom', 'support'], 177 ['pardot.com', 'Salesforce Pardot', 'email-marketing'], 178 ['spf.qualtrics.com', 'Qualtrics', 'analytics'], 179 ['_spf.workday.com', 'Workday', 'hr'], 180 ['spf.klaviyo.com', 'Klaviyo', 'email-marketing'], 181 ['customeriomail.com', 'Customer.io', 'email-marketing'], 182 ['spf.braze.com', 'Braze', 'email-marketing'], 183 ['_spf.lever.co', 'Lever', 'hr'], 184 ['_spf.ashbyhq.com', 'Ashby', 'hr'], 185]; 186 187/** MX host substrings -> email provider. */ 188const MX_VENDORS = [ 189 ['aspmx.l.google.com', 'Google Workspace'], 190 ['l.google.com', 'Google Workspace'], 191 ['googlemail.com', 'Google Workspace'], 192 ['outlook.com', 'Microsoft 365'], 193 ['protection.outlook.com', 'Microsoft 365'], 194 ['pphosted.com', 'Proofpoint'], 195 ['ppe-hosted.com', 'Proofpoint'], 196 ['mimecast.com', 'Mimecast'], 197 ['cf-emailsecurity.net', 'Cloudflare Email Security'], 198 ['zoho.com', 'Zoho Mail'], 199 ['zohomail', 'Zoho Mail'], 200 ['protonmail.ch', 'Proton Mail'], 201 ['messagingengine.com', 'Fastmail'], 202 ['barracudanetworks.com', 'Barracuda'], 203 ['mailgun.org', 'Mailgun'], 204 ['improvmx.com', 'ImprovMX'], 205 ['forwardemail.net', 'Forward Email'], 206]; 207 208/** Nameserver substrings -> DNS provider. */ 209const NS_VENDORS = [ 210 ['cloudflare.com', 'Cloudflare'], 211 ['awsdns', 'AWS Route 53'], 212 ['azure-dns', 'Azure DNS'], 213 ['nsone.net', 'NS1'], 214 ['dnsimple.com', 'DNSimple'], 215 ['googledomains.com', 'Google Domains'], 216 ['ultradns', 'UltraDNS'], 217 ['akam.net', 'Akamai'], 218 ['dynect.net', 'Oracle Dyn'], 219 ['name-services.com', 'Enom'], 220 ['domaincontrol.com', 'GoDaddy'], 221 ['registrar-servers.com', 'Namecheap'], 222 ['vercel-dns.com', 'Vercel'], 223 ['netlify.com', 'Netlify'], 224]; 225 226/** HTTP response header signals -> [vendor, category]. */ 227const HEADER_VENDORS = [ 228 ['cf-ray', 'Cloudflare', 'cdn-dns'], 229 ['x-vercel-id', 'Vercel', 'cloud-hosting'], 230 ['x-nf-request-id', 'Netlify', 'cloud-hosting'], 231 ['x-amz-cf-id', 'AWS CloudFront', 'cdn-dns'], 232 ['x-served-by', 'Fastly', 'cdn-dns'], 233 ['x-github-request-id', 'GitHub Pages', 'cloud-hosting'], 234 ['x-shopify-stage', 'Shopify', 'ecommerce'], 235 ['x-drupal-cache', 'Drupal', 'cms'], 236 ['x-generator', null, 'cms'], 237 ['x-wix-request-id', 'Wix', 'cms'], 238 ['x-hs-hub-id', 'HubSpot CMS', 'cms'], 239]; 240 241/** Substrings found in homepage HTML -> [vendor, category]. */ 242const HTML_VENDORS = [ 243 ['googletagmanager.com', 'Google Tag Manager', 'analytics'], 244 ['google-analytics.com', 'Google Analytics', 'analytics'], 245 ['cdn.segment.com', 'Segment', 'analytics'], 246 ['cdn.mxpnl.com', 'Mixpanel', 'analytics'], 247 ['static.hotjar.com', 'Hotjar', 'analytics'], 248 ['cdn.amplitude.com', 'Amplitude', 'analytics'], 249 ['plausible.io', 'Plausible', 'analytics'], 250 ['posthog.com', 'PostHog', 'analytics'], 251 ['widget.intercom.io', 'Intercom', 'support'], 252 ['js.driftt.com', 'Drift', 'support'], 253 ['static.zdassets.com', 'Zendesk', 'support'], 254 ['embed.tawk.to', 'Tawk.to', 'support'], 255 ['js.hs-scripts.com', 'HubSpot', 'crm-sales'], 256 ['js.hsforms.net', 'HubSpot', 'crm-sales'], 257 ['snap.licdn.com', 'LinkedIn Insight', 'advertising'], 258 ['connect.facebook.net', 'Meta Pixel', 'advertising'], 259 ['analytics.tiktok.com', 'TikTok Pixel', 'advertising'], 260 ['cdn.shopify.com', 'Shopify', 'ecommerce'], 261 ['wp-content', 'WordPress', 'cms'], 262 ['wp-includes', 'WordPress', 'cms'], 263 ['assets.squarespace.com', 'Squarespace', 'cms'], 264 ['cdn.sanity.io', 'Sanity', 'cms'], 265 ['webflow.com', 'Webflow', 'cms'], 266 ['contentful.com', 'Contentful', 'cms'], 267 ['js.stripe.com', 'Stripe', 'payments'], 268 ['paypal.com/sdk', 'PayPal', 'payments'], 269 ['checkout.com', 'Checkout.com', 'payments'], 270 ['browser.sentry-cdn.com', 'Sentry', 'observability'], 271 ['datadoghq-browser-agent', 'Datadog RUM', 'observability'], 272 ['cookiebot.com', 'Cookiebot', 'legal-privacy'], 273 ['cdn.cookielaw.org', 'OneTrust', 'legal-privacy'], 274 ['usercentrics.eu', 'Usercentrics', 'legal-privacy'], 275 ['_next/static', 'Next.js', 'framework'], 276 ['__NUXT__', 'Nuxt', 'framework'], 277 ['data-svelte', 'Svelte', 'framework'], 278 ['ng-version', 'Angular', 'framework'], 279 ['gatsby-', 'Gatsby', 'framework'], 280]; 281 282const CATEGORY_LABELS = { 283 ai: 'AI & LLM tools', 284 email: 'Email hosting', 285 'email-marketing': 'Email & marketing delivery', 286 'crm-sales': 'CRM & sales', 287 support: 'Customer support', 288 analytics: 'Analytics', 289 advertising: 'Advertising & pixels', 290 security: 'Security', 291 'identity-sso': 'Identity & SSO', 292 collaboration: 'Collaboration', 293 devtools: 'Developer tools', 294 observability: 'Observability', 295 'cloud-hosting': 'Cloud & hosting', 296 'cdn-dns': 'CDN & DNS', 297 payments: 'Payments', 298 hr: 'HR & recruiting', 299 esignature: 'E-signature', 300 design: 'Design', 301 ecommerce: 'E-commerce', 302 cms: 'CMS', 303 framework: 'Web framework', 304 automation: 'Automation', 305 communications: 'Communications', 306 'legal-privacy': 'Legal & privacy', 307 workplace: 'Workplace', 308}; 309 310/** 311 * Match a TXT record against the vendor table. 312 * Longest prefix wins so "atlassian-sending-domain-verification" is not 313 * swallowed by a shorter, more generic entry. 314 */ 315function matchTxt(record) { 316 const value = String(record || '').trim(); 317 let best = null; 318 for (const [prefix, vendor, category] of TXT_VENDORS) { 319 if (value.toLowerCase().startsWith(prefix.toLowerCase()) 320 // Guard bare tokens like "MS=" from matching "MSFT-something" 321 && (value.length === prefix.length || /[=:\-_.]/.test(value[prefix.length] || ''))) { 322 if (!best || prefix.length > best.prefix.length) best = { prefix, vendor, category }; 323 } 324 } 325 return best ? { vendor: best.vendor, category: best.category } : null; 326} 327 328export { 329 TXT_VENDORS, SPF_VENDORS, MX_VENDORS, NS_VENDORS, 330 HEADER_VENDORS, HTML_VENDORS, CATEGORY_LABELS, matchTxt, 331};

1/** 2 * Smoke tests - run with `npm test`. 3 * Live DNS lookups are intentional: the value of this Actor is that those 4 * public records keep resolving, so mocking them would test nothing. 5 */ 6 7import assert from 'node:assert/strict'; 8 9import { matchTxt, TXT_VENDORS, CATEGORY_LABELS } from '../src/vendors.js'; 10import { normalizeDomain, dnsQuery, fingerprintDomain } from '../src/fingerprint.js'; 11 12let passed = 0; 13let failed = 0; 14 15async function test(name, fn) { 16 try { 17 await fn(); 18 console.log(` ok ${name}`); 19 passed++; 20 } catch (err) { 21 console.error(` FAIL ${name}\n ${err.message}`); 22 failed++; 23 } 24} 25 26console.log('\n-- pure helpers --'); 27 28await test('normalizeDomain strips scheme, www, path', () => { 29 assert.equal(normalizeDomain('https://www.Figma.com/about?x=1'), 'figma.com'); 30 assert.equal(normalizeDomain('monzo.com'), 'monzo.com'); 31 assert.equal(normalizeDomain('not a domain'), null); 32 assert.equal(normalizeDomain('localhost'), null); 33 assert.equal(normalizeDomain(''), null); 34}); 35 36await test('matchTxt identifies vendors from tokenised records', () => { 37 assert.equal(matchTxt('anthropic-domain-verification-4rt01s=abc').vendor, 'Anthropic (Claude)'); 38 assert.equal(matchTxt('openai-domain-verification=dv-XYZ').vendor, 'OpenAI'); 39 assert.equal(matchTxt('cursor-domain-verification-x97aw0=q').vendor, 'Cursor'); 40 assert.equal(matchTxt('stripe-verification=abc').category, 'payments'); 41 assert.equal(matchTxt('jamf-site-verification=abc').category, 'security'); 42}); 43 44await test('matchTxt prefers the longest matching prefix', () => { 45 const hit = matchTxt('atlassian-sending-domain-verification=abc'); 46 assert.equal(hit.vendor, 'Atlassian'); 47 assert.equal(matchTxt('google-site-verification=abc').vendor, 'Google Workspace'); 48}); 49 50await test('matchTxt ignores unrelated records', () => { 51 assert.equal(matchTxt('some-random-string-with-no-vendor'), null); 52 assert.equal(matchTxt(''), null); 53}); 54 55await test('every vendor category has a human label', () => { 56 for (const [, vendor, category] of TXT_VENDORS) { 57 assert.ok(CATEGORY_LABELS[category], `missing label for "${category}" (${vendor})`); 58 } 59}); 60 61console.log('\n-- live DNS --'); 62 63await test('dnsQuery returns TXT records for a real domain', async () => { 64 const txt = await dnsQuery('figma.com', 'TXT'); 65 assert.ok(txt.length > 5, `expected several TXT records, got ${txt.length}`); 66}); 67 68await test('dnsQuery returns [] for a nonexistent domain', async () => { 69 const txt = await dnsQuery('this-domain-should-not-exist-abc123xyz.com', 'TXT'); 70 assert.deepEqual(txt, []); 71}); 72 73console.log('\n-- end-to-end fingerprinting --'); 74 75await test('fingerprintDomain detects AI vendors and email provider', async () => { 76 const fp = await fingerprintDomain('figma.com', { includePageSignals: false }); 77 assert.ok(fp.vendors.length >= 10, `expected 10+ vendors, got ${fp.vendors.length}`); 78 assert.equal(fp.emailProvider, 'Google Workspace'); 79 const ai = fp.vendors.filter((v) => v.category === 'ai').map((v) => v.vendor); 80 assert.ok(ai.includes('Anthropic (Claude)'), `AI vendors found: ${ai.join(', ')}`); 81 assert.ok(fp.hasSpf, 'expected an SPF record'); 82}); 83 84await test('every detected vendor carries category, source and evidence', async () => { 85 const fp = await fingerprintDomain('gitlab.com', { includePageSignals: false }); 86 for (const v of fp.vendors) { 87 assert.ok(v.vendor, 'vendor name missing'); 88 assert.ok(v.category, `category missing for ${v.vendor}`); 89 assert.ok(Array.isArray(v.sources) && v.sources.length, `sources missing for ${v.vendor}`); 90 assert.ok(CATEGORY_LABELS[v.category], `unknown category "${v.category}"`); 91 } 92}); 93 94await test('page signals add web-layer vendors', async () => { 95 const withPage = await fingerprintDomain('gitlab.com', { includePageSignals: true }); 96 const dnsOnly = await fingerprintDomain('gitlab.com', { includePageSignals: false }); 97 assert.ok(withPage.vendors.length >= dnsOnly.vendors.length, 98 `page signals should not reduce detections (${withPage.vendors.length} vs ${dnsOnly.vendors.length})`); 99 assert.equal(withPage.site.reachable, true); 100}); 101 102await test('protocol records never leak into unmatched TXT prefixes', async () => { 103 const fp = await fingerprintDomain('figma.com', { includePageSignals: false }); 104 for (const p of fp.unmatchedTxtPrefixes) { 105 assert.notEqual(p.toLowerCase(), 'v', 'a "v=" protocol record leaked through'); 106 } 107}); 108 109await test('a domain with no DNS records yields no vendors', async () => { 110 const fp = await fingerprintDomain('this-domain-should-not-exist-abc123xyz.com', { includePageSignals: false }); 111 assert.equal(fp.vendors.length, 0); 112 assert.equal(fp.txtRecordCount, 0); 113}); 114 115console.log(`\n${passed} passed, ${failed} failed\n`); 116process.exit(failed > 0 ? 1 : 0);

Tech Stack Lookup - Company Vendor & SaaS Detection API

Tech Stack · M365 & Google Workspace

Company Enrichment API - Domain to Firmographics, Tech & Email

Website Tech Stack & Contact Scraper

Welcome to the Jungle Scraper: WTJ Tech Jobs FR/EU + Salaries

Glassdoor Jobs Scraper for Hiring Research

Auto Repair Shop Lead Finder - Tekmetric, Mitchell 1

Childcare & Daycare Lead Finder - Brightwheel, Procare

Funeral Home Lead Finder - Tribute, Frazer, Passare

Tech Stack Detector API - BuiltWith & Wappalyzer Alternative

Job Posting Lead Finder | $3/1K | Lead Score, Hiring Signal

.dockerignore

.gitignore

package.json

PUBLISH.md

.actor/actor.json

.actor/dataset_schema.json

.actor/Dockerfile

.actor/input_schema.json

.actor/output_schema.json

src/fingerprint.js

src/main.js

src/vendors.js

test/smoke.js

Tech Stack Lookup - Company Vendor & SaaS Detection API

You might also like

Tech Stack · M365 & Google Workspace

Company Enrichment API - Domain to Firmographics, Tech & Email

Website Tech Stack & Contact Scraper

Welcome to the Jungle Scraper: WTJ Tech Jobs FR/EU + Salaries

Glassdoor Jobs Scraper for Hiring Research

Auto Repair Shop Lead Finder - Tekmetric, Mitchell 1

Childcare & Daycare Lead Finder - Brightwheel, Procare

Funeral Home Lead Finder - Tribute, Frazer, Passare

Tech Stack Detector API - BuiltWith & Wappalyzer Alternative

Job Posting Lead Finder | $3/1K | Lead Score, Hiring Signal

.dockerignore

.gitignore

package.json

PUBLISH.md

.actor/actor.json

.actor/dataset_schema.json

.actor/Dockerfile

.actor/input_schema.json

.actor/output_schema.json

src/fingerprint.js

src/main.js

src/vendors.js

test/smoke.js