Website Technology Detector

Detect the technology stack behind any website — CMS, frameworks, analytics, payment providers, chat widgets, CDN, hosting, and JavaScript libraries.

Built with TypeScript, Crawlee, and Cheerio, this Actor uses Wappalyzer-style signature matching against HTML content, HTTP headers, script tags, and meta tags.

Features

• 70+ built-in signatures for common technologies (WordPress, Shopify, React, Next.js, Google Analytics, Stripe, Intercom, Cloudflare, Vercel, and more)
• Structured JSON output per URL with categorized results
• Retries, rate limiting, and session pool to reduce blocking
• Proxy support via Apify Proxy (datacenter and residential)
• Aggregated JSON report saved to key-value store (REPORT)
• Pay-per-result pricing at $0.003 per scanned URL

Input

Field	Type	Default	Description
urls	string[]	—	Website URLs to scan (required)
maxConcurrency	integer	5	Parallel scans
maxRequestsPerMinute	integer	60	Rate limit
maxRequestRetries	integer	3	Retry count for failed requests
requestHandlerTimeoutSecs	integer	60	Per-URL timeout
proxyConfiguration	object	Apify Proxy on	Proxy settings
useResidentialProxy	boolean	false	Enable residential proxy group

Example input

{
  "urls": [
    "https://wordpress.org",
    "https://react.dev",
    "https://www.shopify.com"
  ],
  "maxConcurrency": 5,
  "maxRequestsPerMinute": 60,
  "maxRequestRetries": 3
}

More examples are in the ./examples folder.

Output

Each dataset item contains:

{
  "url": "https://wordpress.org",
  "cms": "WordPress",
  "framework": null,
  "analytics": ["Google Analytics", "Google Tag Manager"],
  "paymentProviders": [],
  "chatWidgets": [],
  "cdn": "Cloudflare",
  "hosting": null,
  "jsFrameworks": ["jQuery"],
  "detectedTechnologies": ["Cloudflare", "Google Analytics", "Google Tag Manager", "PHP", "WordPress", "jQuery"],
  "statusCode": 200,
  "scannedAt": "2026-07-05T12:00:00.000Z"
}

A full run report is also stored at REPORT in the default key-value store.

Detected categories

Category	Examples
CMS	WordPress, Shopify, Drupal, Wix, Webflow
Framework	Next.js, Nuxt.js, Laravel, Django, ASP.NET
Analytics	Google Analytics, GTM, Hotjar, Segment, Facebook Pixel
Payment providers	Stripe, PayPal, Square, Klarna
Chat widgets	Intercom, Drift, Zendesk, Crisp, Tawk.to
CDN	Cloudflare, Fastly, Akamai, CloudFront
Hosting	AWS, Vercel, Netlify, Azure, WP Engine
JS frameworks	React, Vue.js, Angular, jQuery, Svelte

Local development

npm install
apify run

Run tests:

$npm test

Build for production:

$npm run build

Deploy to Apify

apify login
apify push

Pricing

• $0.003 per result (one scanned URL)
• Failed URLs that return an error record are also charged as a result event

How it works

1. The Actor receives a list of URLs.
2. CheerioCrawler fetches each page (with retries, rate limiting, and optional proxy).
3. HTML, headers, scripts, and meta tags are matched against the built-in signature database.
4. Detected technologies are categorized and saved to the dataset.
5. A consolidated JSON report is written to the key-value store.

Use cases

• Sales prospecting and lead enrichment
• Competitive intelligence
• Security and compliance audits
• Migration planning (CMS/framework discovery)
• Market research across website portfolios

Limitations

• Detection is based on static page analysis (no browser rendering)
• Some client-side-only technologies may not be detected
• Heavily protected sites may require residential proxies

License

ISC