Website Technology Lookup: CMS, Framework and Hosting Detector avatar

Website Technology Lookup: CMS, Framework and Hosting Detector

Pricing

Pay per usage

Go to Apify Store
Website Technology Lookup: CMS, Framework and Hosting Detector

Website Technology Lookup: CMS, Framework and Hosting Detector

Find which CMS, ecommerce platform, JavaScript framework, analytics, CDN and hosting a website uses. One polite HTTP request per URL, with evidence for each finding. Accepts URLs or bare domains; works from the API and AI agents (MCP). Honours robots.txt; blocked sites are reported, not bypassed.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Madrasco

Madrasco

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

6 hours ago

Last modified

Share

Website Tech Stack Detector

Give it a list of website URLs; get back the technologies each site visibly uses: CMS, ecommerce platform, JavaScript frameworks and libraries, analytics and tag managers, CDN, hosting, web server, payment and chat widgets, and more — with the evidence for each finding.

What it does

For each URL you give, the actor makes one ordinary HTTP request to that page (after reading the site's robots.txt once; redirects are followed) and looks at:

  • response headers (for example Server, X-Powered-By, CDN headers)
  • cookie names set by the page (values are discarded immediately and never stored)
  • <meta name="generator"> and similar meta tags
  • <script src> and <link href> URLs
  • characteristic patterns in the HTML

It matches these against about 170 hand-written signatures and reports each technology with its category, version (when the page states it) and what matched.

What it does not do

  • No browser. JavaScript is not executed, so technologies that are only loaded later by scripts, or only appear after login or consent, are not seen.
  • No bypassing of blocks. If a site answers with a recognised bot challenge or refusal — HTTP 403 or 429, HTTP 401 or 503 with a known challenge page, or Cloudflare's challenge header — the URL is reported as blocked (with any facts visible in the response headers, e.g. the CDN) and is not retried through proxies or other tricks. It will stay free when per-website pricing is introduced (see Pricing). A challenge page that is served with HTTP 200 and no challenge header may not be recognised; it is then counted as analysed (and, once per-website pricing is introduced, charged), usually with few or no technologies found.
  • robots.txt is honoured by default, including for the target of a redirect (a redirect to another site is checked against that site's robots.txt). Disallowed pages are reported as disallowed-by-robots and not fetched. A Crawl-delay in robots.txt is respected between requests to the same site (waits are capped at 10 seconds). You can switch robots.txt handling off only for sites you own or have permission to test.
  • No crawling. Only the URLs you list (and any redirects they answer with) are fetched, at most one request at a time per host.
  • It is not a security scanner and does not probe for vulnerabilities.
  • Detection is passive and can miss technologies that leave no trace in the first HTML response (for example a Laravel or Django site whose home page sets no framework cookie and has no form). It can also be fooled by sites that deliberately mimic or hide markers.

Accuracy (measured by us, September 2026)

These figures apply only to this version of the detector (the one described under "Changes in this version"); earlier or later versions can score differently.

We tested this version on 197 websites we had never tuned on: 150 randomly sampled from the Tranco top-sites list (popular, mid-ranked and long-tail sites) and 47 from vendor showcase pages. We left out sites that block bots, fail to load or disallow crawling in robots.txt. Reference labels came from separate blind AI labelling passes (the labellers could not see the detector or each other's labels) over a full browser load of each home page. Every label cites evidence a script re-checked. Where the passes disagreed, a third AI pass decided. The labels were not reviewed by a person. We ran this version's detector on saved copies of each home page's first response, captured with a browser on 25–26 September 2026, not on live actor runs. A site may answer the actor's own request differently.

  • For the six categories we scored (CMS, e-commerce, framework, analytics, CDN, hosting), when the actor reported a technology it matched the reference labels 96% of the time (707 of 736; 95% interval 94–97%). Other things it reports (web servers, languages, fonts, payments and so on) were not scored.
  • Of the technologies visible without running JavaScript (the home page's first response headers, cookies and HTML, or its DNS records; the actor doesn't read DNS records, so those count as misses), it found 72% (646 of 891). Counting everything a full browser load reveals, including tags loaded later by JavaScript, it found 56% (707 of 1262). The actor makes one plain request and does not run JavaScript, so it misses those.
  • By category (correct when reported / found of those visible without JavaScript): CMS 96% / 79%, framework 99% / 91%, CDN 99% / 80%, analytics 92% / 62%, hosting 92% / 62%, e-commerce 100% / 71% (only 18 e-commerce labels, so treat that one loosely; hosting could be decided on only 89 of the 197 sites).
  • Developer test set: 31 saved page snapshots (headers + HTML, including decoy pages that mention products in plain text) with hand-assigned labels: precision 1.00, recall 1.00 over 141 labels. These snapshots were written by the same developer as the signatures, so treat this as an upper bound, not a promise.

Results on your sites will differ. Treat a missing technology as "not seen", not "not used", and check important results by hand.

Changes in this version

  • assets.adobedtm.com is now reported as Adobe Launch (tag manager), not Adobe Analytics; Adobe Analytics is reported only from its own AppMeasurement script.
  • New: HubSpot Analytics (the HubSpot tracking script and cookies).
  • preconnect and dns-prefetch links no longer count as evidence, so, for example, Google Fonts isn't reported from a preconnect link alone.
  • WordPress is no longer detected from /wp-content/uploads/ links alone (those often point to media on another WordPress site).
  • The HTML scan limit rose from 1 million to 4 million characters, so tags near the end of very large pages are seen.
  • 20 new signatures in all (173 in total), mostly analytics tools, hosting providers and public library CDNs.

Input

FieldDefaultMeaning
urls—Up to 1,000 URLs (bare domains are fetched over HTTPS).
startUrls, domains, websites, url—Other names for the same thing, for API callers and AI agents: startUrls takes Apify's request-list format ([{"url": "..."}]) or plain strings, url takes one string. All given URL fields are merged and duplicates removed.
respectRobotsTxttrueSkip pages disallowed by robots.txt.
timeoutSecs20Give up on a page after this many seconds.
maxConcurrency10Different sites fetched in parallel (never more than one request at a time per host).
includeEvidencetrueInclude what matched for each technology.

Use with AI agents

The only input the actor needs is a list of websites. Any of the field names above works, so an agent that guesses startUrls or url still gets results; if no URL is given, the run fails with a message naming the accepted fields.

  • Apify MCP server: add https://mcp.apify.com?tools=madrasco/website-tech-stack-detector to your MCP client (Claude, Cursor and others; see Apify's MCP docs). The agent then has a tool for this actor and calls it with, for example, {"urls": ["example.com", "https://shop.example.org"]}.
  • HTTP API, one call: POST https://api.apify.com/v2/acts/madrasco~website-tech-stack-detector/run-sync-get-dataset-items with your Apify token in the Authorization: Bearer header and a JSON body such as {"urls": ["example.com"]} returns the dataset rows (one per URL) when the run finishes. For long lists, start a normal run and read the dataset afterwards.

Each row carries status, so an agent can tell "no technologies found" apart from blocked, disallowed-by-robots and error.

Output (one dataset row per URL)

Real output for https://wordpress.org/ (run by us on 2026-09-24), shortened: 3 of the 7 technologies found are shown, the long evidence list for WordPress is cut to two entries, and categories lists only the shown technologies.

{
"url": "https://wordpress.org/",
"finalUrl": "https://wordpress.org/",
"httpStatus": 200,
"status": "ok",
"error": null,
"technologies": [
{"name": "Nginx", "categories": ["Web servers", "Reverse proxies"], "version": null,
"evidence": ["header: server: nginx"], "confidence": "direct"},
{"name": "PHP", "categories": ["Programming languages"], "version": null,
"evidence": ["implied by WordPress"], "confidence": "implied"},
{"name": "WordPress", "categories": ["CMS", "Blogs"], "version": "7.2",
"evidence": ["meta: generator=WordPress 7.2-alpha-63914", "html: /wp-content/plugins/"],
"confidence": "direct"}
],
"categories": {"Web servers": ["Nginx"], "Reverse proxies": ["Nginx"],
"Programming languages": ["PHP"], "CMS": ["WordPress"], "Blogs": ["WordPress"]},
"techCount": 7,
"fetchedAt": "2026-09-24T14:40:15+00:00"
}

status is one of ok, blocked, disallowed-by-robots, error (DNS failure, timeout, HTTP 4xx/5xx), or skipped (only once per-website pricing is introduced: your run's maximum charge was reached before this URL was processed; every URL you give still gets a row). confidence is direct (a marker matched) or implied (inferred from another technology, e.g. WordPress implies PHP).

Pricing

Now: no charge from us. You pay only Apify's platform usage for your runs (shown as "pay per usage" on Apify), which is small for this actor: it runs at 256 MB memory with no browser and no proxies, and our own 5-URL test run on 2026-09-24 used about US$0.0002 of platform usage. Your cost depends on how many URLs you give and how quickly the sites answer.

Later: we intend to introduce pay-per-event pricing of about US$0.01 per website analysed (status ok), with blocked, disallowed, failed and skipped URLs free. Apify notifies the actor's users of such a change and applies its notice period before the new price takes effect (currently 14 days for price increases and pricing-model changes on an actor that has paying users). Once that pricing is active, if you set a maximum charge per run, the actor stops starting new URLs when it is reached, returns the remaining URLs as free skipped rows, and says so in the run's OUTPUT record.

Privacy

The actor fetches public pages you name. It stores no cookie values, no full page content and no personal data; the output describes software used by websites. When includeEvidence is on (the default), the evidence field keeps short matched snippets of response headers and HTML (for example a Server header value, a script URL or a meta tag) so you can check each finding; switch includeEvidence off to omit them. The user agent identifies the actor: TechStackDetector/0.1 (website technology lookup; one request per page; honours robots.txt).

Support

Questions and bug reports: open an issue in the Issues tab on this actor's page. We aim to respond within 14 days. Replies are written with AI assistance; a human owner can be reached on request.

About

Published by Madrasco and built and maintained with AI assistance. The signatures are our own work; no third-party fingerprint database is bundled. Product names are trademarks of their owners and are used only to identify the technologies detected.