Website Intelligence Analyzer (OSINT)

Get a complete intelligence profile of any website in one run — 30 checks, 38 structured output fields, no API keys required.

---

Features

Category	Checks
Domain	WHOIS, registrar, age, expiry, nameservers
DNS	A/AAAA/MX/NS/CNAME/TXT/SOA/CAA, DNSSEC, DoH support, cache poisoning check
SSL/TLS	Certificate chain, cipher suites, protocol assessment, 5-client handshake simulation
Security	HTTP security headers, full raw headers, WAF detection, open ports, HSTS preload, security.txt, 17 DNS blocklists
Email	SPF, DKIM (7 selectors), DMARC, BIMI, MX records
Tech Stack	CMS, frameworks, analytics, CDN — 40+ signatures
SEO & Content	robots.txt, sitemap, Open Graph/Twitter Cards, internal/external links, redirect chain
Reputation	Global Tranco ranking, URLHaus + PhishTank threat checks
Server	IP geolocation, ASN, hosting provider, traceroute
Extras	Cookies, site features (PWA/WebSocket/Canvas/WebRTC), quality metrics

---

How to Use

Input

Paste one or more URLs in any format — example.com, https://www.example.com, or full URLs with paths. The actor normalizes everything automatically. Separate multiple URLs with commas, semicolons, or newlines. Optionally configure a residential proxy to avoid rate limits on large batches.

Output

Results are available as JSON, CSV, or Excel from the Apify console. Each URL takes 30–90 seconds and produces one dataset row with the following fields:

Field	Type	Description
url	string	Input URL
finalUrl	string	URL after redirects
ip	string	Resolved IP
domain	string	Domain name
serverStatus	object	Status code, response time, online/offline
whois	object	Registrar, dates, nameservers
domainInfo	object	Age in days, TLD
serverInfo	object	Server software, ASN, hosting provider
serverLocation	object	Country, city, lat/lng, timezone, ISP
dnsRecords	object	A, AAAA, MX, NS, CNAME, TXT, SOA, CAA
txtRecords	array	Raw TXT records
dnsServer	object	Resolver IPs, DoH support, cache poisoning check
dnssec	object	DNSSEC enabled/disabled
sslCert	object	Issuer, validity, protocol, chain
tlsCipherSuites	array	Cipher suites
tlsSecurityConfig	object	modern / intermediate / outdated
tlsHandshakeSimulation	array	5-client compatibility results
securityHeaders	object	CSP, HSTS, X-Frame-Options, etc.
hsts	object	Enabled, preloaded, max-age, includeSubDomains
securityTxt	object	Contact, policy, expiry
firewall	object	WAF detected, provider
malwarePhishing	object	URLHaus + PhishTank threat checks
blockLists	object	Status across 17 DNS blocklists
openPorts	array	Port, protocol, service, state
traceroute	array	Hop, IP, latency
associatedHosts	array	Reverse DNS hostnames
emailConfig	object	SPF, DKIM, DMARC, BIMI, MX
techStack	array	Technology, category, confidence
siteFeatures	object	PWA, AMP, WebSocket, WebGL, Canvas, WebRTC, iframe
cookies	array	Name, domain, path, flags, expiry
crawlRules	string	robots.txt content
sitemapUrls	array	URLs from sitemap.xml
socialTags	object	Open Graph, Twitter Card
linkedPages	object	Internal/external links and counts
redirectChain	array	Each redirect hop
rawHeaders	object	Full raw HTTP response headers
globalRank	number	Tranco ranking
qualityMetrics	object	Viewport, charset, title, H1, page size
checkedAt	string	ISO 8601 timestamp
checksCompleted	array	Modules that succeeded
checksFailed	array	Modules that errored or timed out
runDurationMs	number	Total runtime

API

This actor can also be called via the Apify API for programmatic access — pass your URLs as input and retrieve structured JSON results.

Example Input

{
    "proxyConfiguration": {
        "useApifyProxy": true,
        "apifyProxyGroups": [
            "RESIDENTIAL"
        ]
    },
    "urls": [
        "https://example.com"
    ]
}

---

Limitations

• WHOIS privacy — some domains hide registration details behind privacy protection.
• Open ports & traceroute — require nmap and traceroute in the Docker image (included). Results depend on network conditions.
• Quality metrics — basic HTML-based assessment only; full Lighthouse scores would require a Google Cloud API key.
• Tech stack — signature-based fingerprinting with 40+ patterns. For deeper detection, the full Wappalyzer engine would be needed.

---

Credits & Licenses

Based on Lissy93/web-check (MIT © Alicia Sykes 2023). Adapted by One Scales Inc.

External APIs used (no keys required): ip-api.com · hstspreload.org · tranco-list.eu · dns.google · urlhaus-api.abuse.ch · checkurl.phishtank.com

System tools in Docker: nmap · traceroute · whois · dnsutils (dig)

---

Support

Contact Support — feature requests and custom integrations welcome.

Built with care by One Scales Inc.

osint website-analysis dns ssl whois tech-stack security-headers email-security seo web-check reconnaissance domain-intelligence open-ports waf-detection certificate traceroute hsts dmarc spf dkim phishtank blocklists