Domain Scraper — WHOIS, DNS, Expiry & Availability

Bulk domain lookup that returns something you can act on, not a wall of raw WHOIS text.

For every domain: who registers it, when it expires, whether it's locked, and — from live DNS — which mail provider and DNS provider it actually runs on, plus SPF/DMARC status.

Built on RDAP (the IETF's official WHOIS replacement, RFC 9083) and DNS-over-HTTPS. No key, no login.

What you get

Field	Example
domain, isRegistered, isAvailable	stripe.com, true, false
registrar	SafeNames Ltd.
registeredAt, expiresAt, updatedAt
daysUntilExpiry	410
ageYears	30.9
mailProvider	google · microsoft-365 · zoho · proton …
dnsProvider	cloudflare · aws-route53 · azure · vercel …
hasSPF, hasDMARC, dmarcPolicy	true, true, reject
isLocked, dnssec, statusCodes	true, true
nameservers, dnsA, dnsMX, dnsNS, dnsTXT, dnsCAA
verificationTokens	the *-site-verification TXT records

Example input

{
  "domains": ["github.com", "stripe.com", "https://openai.com/about"],
  "includeDns": true,
  "recordTypes": ["A", "MX", "NS", "TXT"],
  "includeEmailSecurity": true
}

Full URLs and email addresses are accepted — https://example.com/pricing and sales@example.com both reduce to example.com.

Built-in filters

onlyRegistered: true — drop available domains. Useful when you're feeding in a scraped list.

expiringWithinDays: 60 — only domains expiring soon. Point it at a portfolio for renewal alerts, or at a wishlist for drop-catching.

Filtered-out domains are not charged.

Availability check

An unregistered domain returns isAvailable: true. This comes from the registry's own RDAP server returning "no such object" — it's authoritative, not a reseller's guess. Available domains skip the DNS lookups entirely, so bulk availability checks are fast and cheap.

Who this is for

• Agencies & sales teams — qualify leads by tech stack: who's on Google Workspace, who's on Microsoft 365, who has no DMARC
• Domain investors — expiry monitoring across a portfolio, availability checks in bulk
• Security & IT — SPF/DMARC audit across every domain you own
• SEO — domain age and registrar for competitor and backlink analysis

Privacy

This Actor returns no registrant personal data. Post-GDPR, RDAP exposes only the registrar for virtually every TLD, and no attempt is made to recover the individual behind a domain from any other source. What comes back is operational: registrar, dates, status, and where mail and DNS are hosted.

Pricing

Pay per result. One row = one domain. Invalid input and lookup failures come back as error rows and are not charged, and neither are domains removed by your filters.

Notes

• includeEmailSecurity costs one extra DNS lookup per domain (DMARC lives at _dmarc.<domain>, not on the apex).
• Some ccTLDs run thin RDAP servers and return fewer fields — you'll get whatever the registry publishes rather than an error.
• Set a max charge per run in the run options for a hard spend ceiling — the Actor honors it and stops cleanly.

FAQ

Do I need a WHOIS or DNS API key?

No. This uses RDAP, the IETF's official WHOIS replacement (RFC 9083), plus DNS-over-HTTPS. Both are open and key-free.

Can I check whether a domain is available to register?

Yes. An unregistered domain returns isAvailable: true, and that comes from the registry's own RDAP server answering "no such object", so it is authoritative rather than a reseller's guess. Available domains skip DNS lookups entirely, so bulk availability checks are fast and cheap.

Will this give me the registrant's name and email?

No, and not because of a limitation here. Post-GDPR, RDAP exposes only the registrar for virtually every TLD. No attempt is made to recover the individual behind a domain from any other source. What you get is operational: registrar, dates, status, and where mail and DNS are hosted.

How do I find out which email provider a company uses?

mailProvider is derived from live MX records and resolves to names like google, microsoft-365, zoho or proton. dnsProvider does the same for nameservers: cloudflare, aws-route53, azure, vercel. That is the field sales teams actually want out of a WHOIS tool.

Can I audit SPF and DMARC across all my domains?

Yes. includeEmailSecurity returns hasSPF, hasDMARC and dmarcPolicy (the p= value, so you can tell none from reject). It costs one extra DNS lookup per domain because DMARC lives at _dmarc.<domain>, not on the apex.

Can I get renewal alerts for a domain portfolio?

Set expiringWithinDays: 60 and schedule it. Only domains inside that window are returned, and the ones filtered out are not charged.

Do I have to clean my input list first?

No. Full URLs and email addresses are accepted, so https://example.com/pricing and sales@example.com both reduce to example.com.

Why do some domains return fewer fields?

Some ccTLDs run thin RDAP servers. You get whatever the registry publishes rather than an error.