RDAP Domain Information Scraper

This Actor scrapes comprehensive domain registration information using the RDAP (Registration Data Access Protocol) API. It fetches detailed domain data including registration dates, expiration dates, registrant information, nameservers, and DNS security details. The Actor also includes domain expiration monitoring with optional email notifications and robust error handling for failed domains.

Input

The Actor expects a JSON input with a domains array and optional expiration monitoring settings:

{
  "domains": [
    "google.com",
    "example.com"
  ],
  "expirationWarningDays": 30,
  "expirationWarningEmail": [
    {
      "to": "admin@example.com"
    },
    {
      "to": "webmaster@example.com",
      "cc": "manager@example.com",
      "bcc": "backup@example.com"
    }
  ]
}

Input Parameters

• domains (required): Array of domain names to check
• expirationWarningDays (optional): Number of days before expiration to consider as "expiring soon". Use -1 to disable expiration checking. Default: 30
• expirationWarningEmail (optional): Email configuration for sending expiration warnings. If not provided, no emails will be sent.

Email Configuration

The expirationWarningEmail array supports multiple recipients with the following structure:

[
  {
    "to": "primary@example.com"
  },
  {
    "to": "webmaster@example.com",
    "cc": "manager@example.com",
    "bcc": "backup@example.com"
  }
]

• to (required): Primary recipient email address
• cc (optional): Carbon copy recipient email address
• bcc (optional): Blind carbon copy recipient email address

Output

The Actor outputs a single dataset entry containing all domain information, failed domains, and processing summary:

{
  "domains": [
    {
      "domain": "google.com",
      "domainHandle": "google.com",
      "registrationDate": "1997-09-15T04:00:00Z",
      "expirationDate": "2028-09-13T04:00:00Z",
      "lastChangedDate": "2023-09-13T04:00:00Z",
      "transferDate": null,
      "registrant": "REDACTED FOR PRIVACY",
      "registrar": "MarkMonitor Inc.",
      "nameservers": ["ns1.google.com", "ns2.google.com", "ns3.google.com", "ns4.google.com"],
      "status": ["clientTransferProhibited", "clientDeleteProhibited"],
      "whoisServer": "whois.markmonitor.com",
      "rdapConformance": ["rdap_level_0"],
      "dnssecZoneSigned": true,
      "dnssecDelegationSigned": true,
      "dnssecAlgorithm": 8,
      "dnssecKeyFlags": 257,
      "dnssecPublicKey": "AwEAAagAIKlVZrpC6Ia7gEzahOR+9W29euxhJjVVLOyQbSEW0O8gcCjFFVQUTf6v58fLjwBd0YI0EzrAcQqBGCzh/RStIoO8g0NfnfL2MTJRkxoXbfDaUeVPQuYEhg37NZWAJQ9VnMVDxP/VHL496M/QZxkjf5/Efucp2gaDX6RS6CXpoY68LsvPVjR0ZSwzz1apAzvN9dlzEheX7ICJBBtuA6G3LQpzW5hOA2kCT0hkOtvuHhgI+m/9aZTz/RfBp4+xMhQylUV8MzQYAryVWkOASkXjaxSOPy/BRn0qR6HQ6sv4DyB0a9ul2GxoxI2lxfU65uiIeE8lU995R5XCC4U0WqHy2w==",
      "dnssecMaxSigLife": 86400,
      "expiresSoon": false
    }
  ],
  "failedDomains": [
    {
      "domain": "invalid-domain",
      "error": "RDAP lookup failed: RDAP lookup failed for domain invalid-domain: Failed to extract TLD: Domain must have at least one dot (e.g., example.com)",
      "timestamp": "2025-07-13T17:21:18.572Z"
    },
    {
      "domain": "nonexistent.xyz",
      "error": "No RDAP provider found for this domain",
      "timestamp": "2025-07-13T17:21:18.573Z"
    }
  ],
  "summary": {
    "total": 3,
    "successful": 1,
    "failed": 2,
    "timestamp": "2025-07-13T17:21:18.850Z"
  }
}

Output Fields

Successfully Processed Domains (domains array)

All standard RDAP fields are included, plus:

• expiresSoon: Boolean indicating whether the domain will expire within the configured warning period. If true and email notifications are configured, warning emails will be sent.

Failed Domains (failedDomains array)

For each failed domain, the following information is provided:

• domain: The domain name that failed to process
• error: Detailed error message explaining why the domain failed
• rdapProvider: The RDAP provider that was used (only present for RDAP processing failures)
• timestamp: ISO timestamp when the error occurred

Processing Summary (summary object)

• total: Total number of domains submitted for processing
• successful: Number of domains successfully processed
• failed: Number of domains that failed to process
• timestamp: ISO timestamp when processing completed

Features

Domain Information Retrieval

• Registration and expiration dates
• Registrant and registrar information
• Nameserver configuration
• Domain status codes
• WHOIS server information
• RDAP conformance levels
• DNSSEC security details

Expiration Monitoring

• Configurable warning period (days before expiration)
• Automatic detection of domains expiring soon
• Optional email notifications for expiring domains
• Support for multiple email recipients with CC/BCC

Examples

Basic Usage (No Expiration Checking)

{
  "domains": ["example.com", "test.org"]
}

With Expiration Monitoring (No Emails)

{
  "domains": ["example.com", "test.org"],
  "expirationWarningDays": 60
}

With Email Notifications

{
  "domains": ["example.com", "test.org"],
  "expirationWarningDays": 30,
  "expirationWarningEmail": [
    {
      "to": "admin@company.com"
    },
    {
      "to": "webmaster@company.com",
      "cc": "manager@company.com"
    }
  ]
}

Disable Expiration Checking

{
  "domains": ["example.com", "test.org"],
  "expirationWarningDays": -1
}