Sorrek: Domain hosting, mail server, IP address, and more

Scrape DNS data, IP addresses, domain status, mail server details, and hosting provider info from ARIN.

👋 About Us

Sorrek is a domain intelligence provider that tracks domain redirects for over 300mm websites globally to identify and resolve duplicates in company datasets such as CRMs. For more information on the types of data we provide, please visit sorrek.io.

Check out our other Actors too!

🌐 What is ARIN?

ARIN (American Registry for Internet Numbers) is a non-profit organization that manages the distribution of IP addresses and ASN (Autonomous System Number) resources in North America. The ISP-related information is retrieved from ARIN records.

Learn more at arin.net.

📥 Input

The input for the crawler is a list of domain names, such as sorrek.io, that you would like to collect data for. Be sure to exclude any SSL certificates and URL slugs. In most cases, subdomains will return invalid results. Notable exceptions are academic institutions, government entities, and larger conglomerates. Please see the Subdomain Exceptions section below for more details. If you only wish to process one domain name you will need to include it in its own list.

📤 Output Details

The output of the crawler is a JSON string with the following fields:

• domain_name: The domain name provided by the user.
• ip_address: IP Address for the web host of the domain.
• has_nameserver: Boolean value confirming if a name server (NS) DNS record is properly configured.
• domain_is_valid: Boolean value derived from the prior two. True if the site has a valid IP address and has_nameserver is True.
• email_service_provider: Domain name of the email service provider derived from a domain's MX record.
• mail_servers: List of the MX DNS records for the domain.
• isp_name: Name of the ISP host from ARIN.
• isp_org: Name of the organization that the ISP host belongs to.
• isp_address: Address of the isp_org from ARIN.

If the domain is not valid (e.g., a host IP address does not exist), it will return a None-type value for that field, as well as for isp_name, isp_org, and isp_address. If no mail servers (MX DNS records) exist, the email_service_provider field will have a None-type value and the mail_servers field will return an empty list.

🔍 Output Samples (data as of January 2024)

Sample 1: Crawling a single domain name

Input: ["sorrek.io"]

1[
2  {
3    "domain_name": "sorrek.io",
4    "ip_address": "199.36.158.100",
5    "has_nameserver": true,
6    "domain_is_valid": true,
7    "email_service_provider": "google.com",
8    "mail_servers": [
9      "alt3.aspmx.l.google.com",
10      "aspmx.l.google.com",
11      "alt4.aspmx.l.google.com",
12      "alt2.aspmx.l.google.com",
13      "alt1.aspmx.l.google.com"
14    ],
15    "isp_name": "MEEBO",
16    "isp_org": "Google LLC",
17    "isp_address": "1600 Amphitheatre Parkway Mountain View CA 94043 United States"
18  }
19]

Sample 2: Crawling an invalid domain name

Input: ["invalid.domain"]

1[
2  {
3    "domain_name": "invalid.domain",
4    "ip_address": null,
5    "has_nameserver": false,
6    "domain_is_valid": false,
7    "email_service_provider": null,
8    "mail_servers": [],
9    "isp_name": null,
10    "isp_org": null,
11    "isp_address": null
12  }
13]

Sample 3: Crawling multiple domain names

Input: ["apify.com", "airbnb.com", "googlemaps.com"]

1[
2  {
3    "domain_name": "apify.com",
4    "ip_address": "18.244.202.67",
5    "has_nameserver": true,
6    "domain_is_valid": true,
7    "email_service_provider": "google.com",
8    "mail_servers": [
9      "aspmx.l.google.com",
10      "alt2.aspmx.l.google.com",
11      "aspmx2.googlemail.com",
12      "aspmx3.googlemail.com",
13      "alt1.aspmx.l.google.com"
14    ],
15    "isp_name": "AMAZON-CF",
16    "isp_org": "Amazon.com, Inc.",
17    "isp_address": "1918 8th Ave SEATTLE WA 98101-1244 United States"
18  },
19  {
20    "domain_name": "airbnb.com",
21    "ip_address": "54.210.72.225",
22    "has_nameserver": true,
23    "domain_is_valid": true,
24    "email_service_provider": "google.com",
25    "mail_servers": [
26      "alt3.aspmx.l.google.com",
27      "aspmx.l.google.com",
28      "alt4.aspmx.l.google.com",
29      "alt2.aspmx.l.google.com",
30      "alt1.aspmx.l.google.com"
31    ],
32    "isp_name": "AMAZO-ZIAD5",
33    "isp_org": "Amazon.com, Inc.",
34    "isp_address": "Amazon Web Services, Inc.\\r P.O. Box 81226 Seattle WA 98108-1226 United States"
35  },
36  {
37    "domain_name": "googlemaps.com",
38    "ip_address": "64.233.185.104",
39    "has_nameserver": true,
40    "domain_is_valid": true,
41    "email_service_provider": null,
42    "mail_servers": [],
43    "isp_name": "GOOGLE",
44    "isp_org": "Google LLC",
45    "isp_address": "1600 Amphitheatre Parkway Mountain View CA 94043 United States"
46  }
47]

📄 Subdomain Exceptions

In some cases, academic institutions, government entities, and larger conglomerates may have separate hosting information, mail servers, and other details associated with one of their subdomains. For most domains, using a subdomain in the input will return None-type and False values for most, if not all, of the output fields. Here are some examples of subdomains with unique hosting details (as of January 2024):

Sample 1: amazon.com and aws.amazon.com

1[
2  {
3    "domain_name": "amazon.com",
4    "ip_address": "54.239.28.85",
5    "has_nameserver": true,
6    "domain_is_valid": true,
7    "email_service_provider": "amazon.com",
8    "mail_servers": [
9      "amazon-smtp.amazon.com"
10    ],
11    "isp_name": "AMAZON-2011L",
12    "isp_org": "Amazon Technologies Inc.",
13    "isp_address": "410 Terry Ave N. Seattle WA 98109 United States"
14  },
15  {
16    "domain_name": "aws.amazon.com",
17    "ip_address": "13.32.252.53",
18    "has_nameserver": true,
19    "domain_is_valid": true,
20    "email_service_provider": null,
21    "mail_servers": [],
22    "isp_name": "AMAZO-CF",
23    "isp_org": "Amazon.com, Inc.",
24    "isp_address": "1918 8th Ave SEATTLE WA 98101-1244 United States"
25  }
26]

Sample 2: northwestern.edu and law.northwestern.edu

1[
2  {
3    "domain_name": "northwestern.edu",
4    "ip_address": "129.105.136.48",
5    "has_nameserver": true,
6    "domain_is_valid": true,
7    "email_service_provider": "northwestern.edu",
8    "mail_servers": [
9      "chcspprf11.ads.northwestern.edu",
10      "chcspprf10.ads.northwestern.edu",
11      "chcspprf12.ads.northwestern.edu",
12      "evcspprf12.ads.northwestern.edu",
13      "evcspprf11.ads.northwestern.edu",
14      "evcspprf10.ads.northwestern.edu"
15    ],
16    "isp_name": "NWUNET",
17    "isp_org": "Northwestern University",
18    "isp_address": "Leverone Hall #G-166\\r 2001 Sheridan Rd Evanston IL 60208 United States"
19  },
20  {
21    "domain_name": "law.northwestern.edu",
22    "ip_address": "129.105.202.205",
23    "has_nameserver": true,
24    "domain_is_valid": true,
25    "email_service_provider": "northwestern.edu",
26    "mail_servers": [
27      "chcspprf11.ads.northwestern.edu",
28      "chcspprf10.ads.northwestern.edu",
29      "chcspprf12.ads.northwestern.edu",
30      "evcspprf12.ads.northwestern.edu",
31      "evcspprf11.ads.northwestern.edu",
32      "evcspprf10.ads.northwestern.edu"
33    ],
34    "isp_name": "NWUNET",
35    "isp_org": "Northwestern University",
36    "isp_address": "Leverone Hall #G-166\\r 2001 Sheridan Rd Evanston IL 60208 United States"
37  }
38]

📣 Your Feedback

We are always working on improving the perfmance of our Actors. So if you have any technical feedback for our Scraper or found a bug, please create an issue on the Actor's Issues tab in the Apify Console.

Happy probing! 🕵️‍♂️✨