Under maintenance

No credit card required

Go to Store

This Actor is under maintenance.

This Actor may be unreliable while under maintenance. Would you like to try a similar Actor instead?

See alternative Actors

Naked Domains Analyzer

jancurn/analyze-domains

Try for free

No credit card required

Crawls and downloads web pages running on a list of provided naked domains e.g. "example.com". The actor stores HTML snapshot, screenshot, text body, and HTTP response headers of all the pages. It also extracts email addresses, phones, social handles for Facebook, Twitter, LinkedIn, and Instagram.

You can access the Naked Domains Analyzer programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1{
2  "openapi": "3.0.1",
3  "info": {
4    "version": "0.0",
5    "x-build-id": "BxeBtcniyEt7jOnAp"
6  },
7  "servers": [
8    {
9      "url": "https://api.apify.com/v2"
10    }
11  ],
12  "paths": {
13    "/acts/jancurn~analyze-domains/run-sync-get-dataset-items": {
14      "post": {
15        "operationId": "run-sync-get-dataset-items-jancurn-analyze-domains",
16        "x-openai-isConsequential": false,
17        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
18        "tags": [
19          "Run Actor"
20        ],
21        "requestBody": {
22          "required": true,
23          "content": {
24            "application/json": {
25              "schema": {
26                "$ref": "#/components/schemas/inputSchema"
27              }
28            }
29          }
30        },
31        "parameters": [
32          {
33            "name": "token",
34            "in": "query",
35            "required": true,
36            "schema": {
37              "type": "string"
38            },
39            "description": "Enter your Apify token here"
40          }
41        ],
42        "responses": {
43          "200": {
44            "description": "OK"
45          }
46        }
47      }
48    },
49    "/acts/jancurn~analyze-domains/runs": {
50      "post": {
51        "operationId": "runs-sync-jancurn-analyze-domains",
52        "x-openai-isConsequential": false,
53        "summary": "Executes an Actor and returns information about the initiated run in response.",
54        "tags": [
55          "Run Actor"
56        ],
57        "requestBody": {
58          "required": true,
59          "content": {
60            "application/json": {
61              "schema": {
62                "$ref": "#/components/schemas/inputSchema"
63              }
64            }
65          }
66        },
67        "parameters": [
68          {
69            "name": "token",
70            "in": "query",
71            "required": true,
72            "schema": {
73              "type": "string"
74            },
75            "description": "Enter your Apify token here"
76          }
77        ],
78        "responses": {
79          "200": {
80            "description": "OK",
81            "content": {
82              "application/json": {
83                "schema": {
84                  "$ref": "#/components/schemas/runsResponseSchema"
85                }
86              }
87            }
88          }
89        }
90      }
91    },
92    "/acts/jancurn~analyze-domains/run-sync": {
93      "post": {
94        "operationId": "run-sync-jancurn-analyze-domains",
95        "x-openai-isConsequential": false,
96        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
97        "tags": [
98          "Run Actor"
99        ],
100        "requestBody": {
101          "required": true,
102          "content": {
103            "application/json": {
104              "schema": {
105                "$ref": "#/components/schemas/inputSchema"
106              }
107            }
108          }
109        },
110        "parameters": [
111          {
112            "name": "token",
113            "in": "query",
114            "required": true,
115            "schema": {
116              "type": "string"
117            },
118            "description": "Enter your Apify token here"
119          }
120        ],
121        "responses": {
122          "200": {
123            "description": "OK"
124          }
125        }
126      }
127    }
128  },
129  "components": {
130    "schemas": {
131      "inputSchema": {
132        "type": "object",
133        "properties": {
134          "domains": {
135            "title": "Domains",
136            "type": "string",
137            "description": "List of domains to crawl. The domains must be naked, i.e. specified without a protocol and sub-domains (e.g. <code>example.com</code>).",
138            "default": ""
139          },
140          "domainsFileUrl": {
141            "title": "Domains file URL",
142            "type": "string",
143            "description": "URL of a text file that contains the list of domains to crawl. The domains must be naked, i.e. specified without a protocol and sub-domains (e.g. <code>example.com</code>).<br><br>This field is useful if you have a large number of domains."
144          },
145          "domainsFileOffset": {
146            "title": "Domains file offset",
147            "minimum": 0,
148            "maximum": 999999999,
149            "type": "integer",
150            "description": "Indicates how many domains from the file should be skipped in the beginning. This is useful if you only want to crawl a portion of the domains.",
151            "default": 0
152          },
153          "domainsFileCount": {
154            "title": "Domains file count",
155            "minimum": 0,
156            "maximum": 999999999,
157            "type": "integer",
158            "description": "Indicates how many domains from the file should be crawled, starting from the offset. This is useful if you only want to crawl a portion of the domains. Leave empty to crawl all domains."
159          },
160          "useChrome": {
161            "title": "Use Chrome",
162            "type": "boolean",
163            "description": "If checked, the actor uses Chrome instead of Puppeteer's Chromium for the crawling. This might help to prevent blocking of some pages.",
164            "default": false
165          },
166          "useApifyProxy": {
167            "title": "Use Apify Proxy",
168            "type": "boolean",
169            "description": "If checked, the actor uses Apify Proxy to access the target pages. This might help to prevent blocking of some pages.",
170            "default": false
171          },
172          "maxRequestRetries": {
173            "title": "Max page retries",
174            "minimum": 0,
175            "maximum": 5,
176            "type": "integer",
177            "description": "Indicates how many times shall the crawler retry to load a page on error.",
178            "default": 0
179          },
180          "crawlLinkCount": {
181            "title": "Crawl domain links",
182            "minimum": 0,
183            "maximum": 100,
184            "type": "integer",
185            "description": "Indicates how many links from the main page going to the same domain shall also be crawled.",
186            "default": 0
187          },
188          "crawlHttpsVersion": {
189            "title": "Crawl HTTPS version",
190            "type": "boolean",
191            "description": "If checked, the actor attempts to crawl HTTPs version of the website (e.g. <code>https://example.com</code> for domain <code>example.com</code>).",
192            "default": true
193          },
194          "crawlWwwSubdomain": {
195            "title": "Crawl www. sub-domain",
196            "type": "boolean",
197            "description": "If checked, the actor attempts to crawl <code>www.</code> sub-domain of the website (e.g. <code>http://www.example.com</code> for domain <code>example.com</code>).",
198            "default": true
199          },
200          "saveScreenshot": {
201            "title": "Save screenshots",
202            "type": "boolean",
203            "description": "If checked, the actor stores screenshots of all loaded pages into the key-value store.",
204            "default": true
205          },
206          "saveHtml": {
207            "title": "Save HTML content",
208            "type": "boolean",
209            "description": "If checked, the actor stores HTML content of all loaded pages into the key-value store.",
210            "default": true
211          },
212          "saveText": {
213            "title": "Save text content",
214            "type": "boolean",
215            "description": "If checked, the actor stores text content of all loaded pages into the dataset results.",
216            "default": true
217          },
218          "considerChildFrames": {
219            "title": "Consider child frames",
220            "type": "boolean",
221            "description": "If checked, the actor searches for social handles even in the content of the first-level child frames. The 'page.text' also contains the combined text of the main frame and direct child frames.",
222            "default": false
223          }
224        }
225      },
226      "runsResponseSchema": {
227        "type": "object",
228        "properties": {
229          "data": {
230            "type": "object",
231            "properties": {
232              "id": {
233                "type": "string"
234              },
235              "actId": {
236                "type": "string"
237              },
238              "userId": {
239                "type": "string"
240              },
241              "startedAt": {
242                "type": "string",
243                "format": "date-time",
244                "example": "2025-01-08T00:00:00.000Z"
245              },
246              "finishedAt": {
247                "type": "string",
248                "format": "date-time",
249                "example": "2025-01-08T00:00:00.000Z"
250              },
251              "status": {
252                "type": "string",
253                "example": "READY"
254              },
255              "meta": {
256                "type": "object",
257                "properties": {
258                  "origin": {
259                    "type": "string",
260                    "example": "API"
261                  },
262                  "userAgent": {
263                    "type": "string"
264                  }
265                }
266              },
267              "stats": {
268                "type": "object",
269                "properties": {
270                  "inputBodyLen": {
271                    "type": "integer",
272                    "example": 2000
273                  },
274                  "rebootCount": {
275                    "type": "integer",
276                    "example": 0
277                  },
278                  "restartCount": {
279                    "type": "integer",
280                    "example": 0
281                  },
282                  "resurrectCount": {
283                    "type": "integer",
284                    "example": 0
285                  },
286                  "computeUnits": {
287                    "type": "integer",
288                    "example": 0
289                  }
290                }
291              },
292              "options": {
293                "type": "object",
294                "properties": {
295                  "build": {
296                    "type": "string",
297                    "example": "latest"
298                  },
299                  "timeoutSecs": {
300                    "type": "integer",
301                    "example": 300
302                  },
303                  "memoryMbytes": {
304                    "type": "integer",
305                    "example": 1024
306                  },
307                  "diskMbytes": {
308                    "type": "integer",
309                    "example": 2048
310                  }
311                }
312              },
313              "buildId": {
314                "type": "string"
315              },
316              "defaultKeyValueStoreId": {
317                "type": "string"
318              },
319              "defaultDatasetId": {
320                "type": "string"
321              },
322              "defaultRequestQueueId": {
323                "type": "string"
324              },
325              "buildNumber": {
326                "type": "string",
327                "example": "1.0.0"
328              },
329              "containerUrl": {
330                "type": "string"
331              },
332              "usage": {
333                "type": "object",
334                "properties": {
335                  "ACTOR_COMPUTE_UNITS": {
336                    "type": "integer",
337                    "example": 0
338                  },
339                  "DATASET_READS": {
340                    "type": "integer",
341                    "example": 0
342                  },
343                  "DATASET_WRITES": {
344                    "type": "integer",
345                    "example": 0
346                  },
347                  "KEY_VALUE_STORE_READS": {
348                    "type": "integer",
349                    "example": 0
350                  },
351                  "KEY_VALUE_STORE_WRITES": {
352                    "type": "integer",
353                    "example": 1
354                  },
355                  "KEY_VALUE_STORE_LISTS": {
356                    "type": "integer",
357                    "example": 0
358                  },
359                  "REQUEST_QUEUE_READS": {
360                    "type": "integer",
361                    "example": 0
362                  },
363                  "REQUEST_QUEUE_WRITES": {
364                    "type": "integer",
365                    "example": 0
366                  },
367                  "DATA_TRANSFER_INTERNAL_GBYTES": {
368                    "type": "integer",
369                    "example": 0
370                  },
371                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
372                    "type": "integer",
373                    "example": 0
374                  },
375                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
376                    "type": "integer",
377                    "example": 0
378                  },
379                  "PROXY_SERPS": {
380                    "type": "integer",
381                    "example": 0
382                  }
383                }
384              },
385              "usageTotalUsd": {
386                "type": "number",
387                "example": 0.00005
388              },
389              "usageUsd": {
390                "type": "object",
391                "properties": {
392                  "ACTOR_COMPUTE_UNITS": {
393                    "type": "integer",
394                    "example": 0
395                  },
396                  "DATASET_READS": {
397                    "type": "integer",
398                    "example": 0
399                  },
400                  "DATASET_WRITES": {
401                    "type": "integer",
402                    "example": 0
403                  },
404                  "KEY_VALUE_STORE_READS": {
405                    "type": "integer",
406                    "example": 0
407                  },
408                  "KEY_VALUE_STORE_WRITES": {
409                    "type": "number",
410                    "example": 0.00005
411                  },
412                  "KEY_VALUE_STORE_LISTS": {
413                    "type": "integer",
414                    "example": 0
415                  },
416                  "REQUEST_QUEUE_READS": {
417                    "type": "integer",
418                    "example": 0
419                  },
420                  "REQUEST_QUEUE_WRITES": {
421                    "type": "integer",
422                    "example": 0
423                  },
424                  "DATA_TRANSFER_INTERNAL_GBYTES": {
425                    "type": "integer",
426                    "example": 0
427                  },
428                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
429                    "type": "integer",
430                    "example": 0
431                  },
432                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
433                    "type": "integer",
434                    "example": 0
435                  },
436                  "PROXY_SERPS": {
437                    "type": "integer",
438                    "example": 0
439                  }
440                }
441              }
442            }
443          }
444        }
445      }
446    }
447  }
448}

Naked Domains Analyzer OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Naked Domains Analyzer from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Naked Domains Analyzer API in Python

Naked Domains Analyzer API in JavaScript

Naked Domains Analyzer API through CLI

Naked Domains Analyzer API

Developer

Jan Čurn

Actor Metrics

18 monthly users
5 stars
>99% runs succeeded
Created in Nov 2018
Modified 2 years ago

Categories

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

35.9k

995

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.3k

117

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

75.8k

448

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.3k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.3k

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

Monitoring Reporter Dashboard

apify/monitoring-reporter-dashboard

The monitoring reporter dashboard is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

Youtube Transcript Scraper

topaz_sharingan/Youtube-Transcript-Scraper

Are you in search of a robust solution for extracting transcripts from YouTube videos? Look no further 😉, YouTube-Transcript-Scraper will meet your needs. Our software not only efficiently retrieves transcripts but also provides additional valuable information .👍 😀 Scrap away 🕵‍♂️.

Moses Bilal

1.2k

Shopify Scraper

pocesar/shopify-scraper

Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online stores and extract a list of all products in a structured form, including product title, price, description, etc.