Domain Intelligence Crawler (AI Website Evaluation)

Analyze any website by providing a domain or a full URL.
This Actor returns a structured, AI-generated company/website profile including reachability, contacts, business summary, advantages/disadvantages, and user sentiment highlights.

---

What this Actor does

Given an input like:

• apify.com
• https://apify.com
• http://www.apify.com/some/path

The Actor will:

1. Normalize the input (domain or URL)
2. Check basic reachability and status code
3. Extract/derive key site/company signals
4. Generate an AI-written analysis and structured insights
5. Return a single JSON record with consistent fields

---

Output example

{
  "ok": true,
  "url": "apify.com",
  "status_code": 200,
  "reachable": true,
  "domain": "apify.com",
  "full_name": "Apify Technologies s.r.o.",
  "brands": ["Apify"],
  "main_business": "A full-stack web scraping and data extraction platform...",
  "target_market": ["global"],
  "target_audience": ["Software Developers", "Data Scientists", "..."],
  "emails": ["hello@apify.com", "support@apify.com"],
  "phones": ["+420 228 881 881"],
  "address": ["Vodičkova 704/36, 110 00 Prague 1, Czech Republic"],
  "analysis": "Apify is a leading platform...",
  "product_advantages": ["Extensive marketplace...", "Scalable serverless..."],
  "product_disadvantages": ["Steep learning curve...", "Complex pricing..."],
  "user_praise": ["High reliability...", "Great documentation..."],
  "user_negative": ["Confusing billing...", "Expensive proxy costs..."],
  "error_code": null,
  "message": null
}

URL Field Behavior

Please note that regardless of whether the "url" field contains a domain name or a full URL, the API will analyze the website based on the root domain. For example:

• https://console.apify.com/store
• https://apify.com/
• apify.com

All of these URLs will be analyzed as the root domain apify.com, and the analysis will be based on that.

This behavior ensures that the API performs the analysis consistently, regardless of the provided URL format, by focusing on the root domain level.

---

Input

Input fields

Field	Type	Required	Description
url	string	✅ Yes	A domain or URL to analyze (e.g., apify.com or https://apify.com)

Notes on input normalization

• You can pass either a domain or a URL
• If the protocol is missing, the Actor will handle it automatically
• Paths and query strings are allowed (they will be normalized to the effective domain when needed)

---

How to use

Run from Apify Console

1. Open the Actor

2. Go to Input

3. Provide:

   { "url": "apify.com" }
   

4. Click Start

Run via API

Use the standard Apify Actor run endpoint, then read results from the default dataset.

---

Results storage

This Actor writes the final structured record into the default dataset:

• Default dataset: contains the resulting JSON item(s)

You can export results as JSON/CSV/Excel from the Apify Console.

---

Typical use cases

• Lead enrichment and qualification (B2B)
• Vendor / partner due diligence
• Market research automation
• Sales prospect profiling
• Competitive analysis pipelines
• AI-ready website/company profiling for LLM workflows

---

Error handling

If the analysis fails or the website is not reachable, the Actor still returns a structured result whenever possible:

• ok: whether the run succeeded
• error_code and message: populated if an error occurred
• status_code / reachable: reflects network and HTTP status conditions

---

Limitations & best practices

• Some websites may block automated requests; reachability and extraction may vary
• AI-generated fields (e.g., analysis, pros/cons, sentiment highlights) are best used as decision support, not as absolute truth
• For batch usage, throttle requests and monitor error rates

---

Support

If you need custom fields, bulk/batch mode, or a tailored scoring model, feel free to reach out via the Actor support channel on Apify.