Site Lens – Website Homepage Analyzer & Design Inspector

Site Lens analyzes a website’s homepage only and extracts its structure, design signals, and key touchpoints — without crawling the entire site.

It captures full-page screenshots, navigation pages, contact details, social profiles, fonts, colors, and visible text, and returns everything in a clean, structured dataset.

This Actor is fast, predictable, and optimized for modern JavaScript-heavy websites.

---

🚀 What Site Lens Does

For each input URL, Site Lens analyzes only the homepage and extracts:

🖼 Screenshots

• Full-page desktop screenshot
• Full-page mobile screenshot
• Public preview URLs (stored in Key-Value Store)

🧭 Navigation Pages

• Header & menu links (Home, About, Blog, Products, Careers, etc.)
• Internal site structure without crawling
• Helps understand how a website is organized at a glance

📞 Contact Information

• Email links (mailto:)
• Phone links (tel:)
• Footer contact links

🌐 Social Profiles

Automatically detects links to:

• Facebook
• Instagram
• LinkedIn
• Twitter / X
• YouTube
• TikTok
• GitHub
• Discord / WhatsApp (when present)

🎨 Design Signals

• Fonts used on the page
• Colors (text, background, borders)
  Useful for UI / UX audits and design inspiration.

📝 Text Content

• Headings (h1, h2, h3)
• Visible paragraph text

---

❌ What Site Lens Does NOT Do

To keep execution fast, low-cost, and reliable, Site Lens intentionally:

• ❌ Does NOT crawl multiple pages
• ❌ Does NOT scrape product or listing data
• ❌ Does NOT bypass logins or paywalls
• ❌ Does NOT click buttons or submit forms

➡️ This Actor is homepage-only by design.

---

🧠 Why Use Site Lens?

Site Lens is ideal for:

• Brand & competitor analysis
• UI / UX audits
• Lead research (contacts & socials)
• Sales & marketing discovery
• AI agents needing website context
• Design inspiration (fonts & colors)
• Quick website overview before deeper crawling

---

📥 Input

Required

• Start URLs – One or more website URLs

Optional

Toggle extraction options:

• Screenshots
• Text
• Styles
• Links

Example Input

{
  "startUrls": [
    { "url": "https://apify.com" }
  ]
}


---

## 📤 Output

### Dataset Fields

Each dataset item contains:

- `pageUrl`
- `title`
- `screenshots.desktop`
- `screenshots.mobile`
- `texts.headings`
- `texts.paragraphs`
- `fonts`
- `colors`
- `links.navigation`
- `links.contacts`
- `links.social`
- `stats` (counts for quick overview)

### Dataset Views

- **Overview** – High-level summary
- **Navigation Pages**
- **Contact Details**
- **Social Profiles**

---

## ⚡ Performance & Cost

- Processes **1 page per run**
- Optimized for **JavaScript-heavy websites**
- Handles **lazy-loaded content**
- Very low runtime and cost
- Predictable execution (**Store-friendly**)

---

## 🔒 Ethical & Legal Use

You are responsible for:

- Respecting website terms of service
- Complying with applicable laws
- Using extracted data ethically

---

## ❓ FAQ

**Does Site Lens crawl the entire website?**  
No. It analyzes only the homepage.

**Does it work on modern JS websites (React, Next.js, etc.)?**  
Yes. It uses Playwright and supports client-side rendering.

**Can I extract product or blog content?**  
No. Site Lens focuses on structure, design, and key touchpoints.

**Are screenshots publicly accessible?**  
Yes. Screenshot URLs are stored in the Key-Value Store.

**Is this Actor suitable for AI agents?**  
Yes. The structured output is ideal for AI agents and RAG workflows.

---

## 🏆 Built for the Apify $1M Challenge

- Clear scope and purpose
- Clean dataset schema
- Useful output views
- Low cost, high signal
- Store-ready and production-safe

---

## 👨‍💻 Author

Created by **Koushik Biswas** using **Crawlee + Playwright (Chrome)** on the Apify Platform, with assistance from **ChatGPT** for design, structure, and documentation.