B2B Domain Contact & Decision-Maker Enricher (Apify Actor)

A high-performance, production-ready Apify Actor written in Python, designed to enrich B2B domains with direct decision-maker contact details (emails, phone numbers, and social profiles) with ultra-low Compute Unit (CU) consumption and memory usage strictly under 256MB.

---

🚀 Key Features

• Ultra-Low CU Footprint: Operates purely on lightweight asynchronous HTTP requests (aiohttp + BeautifulSoup4 + lxml). Absolutely no headless browsers (no Playwright/Selenium/Puppeteer), slashing Apify run costs by over 90%.
• Intelligent Page Discovery: Fetches the homepage and discovers internal links matching /contact, /contact-us, /about, /about-us, /team, /our-team, /leadership, /people, etc., crawling up to 3 highest-priority subpages concurrently per domain.
• Smart Email Classification & Scoring:
  • Distinguishes Direct/Personal Emails (e.g. john@, j.smith@, sarah.k@, first.last@company.com) from Generic Inboxes (info@, support@, sales@, admin@, etc.).
  • Filters out false positives (e.g. image extensions .png, .svg, .jpg, .css and vendor/test domains like example.com, sentry.io, wixpress.com, shopify.com).
  • Calculates confidence scores to nominate a primary_direct_email.
• Social Profile & Phone Extraction:
  • Cleans and normalizes profile and company URLs for LinkedIn, Twitter/X, Instagram, and Facebook (strips tracking parameters, share dialogs, and internal platform pages).
  • Extracts and validates international phone numbers via tel: links and regex patterns.
• Async Worker Pool & Proxy Integration:
  • Native Apify proxy rotation with Actor.create_proxy_configuration().
  • Queue-based worker pool with configurable concurrency (default: 15 workers) and 10s strict page timeouts.
• Fault-Tolerant Execution:
  • Individual domain timeouts, 403 Forbidden, or connection failures are logged and recorded with descriptive statuses (Failed: Timeout, Failed: Forbidden, etc.) without stopping or crashing the batch.

---

📥 Input Schema

Configure the Actor via Apify Console or JSON input:

{
  "startUrls": [
    { "url": "https://apify.com" },
    { "url": "https://stripe.com" },
    { "url": "openai.com" }
  ],
  "maxConcurrency": 15,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Parameters:

Parameter	Type	Required	Default	Description
startUrls	Array	Yes	—	List of target domains or URLs (supports Google Maps exports, CRM lists, string URLs, or Apify request objects).
maxConcurrency	Integer	No	15	Concurrency limit for the worker pool (10-20 recommended for minimal memory).
proxyConfiguration	Object	No	{"useApifyProxy": true}	Apify Proxy configuration (residential or datacenter).

---

📤 Output Schema

Each processed domain outputs a structured record to the default Apify Dataset:

{
  "domain": "example-corp.com",
  "website_status": "OK",
  "primary_direct_email": "john.smith@example-corp.com",
  "all_direct_emails": [
    "john.smith@example-corp.com",
    "sarah.k@example-corp.com"
  ],
  "generic_emails": [
    "contact@example-corp.com",
    "info@example-corp.com"
  ],
  "phone_numbers": [
    "+1-555-019-2834"
  ],
  "linkedin_urls": [
    "https://www.linkedin.com/company/example-corp"
  ],
  "social_profiles": {
    "linkedin": [
      "https://www.linkedin.com/company/example-corp"
    ],
    "twitter": [
      "https://x.com/examplecorp"
    ],
    "instagram": [
      "https://www.instagram.com/examplecorp/"
    ],
    "facebook": [
      "https://www.facebook.com/examplecorp"
    ]
  },
  "scraped_at": "2026-09-06T10:55:00.123456+00:00"
}

For unreachable or failed domains:

{
  "domain": "offline-domain.com",
  "website_status": "Failed: Timeout",
  "primary_direct_email": null,
  "all_direct_emails": [],
  "generic_emails": [],
  "phone_numbers": [],
  "linkedin_urls": [],
  "social_profiles": {
    "linkedin": [],
    "twitter": [],
    "instagram": [],
    "facebook": []
  },
  "scraped_at": "2026-09-06T10:55:00.123456+00:00"
}

---

🛠️ Local Development & Testing

1. Install Dependencies

$pip install -r requirements.txt

2. Run Locally with Apify CLI

$apify run -p

Or directly using Python with environment variables:

$python main.py

---

🚢 Deploy to Apify

Push directly using the Apify CLI:

apify login
apify push

Or connect your GitHub repository to your Apify Actor dashboard for automated builds.