🔍 Website Contact Information Scraper

✨ Purpose

This actor crawls websites to extract contact information including email addresses, phone numbers, and contact form URLs. It starts with a list of search queries, performs Google searches to find websites, and then systematically scrapes each website to collect contact details.

🚀 Features

• 📧 Extracts up to 2 email addresses per website
• 📱 Extracts up to 2 phone numbers per website
• 🔗 Extracts up to 2 contact form URLs per website
• ⚡ Uses both requests and Selenium for crawling (to handle JavaScript-heavy websites)
• 🎯 Prioritizes pages with "contact" or "about" in the URL
• ✅ Verifies email addresses to filter out invalid or fake ones
• 🌍 Handles international phone numbers via the phonenumbers library
• 🛑 Limited to crawling 100 pages per website by default (configurable)

⚙️ Input Parameters

Parameter	Type	Required	Default	Description
google_queries	array	Yes	-	List of search queries to find websites. The actor will perform Google searches using these queries and scrape contact information from the resulting websites.
max_pages	integer	No	100	Maximum number of pages to crawl per website.
countryCode	string	No	'es'	Google search country code.
languageCode	string	No	'es'	Google search language code.

📊 Output Format

The actor outputs data in the following format for each website:

{
  "Website": "https://example.com/",
  "email (1)": "contact@example.com",
  "email (2)": "info@example.com",
  "phone (1)": "+15551234567",
  "phone (2)": "+15559876543",
  "contact_form (1)": "https://example.com/contact",
  "contact_form (2)": "https://example.com/support",
  "start_url": "https://example.com",
  "google_search_url": "https://www.google.com/search?q=example+query",
  "search_term": "example query"
}

🔄 How It Works

1. 🔍 The actor takes search queries and performs Google searches using Apify's Google Search Scraper
2. 🌐 For each website found in the search results:
   • First checks the homepage for contact information
   • Prioritizes pages containing "about", "contact", or "support" in the URL
   • Uses regular expressions to extract emails and the phonenumbers library for phone numbers
   • Attempts regular requests first (faster) and falls back to Selenium for JavaScript-heavy sites
   • Verifies emails to filter out invalid ones
   • Collects and returns the specified number of contact details

⚠️ Limitations

• Limited to extracting 2 items of each contact type per website
• May not extract all contact information from complex websites
• Will skip certain URLs containing terms like "sign_up", "privacy", "policy", "donate", etc.
• Has a timeout of 15 seconds for page loading
• Special handling for social media platforms (only scrapes the main page without going deeper)

🛠️ Dependencies

• 🔄 Selenium WebDriver for JavaScript-rendered content
• 🧩 Beautiful Soup for HTML parsing
• 📞 Phonenumbers library for international phone number recognition
• 📨 Requests library for HTTP requests
• 🔍 Google Search Scraper Apify actor for initial website discovery