Universal Contact Data Scraper (Google & Bing)

Advanced multilingual contact data scraper for Apify.

Extract complete business contact information from Google and Bing search results in ANY language worldwide.

Key Features

Universal Multi-Language Support

• Works in ANY language - Chinese, Japanese, Korean, Arabic, Russian, etc.
• Automatic contact page detection across all languages
• Universal URL pattern matching (contact, kontakt, 联系, お問い合わせ, etc.)

Unlimited Email Extraction

• ALL emails found on websites (no limits)
• Extracts from visible text, HTML source, and mailto: links
• Visits up to 5 contact/impressum pages automatically
• Detects obfuscated emails ("email [at] domain.com")
• Smart filtering of invalid/image filenames

9 Social Media Platforms

• Facebook (all pages)
• LinkedIn (all profiles)
• Instagram (all accounts)
• Twitter/X (all profiles)
• YouTube (all channels)
• TikTok (all profiles)
• Pinterest (all boards)
• WhatsApp (all contact links)
• Telegram (all channels)
• Returns ALL links found (no limits)

Complete Data Extraction

• Unlimited emails - every single email found
• Unlimited phones - all phone numbers (10-15 digits)
• All social media links - complete presence
• Physical addresses (US, Canada, Europe, worldwide)
• Business hours (any format)
• Blog posts/articles (title + URL)
• Company name (from page title)

Anti-CAPTCHA System

• Session pooling (20 concurrent sessions)
• Automatic CAPTCHA detection
• Smart proxy rotation (RESIDENTIAL)
• Browser fingerprint masking
• Random human-like delays (2-5s)
• 5 automatic retries

Performance & Scale

• Scales to 200 results without issues
• Concurrency optimized (2 parallel requests)
• Smart memory management
• Early stop when enough data found
• Graceful error recovery

Input Configuration

{
  "searchEngine": "google",
  "searchQuery": "plumber toronto canada",
  "maxResults": 50
}

Search Engine Options:

• google - Best for most queries, requires RESIDENTIAL proxy (auto-configured)
• bing - More stable, works without proxy for local testing

Output Format

{
  "01_companyName": "Example Company Inc.",
  "02_emails": [
    "info@example.com",
    "sales@example.com",
    "support@example.com"
  ],
  "03_phoneNumbers": [
    "+1-416-555-0123",
    "647-894-7354"
  ],
  "04_socialMedia": {
    "facebook": ["https://facebook.com/example"],
    "linkedin": ["https://linkedin.com/company/example"],
    "instagram": ["https://instagram.com/example"],
    "twitter": ["https://twitter.com/example"],
    "youtube": ["https://youtube.com/@example"],
    "tiktok": ["https://tiktok.com/@example"],
    "pinterest": ["https://pinterest.com/example"],
    "whatsapp": ["https://wa.me/1234567890"],
    "telegram": ["https://t.me/example"]
  },
  "05_physicalAddress": "123 Main St, Toronto, ON M5V 2T6",
  "06_sourceUrl": "https://example.com",
  "07_businessHours": [
    "Mon-Fri: 9am-5pm",
    "Sat: 10am-4pm"
  ],
  "08_additionalInfo": {
    "position": 1,
    "searchQuery": "plumber toronto canada",
    "scrapedAt": "2025-10-05T20:00:00Z",
    "blogPosts": [
      {
        "title": "How to Fix a Leaky Faucet",
        "url": "https://example.com/blog/fix-leaky-faucet"
      }
    ],
    "error": null
  }
}

How It Works

1. Search Phase

• Queries Google or Bing with your search terms
• Extracts all valid website URLs from results
• Handles pagination automatically (up to 20 pages)
• Detects and bypasses CAPTCHA with session rotation

2. Extraction Phase

For each website found:

Email Extraction (Advanced)

1. Scans visible page text
2. Searches HTML source code
3. Extracts mailto: links
4. Automatically visits up to 5 contact pages (universal language detection)
5. Detects obfuscated emails (email [at] domain.com)
6. Filters image filenames and invalid patterns
7. Returns ALL valid emails (no 5 email limit)

Social Media Extraction

• Searches all <a href> tags on page
• Identifies 9 different platforms
• Filters out share buttons and widgets
• Returns ALL unique links per platform

Phone & Address Extraction

• Regex patterns for international formats
• Validates phone length (10-15 digits)
• Multi-format address detection (US, Europe, etc.)
• Returns ALL phones found

Additional Data

• Business hours detection (any language/format)
• Blog post discovery (up to 5 articles)
• Metadata extraction

3. Anti-Detection

• Session Pooling: 20 rotating sessions
• CAPTCHA Detection: Auto-detects and retries with new IP
• Browser Masking: Hides automation signatures
• Human Delays: Random 2-5s between requests
• 5 Retries: With different proxies each time

Language Support

Universal Contact Detection

Works automatically in ANY language:

• English: contact, about, reach us
• German: kontakt, impressum, ansprechpartner
• French: contactez, nous contacter
• Spanish: contacto, escríbenos
• Italian: contatto, contattaci
• Romanian: contactare, scrie-ne
• Portuguese: fale conosco
• Chinese: 联系 (liánxì)
• Japanese: お問い合わせ (otoiawase)
• Korean: 문의 (mun-ui)
• Russian: связаться (svyazat'sya)
• Turkish: iletişim
• Greek: επικοινωνία
• Arabic: اتصل (ittasil)
• And many more...

How It Works

Uses universal URL patterns and language-independent keywords:

// URL patterns
/contact/i, /kontakt/i, /联系/i, /お問い合わせ/i, /문의/i, /связаться/i

// Text keywords
'mail', '@', 'phone', 'tel:', 'address', 'info', 'support'

Testing

Local Testing

npm install
npx apify run

export APIFY_TOKEN=your_token_here
npx apify run

Performance Benchmarks

Test	Language	Results	Emails	Social Media	Time
Toronto Plumbers	EN	5	31 max	All platforms	~2 min
Berlin Dentists	DE	10	18 max	All platforms	~2 min
Stress Test	EN	50	100+	All platforms	~10 min

Use Cases

Lead Generation

• B2B contact discovery
• Email list building
• Sales prospecting
• Market research

Competitive Analysis

• Competitor social media presence
• Industry contact patterns
• Market positioning analysis

SEO & Marketing

• Backlink opportunities
• Influencer discovery
• Partnership prospecting

Configuration

Proxy Settings (Advanced)

proxyConfiguration: {
    groups: ['RESIDENTIAL'],
    countryCode: 'US'
}

Performance Tuning

maxRequestRetries: 5,
maxConcurrency: 2,
navigationTimeoutSecs: 90,
requestHandlerTimeoutSecs: 180

Session Pooling

useSessionPool: true,
sessionPoolOptions: {
    maxPoolSize: 20,
    sessionOptions: {
        maxUsageCount: 10
    }
}

Troubleshooting

Google CAPTCHA

Issue: Google shows CAPTCHA Solution:

• RESIDENTIAL proxies are auto-configured
• Session rotation happens automatically
• 5 retries with different IPs

No Results Found

Issue: 0 websites extracted Solution:

• Try Bing instead of Google
• Use more specific search query
• Increase maxResults parameter

Missing Emails

Issue: Some websites return no emails Solution:

• Actor visits up to 5 contact pages automatically
• Some sites hide emails in images (can't be extracted)
• Check 08_additionalInfo.error for extraction errors

Important Notes

Data Limits

• NO LIMIT on emails - returns all found
• NO LIMIT on phone numbers - returns all found
• NO LIMIT on social media links - returns all per platform
• 5 contact pages max visited per website
• 5 blog posts max per website

Rate Limiting

• Random 2-5 second delays between requests
• Concurrency limited to 2 for stability
• Session rotation every 10 requests
• Automatic retry with new IP on failure

Best Practices

1. Start with Bing for testing (no proxy needed)
2. Use specific search queries for better results
3. For 100+ results, use maxResults carefully
4. Check dataset quality before scaling up

What Makes This Actor Special

1. Truly Universal - Works in ANY language automatically
2. No Limits - Returns ALL emails, phones, and social links found
3. 9 Social Platforms - Most comprehensive social media extraction
4. Smart Contact Detection - Finds contact pages in any language
5. Anti-CAPTCHA - Session pooling with 20 rotating IPs
6. Battle-Tested - Scales to 200 results reliably

License

ISC

---

Built for universal data extraction across all languages and countries