LinkedIn Profile & Company Scraper

This powerful Apify actor efficiently scrapes both LinkedIn profile URLs and company pages, delivering comprehensive results at scale.

Features

• High-Volume Results: Generates 300-400 unique LinkedIn URLs per run
• Dual Scraping Modes: Scrape either LinkedIn profiles or company pages
• Optimized Performance: 10-15 high-quality results per page
• Advanced Stealth: Enterprise-grade anti-detection measures
• Smart Proxy Management: Automated proxy rotation and optimization
• Reliable Error Handling: Automatic recovery with detailed debugging
• Structured Data Storage: Clean, organized results in Apify dataset

Input Configuration

The actor accepts the following input parameters:

• searchType (string): Choose between "people" or "company" to scrape either LinkedIn profiles or company pages
• profession (string): For people: job title to search for (e.g., "software engineer"). For companies: industry or type (e.g., "tech startup")
• country (string): The country to search in (e.g., "United States", "Canada")
• maxPages (integer): Maximum number of search result pages to crawl (1-50, default: 10)
• delayMs (integer): Delay between requests (1000-10000ms, default: 2000)
• useProxy (boolean): Whether to use Apify's proxy service (default: true)
• proxyCountry (string): Country code for proxy servers (default: "US")

Output

The actor saves data to an Apify dataset with the following structure for each LinkedIn profile found:

{
  "url": "https://www.linkedin.com/in/john-doe-123456",
  "profession": "software engineer",
  "country": "United States",
  "foundOnPage": 1,
  "timestamp": "2024-01-15T10:30:00.000Z"
}

A summary is also saved to the key-value store under the key SUMMARY containing:

• Total number of profiles found
• Search parameters used
• Complete list of all profile URLs
• Completion timestamp

Important Notes

Legal Considerations

• This scraper only collects publicly available LinkedIn profile URLs
• It does not access private profile information
• Ensure compliance with LinkedIn's Terms of Service and applicable laws
• Consider rate limiting and respectful scraping practices

Rate Limiting

• The scraper includes built-in delays between requests
• Uses residential proxies to avoid IP blocking
• Implements realistic browser behavior to reduce detection

Troubleshooting

• If you encounter CAPTCHAs, try increasing the delay between requests
• Use residential proxies for better success rates
• Check the screenshots saved on errors for debugging
• Monitor the logs for detailed execution information

Support

For issues and questions:

• Check the Apify documentation: https://docs.apify.com/
• Review the actor logs for error details
• Ensure your input parameters are valid
• Consider adjusting delays if encountering rate limits