Linkedin Email Sniper

1# linkedin Email & Profile Scraper Actor
2
3This Apify actor scrapes publicly available data from linkedin profiles, including usernames and potentially email addresses. **Important:** Due to linkedin's robust anti-scraping measures, directly scraping email addresses is extremely difficult and often impossible. This actor prioritizes ethical scraping practices and focuses on publicly accessible data. Be aware of linkedin's terms of service and `robots.txt` before using this actor. Scraping personal data without consent is unethical and potentially illegal.
4
5## Input
6
7The actor accepts the following input fields:
8
9*   **`keywords` (required):** An array of keywords to search for on linkedin. This is used to find relevant profiles. Example: `["photography", "travel", "food"]`
10*   **`locations` (optional):** An array of locations to refine the search. Example: `["New York", "London"]`
11*   **`gmail` (optional, default: `true`):** Include Gmail addresses in the search.
12*   **`yahoo` (optional, default: `true`):** Include Yahoo addresses in the search.
13*   **`outlook` (optional, default: `true`):** Include Outlook/Hotmail addresses in the search.
14*   **`aol` (optional, default: `true`):** Include AOL addresses in the search.
15*   **`icloud` (optional, default: `true`):** Include iCloud addresses in the search.
16*   **`protonmail` (optional, default: `true`):** Include ProtonMail addresses in the search.
17*   **`other` (optional, default: `false`):** Include addresses from other providers specified in `extraEmailProviders`.
18*   **`extraEmailProviders` (optional):** An array of additional email providers to include if `other` is `true`. Example: `["example.com", "another.net"]`
19*   **`maxProfiles` (optional, default: `100`):** The maximum number of profiles to scrape per keyword. This helps to avoid overwhelming the actor and respect linkedin's rate limits.
20
21Example input:
22
23```json
24{
25  "keywords": ["photography", "travel"],
26  "locations": ["New York", "London"],
27  "gmail": true,
28  "yahoo": false,
29  "outlook": true,
30  "aol": false,
31  "icloud": false,
32  "protonmail": false,
33  "other": false,
34  "extraEmailProviders": [],
35  "maxProfiles": 50
36}

Output

The actor outputs an array of objects, where each object represents an linkedin profile. The output includes the following fields (availability may vary depending on the profile's privacy settings and linkedin's restrictions):

• url: The URL of the linkedin profile.
• username: The username of the profile (if available).
• emails: An array of email addresses found on the profile (if available).
• ...other profile data: Other publicly available profile data that can be scraped (number of followers, bio, etc.). You will need to add the scraping logic for these in routes.js.

Example output:

1[
2  {
3    "url": "[https://www.linkedin.com/example_user/](https://www.linkedin.com/example_user/)",
4    "username": "example_user",
5    "emails": ["[email address removed]", "[email address removed]"]
6    // ... other data
7  },
8  {
9    "url": "[https://www.linkedin.com/another_user/](https://www.linkedin.com/another_user/)",
10    "username": "another_user",
11    "emails": [] // Or null if no emails are found
12    // ... other data
13  }
14]

Usage

1. Install Apify CLI: If you don't have it already, install the Apify CLI: npm install -g apify-cli
2. Clone the Actor: Clone this repository (or create a new Apify actor and copy the code).
3. Install Dependencies: npm install
4. Run the Actor: apify run --purge --input '{"keywords": ["your_keywords"], "locations": ["your_locations"], "gmail": true, "yahoo": true, "outlook": true, "aol": true, "icloud": true, "protonmail": true, "other": false, "extraEmailProviders": [], "maxProfiles": 100}' (Replace the example input with your desired values). You can also provide the input via input.json file.
5. View Results: The results will be stored in the Apify dataset. You can view them using the Apify CLI or in the Apify Console.

Important Notes

• linkedin's Anti-Scraping: linkedin actively blocks scraping. Directly scraping email addresses is extremely difficult and often impossible. This actor focuses on publicly available profile information, but even that might be restricted by linkedin.
• Ethical Considerations: Always respect linkedin's terms of service and robots.txt. Scraping personal data without consent is unethical and potentially illegal. Use this actor responsibly.
• Rate Limiting: Be mindful of linkedin's rate limits. Implement delays and error handling to avoid being blocked.
• Selector Adjustments: The HTML structure of linkedin and Google Search can change, which may require you to update the CSS selectors in routes.js to extract the desired data. Use your browser's developer tools to inspect the HTML and find the correct selectors.
• Proxies: Using proxies is highly recommended to avoid IP bans. The actor is configured to use the Apify proxy by default. You can configure your own proxies if needed.
• Email Extraction Limitations: Even if emails are found, their accuracy and validity are not guaranteed. They could be outdated or fake.

Disclaimer

This actor is provided for educational purposes only. The author is not responsible for any misuse of this actor. Use this actor at your own risk. Always comply with linkedin's terms of service and respect users' privacy.