LinkedIn Multi-Functional Scraper

Overview

LinkedIn Multi-Functional Scraper: The Ultimate All-in-One Solution

🚀 Transform Your LinkedIn Data Collection

Tired of juggling multiple scrapers and paying excessive fees? Meet the LinkedIn Multi-Functional Scraper - your comprehensive solution for extracting profiles, companies, posts, messages, reactions, and comments from LinkedIn, all in one powerful package.

Save 84% on your LinkedIn data collection costs while getting more functionality!

💰 Unbeatable Value

• Traditional approach (separate scrapers): $125+/month
• Our all-in-one solution: Just $20/month
• Get more features, better integration, and superior support

✨ Key Features

🎯 Comprehensive Data Collection

• Profile Scraping: Complete professional details, experience, education, skills
• Company Data: Company information, employees, posts, analytics
• Post Collection: Content, reactions, comments, engagement metrics
• Message Extraction: Conversation details and participant information
• Reaction Analysis: Detailed engagement data and user interactions
• Comment Processing: Thread analysis and user engagement

🔄 Advanced Automation

• Webhook integration for real-time data processing
• Customizable operation parameters
• Flexible proxy configuration
• Batch processing capabilities
• Automated data export

🛠 Enterprise-Grade Capabilities

• Multiple operation types in single runs
• Advanced filtering options
• Customizable search parameters
• Detailed output formatting
• Rate limit handling
• Error recovery

💡 Perfect For

• Market Researchers: Gather comprehensive market intelligence
• Recruiters: Streamline talent sourcing and analysis
• Sales Teams: Generate qualified leads and insights
• Marketing Professionals: Track campaign performance and engagement
• Business Analysts: Collect data for strategic decision-making
• HR Professionals: Monitor employee engagement and company presence

🎮 Easy to Use

1. Configure your LinkedIn credentials
2. Define your operations
3. Set your parameters
4. Get comprehensive data

1{
2   "operations": [
3     {
4       "retrieval_type": "Post_Content",
5       "url": "https://linkedin.com/in/example-profile",
6       "days_to_go_back": 7,
7       "number_of_posts": 5
8     }
9   ]
10}

🔧 Powerful Configuration Options

Authentication

• Simple cookie-based authentication
• Secure credential handling
• Multiple session support

Operation Types

• Profile data extraction
• Company information gathering
• Post content collection
• Message retrieval
• Reaction analysis
• Comment processing

Advanced Filtering

• Geographic targeting
• Industry-specific filtering
• Network-level filtering
• Time-based parameters
• Language preferences

🔄 Seamless Integration

• Webhook support for automated workflows
• API integration capabilities
• Export to multiple formats
• Custom data processing options
• Real-time data streaming

💪 Why Choose Our Scraper?

1. Cost-Effective: Save over 80% compared to using multiple scrapers
2. Comprehensive: All LinkedIn data extraction needs in one tool
3. Reliable: Enterprise-grade infrastructure and support
4. Flexible: Customizable to your specific needs
5. Automated: Built for seamless integration with your workflows

🎯 Getting Started

1. Get your Apify token
2. Configure your LinkedIn credentials
3. Define your operations
4. Start collecting valuable data

📊 Sample Output

1{
2  "profiles": [
3    {
4      "firstName": "John",
5      "lastName": "Doe",
6      "headline": "Senior Developer",
7      "location": {
8        "country": "United States",
9        "city": "San Francisco"
10      }
11    }
12  ]
13}

🤝 Support & Resources

• Detailed documentation
• Technical support
• Regular updates
• Custom development options
• Community forum

🚀 Ready to Transform Your LinkedIn Data Collection?

Don't waste time and money on multiple scrapers. Get started with the LinkedIn Multi-Functional Scraper today and experience the power of comprehensive LinkedIn data extraction at an unbeatable price.

---

Note: Use this tool responsibly and ensure compliance with LinkedIn’s terms of service, as well as all relevant data protection regulations applicable in your region.

Need help or have questions? Create an issue on the actor's Issues tab in Apify Console or contact our support team.

---

Configuration

Input Fields

1. LinkedIn Session Cookie (cookie)

• Description: Your LinkedIn session cookies (li_at and JSESSIONID) are required for authentication.
• How to Retrieve:

  1. Log in to LinkedIn in your browser.

  2. Open Developer Tools (press F12 or right-click and select "Inspect").

  3. Navigate to the Application or Storage tab.

  4. Under Cookies, find the domain linkedin.com.

  5. Copy the value of the cookie named li_at.

  6. Repeat step 5 for JSESSIONID.

  • Example:

  1{
  2   "li_at": "Your li_at cookie",
  3   "JSESSIONID": "Your JSESSIONID cookie"
  4 }
  

2. Operations (operations)

• Description: A JSON array defining the operations the scraper should perform. Each operation specifies the retrieval type, URL, and optional parameters.

• Input Format:

  • The operations field expects a JSON array. Each item in the array is an object with the following properties:
    • retrieval_type (required): The type of operation. Must be one of:
      • "Post_Content": Retrieve posts from a profile.
      • "LinkedIn_Profile": Retrieve LinkedIn profile details.
      • "Company": Retrieve LinkedIn company details.
      • "Post_From_URL": Retrieve posts from a URL.
      • "Conversation_Detail": Retrieve conversation details from a profile. Also gets the profile of the person you are conversing with.
    • profile (required for Conversation_Detail): The LinkedIn URL of the profile to retrieve conversation details from.
    • url (required): The LinkedIn URL for the operation.
    • days_to_go_back (optional): Number of days to retrieve posts from (for Post_Content only). Default: 1.
    • number_of_posts (optional): Number of posts to retrieve (for Post_Content only). Default: 10.
    • number_of_comments (optional): Number of comments to retrieve (for Post_Content only). Default: 10.
    • number_of_reactions (optional): Number of reactions to retrieve (for Post_Content only). Default: 10.
    • keywords (optional): Keywords to search for (for Post_From_URL only).
    • extra_filters (optional): Extra filters to apply (for Post_From_URL only). Example: ",geoUrn->103644278,network->F".
    • number_of_search_pages (optional): Number of search pages to retrieve (for Post_From_URL only). Default: 1.
      • Note Due to the way LinkedIn batches the number of search pages can result in different numbers of posts being returned.

• Additional filters we are aware of are:

  • geoUrn: Filters results by geographic region. For example:
    • Europe: "103644278"
    • United States: "103644279" These URNs can be found by inspecting LinkedIn's network requests during region-specific searches.
  • industry: Filters results by industries using URN IDs. Examples include:
    • Technology: "104091591"
    • Finance: "104091587" You can find valid industry URNs by inspecting network requests or LinkedIn search results.
  • currentCompany: Filters by current employer using their URN. Example:
    • "urn:li:organization:123456" for a specific company. These URNs can be obtained from a company’s LinkedIn page.
  • pastCompany: Filters by past employers using their URNs (similar to currentCompany).
  • network: Filters by connection degree:
    • F: 1st-degree connections (direct connections).
    • S: 2nd-degree connections (connections of connections).
    • O: 3rd-degree connections and beyond.
  • profileLanguage: Filters by profile language. Examples include:
    • 'en': English
    • 'es': Spanish Specify the language code for filtering.
  • school: Filters by educational institutions using their URNs. Example:
    • "urn:li:fs_miniSchool:123456" for a specific school. These URNs can be obtained by inspecting LinkedIn profiles or school pages.
  • listed_at: Restricts results to posts made within a specific timeframe. Examples:
    • "86400": Last 24 hours (in seconds).
    • "604800": Last 7 days (in seconds).
  • connectionOf: Filters results to connections of a specified profile using their URN. Example:

    • "urn:li:fs_miniProfile:123456" to filter connections of a specific profile.

  • Note: We cannot guatanee the these filters are correct, you must verify if they are correct before using them.

• Example:

  1{
  2   "operations": [
  3     {
  4       "retrieval_type": "Post_Content",
  5       "url": "https://linkedin.com/in/example-profile",
  6       "days_to_go_back": 7,
  7       "number_of_posts": 5,
  8       "deep_search": true,
  9       "number_of_comments": 5,
  10       "number_of_reactions": 5
  11     },
  12     {
  13         "retrieval_type": "Post_From_URL",
  14         "keywords": "artificial intelligence",
  15         "extra_filters": ",geoUrn->103644278,network->F",
  16         "deep_search": true,
  17         "number_of_comments": 1,
  18         "number_of_reactions": 1,
  19         "number_of_search_pages": 1
  20     },
  21     {
  22       "retrieval_type": "Company",
  23       "url": "https://linkedin.com/company/example-company"
  24     },
  25     {
  26       "retrieval_type": "LinkedIn_Profile",
  27       "url": "https://linkedin.com/in/example-profile-2"
  28     },
  29     {
  30       "retrieval_type": "Conversation_Detail",
  31       "profile": "https://linkedin.com/in/example-profile"
  32     }
  33   ]
  34 }
  

3. Proxy Configuration (proxyConfiguration)

• Description: Configure proxy settings for the scraper.
• Fields:
  • useApifyProxy: Use Apify Proxy for requests. Default: true.
  • apifyProxyCountry: Specify a preferred country for Apify proxies. Example: "US".

4. Timeout (timeout)

• Description: Maximum time (in seconds) to wait for each operation. Default: 30.

5. Apify Token (apifyToken)

• Description: Your Apify API token. If not provided here, the token must be set in the APIFY_TOKEN environment variable.

6. Webhook URLs (webHookUrls)

• Description: A list of URLs that will be called when the scraper completes its operation. Each webhook will receive the scraping results in JSON format.
• Type: Array of strings
• Optional: Yes
• Example:

  1{
  2  "webHookUrls": [
  3    "https://example.com/webhook1",
  4    "https://example.com/webhook2"
  5  ]
  6}
  

7. Include Raw Data (include_raw_data)

• Description: Optional boolean parameter to include the complete raw data in the output
• Default: false
• Example:

  1{
  2  "include_raw_data": true
  3}
  

• Use Case: Useful for accessing additional data fields not included in the standard cleaned structure or for debugging purposes

---

Full Example Input

1{
2  "cookie": {
3    "li_at": "AQEDAS8C5QoFE-KwAAABjLU1NbIAAAGM2UG5sk4AKQeJJk...",
4    "JSESSIONID": "ajax:8537563245245"
5  },
6  "proxyConfiguration": {
7    "useApifyProxy": true,
8    "apifyProxyCountry": "US",
9    "apifyProxyGroups": ["RESIDENTIAL"]
10  },
11  "minWaitTime": 10,
12  "maxWaitTime": 30,
13  "include_raw_data": false,
14  "webhookUrls": ["https://your-webhook.com/endpoint"],
15  "apifyToken": "your_apify_token",
16  "include_raw_data": false,
17  "operations": {
18    "operations": [
19          {
20            "retrieval_type": "Post_Content",
21            "url": "https://linkedin.com/in/example-profile",
22            "days_to_go_back": 7,
23            "number_of_posts": 10,
24            "number_of_comments": 5,
25            "number_of_reactions": 5,
26            "deepSearch": false
27          },
28          {
29            "retrieval_type": "Company",
30            "url": "https://linkedin.com/company/example-company"
31          },
32          {
33            "retrieval_type": "LinkedIn_Profile",
34            "url": "https://linkedin.com/in/example-profile"
35          },
36          {
37            "retrieval_type": "Post_From_URL",
38            "keywords": "software engineer",
39            "extra_filters": ",geoUrn->103644278,network->F",
40            "number_of_search_pages": 1,
41            "number_of_comments": 5,
42            "number_of_reactions": 5,
43            "deepSearch": false
44          },
45          {
46            "retrieval_type": "Conversation_Detail",
47            "profile": "https://linkedin.com/in/example-profile"
48          }
49        ]
50      }
51}

Example Output

1{
2  "profiles": [
3    {
4      "profileUrn": "",
5      "profileId": "",
6      "firstName": "",
7      "lastName": "",
8      "headline": "",
9      "summary": "",
10      "location": {
11        "country": "",
12        "city": ""
13      },
14      "experience": [
15        {
16          "title": "",
17          "companyName": "",
18          "description": null,
19          "linkedinCompanyURN": null,
20          "dateRange": {
21            "startDate": {
22              "month": null,
23              "year": null
24            },
25            "endDate": {
26              "month": null,
27              "year": null
28            }
29          }
30        }
31      ],
32      "education": [
33        {
34          "schoolName": "",
35          "degreeName": null,
36          "fieldOfStudy": null,
37          "dateRange": {
38            "startYear": null,
39            "endYear": null
40          }
41        }
42      ],
43      "skills": [],
44      "languages": [
45        {
46          "name": "",
47          "proficiency": ""
48        }
49      ],
50      "certifications": [
51        {
52          "name": "",
53          "authority": "",
54          "date": {
55            "startDate": null,
56            "endDate": null
57          }
58        }
59      ],
60      "publications": [],
61      "volunteer": [],
62      "honours": [],
63      "projects": [
64        {
65          "title": "",
66          "description": "",
67          "dateRange": {
68            "startDate": {
69              "month": null,
70              "year": null
71            },
72            "endDate": {
73              "month": null,
74              "year": null
75            }
76          }
77        }
78      ],
79      "contactDetails": {
80        "email": "",
81        "websites": [
82          {
83            "url": "",
84            "label": ""
85          }
86        ],
87        "phoneNumbers": [
88          {
89            "type": "",
90            "number": ""
91          }
92        ]
93      },
94      "privacyDetails": {
95        "messagingTypingIndicators": "",
96        "allowOpenProfile": false,
97        "profilePictureVisibilitySetting": "",
98        "entityUrn": "",
99        "showPublicProfile": false,
100        "showPremiumSubscriberBadge": false,
101        "publicProfilePictureVisibilitySetting": "",
102        "formerNameVisibilitySetting": "",
103        "messagingSeenReceipts": "",
104        "allowProfileEditBroadcasts": false,
105        "$type": ""
106      },
107      "industry": "",
108      "profilePicture": {
109        "small": "",
110        "large": ""
111      }
112    }
113  ],
114  "posts": [
115    {
116      "postUrn": "",
117      "profileId": "",
118      "author": {
119        "firstName": "",
120        "lastName": "",
121        "headline": "",
122        "profileUrn": null
123      },
124      "content": "",
125      "publishedDate": null,
126      "stats": {
127        "numLikes": 0,
128        "numComments": 0,
129        "numShares": 0
130      },
131      "reactions": [
132        {
133          "reactionType": "",
134          "reactor": {
135            "firstName": "",
136            "lastName": ""
137          },
138          "reactorProfileUrl": ""
139        }
140      ],
141      "comments": [
142        {
143          "author": {
144            "firstName": "",
145            "lastName": ""
146          },
147          "commenterProfileUrl": "",
148          "text": "",
149          "timeOffset": -1
150        }
151      ]
152    }
153  ],
154  "companies": [
155    {
156      "companyUrn": "",
157      "name": "",
158      "tagline": "",
159      "description": "",
160      "industry": "",
161      "companySize": {
162        "min": null,
163        "max": null
164      },
165      "locations": [
166        {
167          "city": "",
168          "country": "",
169          "isHeadquarter": false
170        }
171      ],
172      "specialities": [],
173      "website": "",
174      "foundedYear": null
175    }
176  ],
177  "conversationDetail": [
178    {
179      "conversation_id": "",
180      "messages": [
181        {
182          "message_id": "",
183          "timestamp": 0,
184          "sender": {
185            "firstName": "",
186            "lastName": "",
187            "profileId": "",
188            "occupation": ""
189          },
190          "message": "",
191          "previous_message_id": "",
192          "reactions": []
193        }
194      ],
195      "metadata": {
196        "participants": [
197          {
198            "firstName": "",
199            "lastName": "",
200            "profileId": "",
201            "occupation": ""
202          }
203        ],
204        "total_messages": 0,
205        "unread_count": 0,
206        "last_activity": 0,
207        "group_chat": false,
208        "read": true
209      }
210    }
211  ]
212}

📜 Legal Disclaimer

This software is provided "as is," without warranty of any kind, express or implied, including but not limited to warranties of merchantability, fitness for a particular purpose, or non-infringement. The authors and contributors shall not be held liable for any claim, damages, or other liabilities arising from the use of this software.

By using this tool, you acknowledge that:

• You are solely responsible for how you use this software.
• You must comply with LinkedIn's Terms of Service and all applicable data protection laws (such as GDPR, CCPA, or other regional regulations).
• You must not use this tool for unlawful or unethical purposes, including unauthorized data scraping.
• The data accessible through this tool is limited by LinkedIn's visibility settings and the permissions of the LinkedIn account used.
• This project is not affiliated with, endorsed by, or connected to LinkedIn Corporation in any way.
• The availability and structure of data may change without notice due to LinkedIn platform updates.

The maintainers of this project do not endorse or encourage any misuse of LinkedIn’s platform. Use at your own risk.