# LinkedIn Profile Scraper (`mighty_monk/linkedin-profile-scraper`) Actor Scrape public LinkedIn profiles without login when data is public. Extract name, headline, location, about, experience, education, skills, connections, and current company/title for GTM and lead enrichment. - **URL**: https://apify.com/mighty\_monk/linkedin-profile-scraper.md - **Developed by:** [Harsh](https://apify.com/mighty_monk) (community) - **Categories:** Lead generation, Social media - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## LinkedIn Profile Scraper **Scrape public LinkedIn profile data** for GTM, outbound, and lead enrichment — **name, headline, location, about, experience, education, skills, connections, and current company/title**. Built with **TypeScript** and **Crawlee CheerioCrawler** (HTTP-first, no browser) using multi-strategy extraction (JSON-LD, meta tags, public DOM, embedded state). Run it on the [Apify platform](https://apify.com) for scheduling, API access, **residential proxy rotation**, monitoring, and dataset exports (JSON, CSV, Excel, HTML). > **Legal / ToS notice:** This Actor is intended for **publicly available data only**. It does **not** log into LinkedIn. Respect [LinkedIn Terms of Service](https://www.linkedin.com/legal/user-agreement), robots rules, and applicable privacy laws (GDPR/CCPA). Do not use this tool to scrape private content, bypass authentication, or harass people. You are responsible for how you use the data. ### What does LinkedIn Profile Scraper do? Given a list of LinkedIn profile URLs, this Actor: 1. **Deduplicates** profile URLs (case-insensitive `/in/` slugs) 2. Loads each public profile page over HTTP (Cheerio — no headless browser) 3. Extracts **profile fields**: full name, headline, location, about/summary, current company & title, connections/followers text, profile ID when present 4. Extracts **experience**, **education**, and **skills** when they appear in public HTML / structured data 5. Handles **auth walls, blocks, and missing profiles gracefully** — writes a dataset row with an `error` field and **exits 0** 6. Pushes clean JSON dataset items 7. Exports **PROFILES.csv** and **SUMMARY.md** to the key-value store Ideal for **outbound / GTM stacks**, warm-lead enrichment, and CRM backfill where Apollo-style profile data is needed at scale. ### Why use LinkedIn Profile Scraper? - **Lead enrichment** — turn `/in/` URLs into structured person records for your CRM - **Outbound research** — pull headlines, current roles, and locations before personalizing emails - **Talent & market intel** — sample public experience and skills for role mapping - **Automation-ready** — JSON dataset + CSV export + Apify API, schedules, and webhooks ### Proxy necessity (important) **LinkedIn aggressively rate-limits and auth-walls unauthenticated traffic**, especially from datacenter IPs. For production runs: | Setting | Recommendation | | ------- | -------------- | | Proxy | **Apify Proxy RESIDENTIAL** (default in input schema) | | `maxConcurrency` | `1`–`2` | | `requestDelayMs` | `1500`–`3000`+ | | `maxRequestRetries` | `3`+ | Without residential proxies you will often see sign-in walls or empty shells. The Actor detects these and writes an `error` on the profile record instead of crashing the run. **Data depth note:** Public / guest LinkedIn HTML is **limited**. Full experience histories, complete skills graphs, and connection counts beyond “500+” often require a logged-in session — which this Actor intentionally does **not** use. You get what LinkedIn exposes publicly for that URL/IP. ### How to scrape LinkedIn profiles 1. Open the Actor in [Apify Console](https://console.apify.com) 2. Paste one or more profile URLs (e.g. `https://www.linkedin.com/in/williamhgates/`) 3. Keep **residential proxy** enabled 4. Click **Start** 5. Download results from the **Dataset** tab or key-value store (`PROFILES.csv`, `SUMMARY.md`) ### Input | Field | Type | Default | Description | | ----- | ---- | ------- | ----------- | | `profileUrls` | string[] | `[]` (required) | LinkedIn `/in/` profile URLs (deduped) | | `maxConcurrency` | integer | `2` | Concurrent requests (keep low) | | `maxRequestRetries` | integer | `3` | HTTP retry count | | `requestDelayMs` | integer | `1500` | Used for rate limiting | | `proxyConfiguration` | object | Residential on | Apify Proxy settings | Example: ```json { "profileUrls": [ "https://www.linkedin.com/in/williamhgates/", "https://www.linkedin.com/in/satyanadella/" ], "maxConcurrency": 2, "maxRequestRetries": 3, "requestDelayMs": 1500, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ```` See also [`examples/input.json`](./examples/input.json). ### Output Each dataset item is one profile: ```json { "fullName": "Jane Doe", "headline": "Senior Software Engineer at Acme Corp", "location": "San Francisco Bay Area", "about": "Builder of reliable data platforms...", "currentCompany": "Acme Corp", "currentTitle": "Senior Software Engineer", "profileUrl": "https://www.linkedin.com/in/jane-doe", "profileId": "123456789", "connectionsText": "500+ connections", "followersText": "12K followers", "experience": [ { "title": "Senior Software Engineer", "company": "Acme Corp", "companyUrl": "https://www.linkedin.com/company/acme-corp", "location": "San Francisco, CA", "dateRange": "Jan 2022 – Present · 3 yrs", "description": "Building core data APIs and event pipelines.", "isCurrent": true } ], "education": [ { "school": "Stanford University", "schoolUrl": "https://www.linkedin.com/school/stanford-university", "degree": "Master of Science", "fieldOfStudy": "Computer Science", "dateRange": "2016 – 2018", "description": null } ], "skills": ["TypeScript", "Node.js", "Distributed Systems"], "scrapedAt": "2026-07-18T12:00:00.000Z", "error": null } ``` You can download the dataset in **JSON, HTML, CSV, Excel**, and other formats from the Apify Console. #### Data fields | Field | Description | | ----- | ----------- | | `fullName` | Display name | | `headline` | Profile headline | | `location` | Location text when public | | `about` | About / summary section | | `currentCompany` | Current employer (experience or headline) | | `currentTitle` | Current title (experience or headline) | | `profileUrl` | Canonical `/in/` URL | | `profileId` | Member ID when detectable | | `connectionsText` | e.g. `500+ connections` | | `followersText` | Followers caption when public | | `experience` | Array of roles | | `education` | Array of schools | | `skills` | Skill name strings | | `scrapedAt` | ISO timestamp | | `error` | Non-null on block / not found / failure | ### How much does it cost to scrape LinkedIn profiles? This Actor uses **Pay-per-event (PPE)** pricing: - **Actor start**: small fixed fee per run - **Profile result**: **$0.005** per dataset item (`apify-default-dataset-item`) Example: **200 profiles ≈ $1.00** (plus start event and platform compute / proxy). Free Apify tier credits apply as usual. Residential proxy usage is billed separately by Apify Proxy. ### Tips for better results - Prefer **canonical** `https://www.linkedin.com/in/{slug}/` URLs - Keep **concurrency low** and **delay high** when batching hundreds of profiles - Use **residential proxies**; rotate or retry profiles that return auth walls - Expect **partial public data** — LinkedIn often hides long experience lists from guests - Deduplication is automatic; safe to re-submit overlapping URL lists - Failed / blocked profiles still produce a row with `error` so your pipeline can retry later ### FAQ, disclaimers, and support **Does this Actor log into LinkedIn?**\ No. It only requests public profile HTML. No cookies, no credentials, no session takeover. **Why are many fields null?**\ LinkedIn frequently serves auth walls or thin public cards. Enable residential proxies, lower concurrency, and retry. Some profiles simply do not expose experience/skills to guests. **Is scraping LinkedIn legal?**\ Laws vary by jurisdiction and use case. Public data scraping can still violate site ToS. Consult counsel for your use case. This tool is provided as-is for legitimate research and enrichment of publicly available information. **Can you build a custom solution?**\ Yes — open an Issue on the Actor page or contact the developer for higher-volume pipelines, logged-in enterprise connectors (where permitted), or CRM integrations. **Feedback**\ Use the **Issues** tab on the Apify Store Actor page for bugs and feature requests. ### Local development ```bash npm install npm run lint npm run format npm run build npm test apify run --purge ``` Copy `examples/input.json` into `storage/key_value_stores/default/INPUT.json` for local runs. ### Deploy ```bash apify login apify push ``` ### Project structure ``` .actor/ Actor config + input/output/dataset schemas src/ main.ts Entry point (CheerioCrawler) routes.ts Profile page router + sanitization extractors.ts JSON-LD / meta / DOM / embedded JSON extractors utils.ts URL helpers, block detection, text utils csv.ts PROFILES.csv + SUMMARY.md exporters types.ts TypeScript types test/ fixtures/ HTML fixtures for unit tests extractors.test.ts main.test.ts examples/ Sample input/output ``` ### License Apache-2.0 # Actor input Schema ## `profileUrls` (type: `array`): One or more public LinkedIn profile URLs (e.g. https://www.linkedin.com/in/williamhgates/). Duplicates are removed automatically. Bare /in/ slugs are also accepted. ## `maxConcurrency` (type: `integer`): Maximum number of concurrent HTTP requests. Keep low (1–3) to reduce LinkedIn rate limits and auth walls. ## `maxRequestRetries` (type: `integer`): How many times to retry a failed HTTP request before giving up. ## `requestDelayMs` (type: `integer`): Approximate delay between requests used to compute rate limiting (max requests per minute). ## `proxyConfiguration` (type: `object`): Apify Proxy settings. Residential proxies are strongly recommended for LinkedIn. ## Actor input object example ```json { "profileUrls": [ "https://www.linkedin.com/in/williamhgates/" ], "maxConcurrency": 2, "maxRequestRetries": 3, "requestDelayMs": 1500, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `dataset` (type: `string`): No description ## `profilesCsv` (type: `string`): No description ## `summary` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "profileUrls": [ "https://www.linkedin.com/in/williamhgates/" ] }; // Run the Actor and wait for it to finish const run = await client.actor("mighty_monk/linkedin-profile-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "profileUrls": ["https://www.linkedin.com/in/williamhgates/"] } # Run the Actor and wait for it to finish run = client.actor("mighty_monk/linkedin-profile-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "profileUrls": [ "https://www.linkedin.com/in/williamhgates/" ] }' | apify call mighty_monk/linkedin-profile-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=mighty_monk/linkedin-profile-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "LinkedIn Profile Scraper", "description": "Scrape public LinkedIn profiles without login when data is public. Extract name, headline, location, about, experience, education, skills, connections, and current company/title for GTM and lead enrichment.", "version": "1.0", "x-build-id": "n00WOhK9uVsGF27C2" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/mighty_monk~linkedin-profile-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-mighty_monk-linkedin-profile-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/mighty_monk~linkedin-profile-scraper/runs": { "post": { "operationId": "runs-sync-mighty_monk-linkedin-profile-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/mighty_monk~linkedin-profile-scraper/run-sync": { "post": { "operationId": "run-sync-mighty_monk-linkedin-profile-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "profileUrls" ], "properties": { "profileUrls": { "title": "LinkedIn profile URLs", "type": "array", "description": "One or more public LinkedIn profile URLs (e.g. https://www.linkedin.com/in/williamhgates/). Duplicates are removed automatically. Bare /in/ slugs are also accepted.", "default": [], "items": { "type": "string" } }, "maxConcurrency": { "title": "Max concurrency", "minimum": 1, "maximum": 20, "type": "integer", "description": "Maximum number of concurrent HTTP requests. Keep low (1–3) to reduce LinkedIn rate limits and auth walls.", "default": 2 }, "maxRequestRetries": { "title": "Max request retries", "minimum": 0, "maximum": 10, "type": "integer", "description": "How many times to retry a failed HTTP request before giving up.", "default": 3 }, "requestDelayMs": { "title": "Request delay (ms)", "minimum": 0, "maximum": 30000, "type": "integer", "description": "Approximate delay between requests used to compute rate limiting (max requests per minute).", "default": 1500 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Apify Proxy settings. Residential proxies are strongly recommended for LinkedIn.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```