# LinkedIn Public Pages Scraper (`moving_beacon-owner1/my-actor-91`) Actor Scrape public LinkedIn profiles, companies, jobs, and articles without any API. Built with httpx + parsel and powered by Apify Residential Proxy for reliable, scalable data extraction. - **URL**: https://apify.com/moving\_beacon-owner1/my-actor-91.md - **Developed by:** [Jamshaid Arif](https://apify.com/moving_beacon-owner1) (community) - **Categories:** Developer tools, Jobs, Lead generation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## LinkedIn Public Pages Scraper — Apify Actor Scrapes public LinkedIn data — profiles, company pages, job listings, job search results, and articles — without any third-party scraping API. Uses **Apify Proxy (RESIDENTIAL group)** for IP rotation ### Modes | Mode | Input | What you get | |------|-------|--------------| | `profile` | List of `linkedin.com/in//` URLs | JSON-LD `Person` schema + public posts | | `company` | List of `linkedin.com/company//` URLs | Organization microdata + "About us" fields + leaders/affiliated pages (fetches the `/life` sub-page automatically) | | `job` | List of `linkedin.com/jobs/view/` URLs | JSON-LD `JobPosting` schema + description bullets | | `article` | List of `linkedin.com/pulse/` URLs | JSON-LD `Article` schema + full article body | | `jobSearch` | `searchKeyword` + `searchLocation` + `maxSearchPages` | Paginated list of jobs (25 per page) | ### Input example ```json { "mode": "profile", "startUrls": [ { "url": "https://www.linkedin.com/in/williamhgates/" }, { "url": "https://www.linkedin.com/in/satyanadella/" } ], "maxConcurrency": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ```` ```json { "mode": "jobSearch", "searchKeyword": "python developer", "searchLocation": "San Francisco, CA", "maxSearchPages": 4, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ``` ### Output Each scraped item is pushed to the actor's default dataset with the shape: ```json { "mode": "profile", "url": "https://www.linkedin.com/in/williamhgates/", "data": { "profile": { "@type": "Person", "name": "Bill Gates", "...": "..." }, "posts": [ ... ] } } ``` Failed fetches land in the same dataset with `error: "fetch_failed"` and `data: null` so you can audit coverage and re-run only the failures. ### Proxy — important LinkedIn aggressively blocks datacenter IPs and will return HTTP 999 ("please log in") on the first few requests from a fresh IP. Set `apifyProxyGroups: ["RESIDENTIAL"]` — this costs more than the default proxy group but is effectively required. Without it, expect empty results. If you still see blocks with RESIDENTIAL, try: - Lower `maxConcurrency` to 1 or 2. - Slower is better — LinkedIn tracks velocity per IP. - Split your URL list into smaller runs spread across hours. # Actor input Schema ## `mode` (type: `string`): Which type of LinkedIn page to scrape. ## `startUrls` (type: `array`): LinkedIn URLs to scrape. Used for all modes except 'jobSearch'. Example: https://www.linkedin.com/in/williamhgates/ ## `searchKeyword` (type: `string`): Job title / keyword to search for. Required if mode is 'jobSearch'. ## `searchLocation` (type: `string`): Location filter for the job search. Required if mode is 'jobSearch'. ## `maxSearchPages` (type: `integer`): How many pages of search results to scrape (25 jobs per page). ## `maxConcurrency` (type: `integer`): How many pages to scrape in parallel. Keep low for LinkedIn — aggressive concurrency triggers blocks. ## `proxyConfiguration` (type: `object`): Apify Proxy settings. RESIDENTIAL is strongly recommended — LinkedIn hard-blocks datacenter IPs. ## Actor input object example ```json { "mode": "profile", "startUrls": [ { "url": "https://www.linkedin.com/in/williamhgates/" } ], "searchKeyword": "python developer", "searchLocation": "San Francisco, CA", "maxSearchPages": 2, "maxConcurrency": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.linkedin.com/in/williamhgates/" } ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("moving_beacon-owner1/my-actor-91").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.linkedin.com/in/williamhgates/" }], "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("moving_beacon-owner1/my-actor-91").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.linkedin.com/in/williamhgates/" } ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call moving_beacon-owner1/my-actor-91 --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=moving_beacon-owner1/my-actor-91", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "LinkedIn Public Pages Scraper", "description": "Scrape public LinkedIn profiles, companies, jobs, and articles without any API. Built with httpx + parsel and powered by Apify Residential Proxy for reliable, scalable data extraction.", "version": "0.0", "x-build-id": "IUx6x3eiVrHU2lAkw" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/moving_beacon-owner1~my-actor-91/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-moving_beacon-owner1-my-actor-91", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/moving_beacon-owner1~my-actor-91/runs": { "post": { "operationId": "runs-sync-moving_beacon-owner1-my-actor-91", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/moving_beacon-owner1~my-actor-91/run-sync": { "post": { "operationId": "run-sync-moving_beacon-owner1-my-actor-91", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode", "proxyConfiguration" ], "properties": { "mode": { "title": "Scrape mode", "enum": [ "profile", "company", "job", "article", "jobSearch" ], "type": "string", "description": "Which type of LinkedIn page to scrape.", "default": "profile" }, "startUrls": { "title": "Start URLs", "type": "array", "description": "LinkedIn URLs to scrape. Used for all modes except 'jobSearch'. Example: https://www.linkedin.com/in/williamhgates/", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "searchKeyword": { "title": "Search keyword (jobSearch mode)", "type": "string", "description": "Job title / keyword to search for. Required if mode is 'jobSearch'." }, "searchLocation": { "title": "Search location (jobSearch mode)", "type": "string", "description": "Location filter for the job search. Required if mode is 'jobSearch'." }, "maxSearchPages": { "title": "Max search pages (jobSearch mode)", "minimum": 1, "maximum": 40, "type": "integer", "description": "How many pages of search results to scrape (25 jobs per page).", "default": 2 }, "maxConcurrency": { "title": "Max concurrency", "minimum": 1, "maximum": 10, "type": "integer", "description": "How many pages to scrape in parallel. Keep low for LinkedIn — aggressive concurrency triggers blocks.", "default": 3 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Apify Proxy settings. RESIDENTIAL is strongly recommended — LinkedIn hard-blocks datacenter IPs." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```