# Glassdoor Jobs Scraper (`jobscrawler/glassdoor-jobs-scraper`) Actor Extract job listings and company insights from Glassdoor, the leading employer review and job search platform. - **URL**: https://apify.com/jobscrawler/glassdoor-jobs-scraper.md - **Developed by:** [Jobs Scraper](https://apify.com/jobscrawler) (community) - **Categories:** Jobs, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $3.99 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Glassdoor Jobs Scraper ### Overview Penetrate Glassdoor's combined job search and employer review platform to extract employment data enriched with company insights. This actor gathers job listings alongside employer ratings, salary transparency data, and workplace culture indicators from one of the most trusted career research destinations. ### Features - Job listings paired with employer review scores - Glassdoor salary estimates and reported compensation - Company culture and work-life balance indicators - Interview process insights from employee reviews - Proxy rotation with automatic fallback (residential → datacenter) - CAPTCHA detection and session rotation - Automatic retry on failures with exponential backoff - Deduplication of results by application URL - Dataset validation with auto-fix capability ### Supported Inputs | Field | Type | Default | Description | |-------|------|---------|-------------| | `keyword` | string | `"software engineer"` | Search terms for job discovery | | `location` | string | `""` | Geographic filter for results | | `country` | string | `"US"` | Country code for proxy routing | | `maxItems` | integer | `50` | Upper limit on extracted listings | | `proxyEnabled` | boolean | `true` | Toggle proxy rotation on/off | | `sortBy` | string | `"relevance"` | Result ordering (relevance/date/salary) | | `jobType` | string | `""` | Employment type filter | | `experienceLevel` | string | `""` | Seniority level filter | | `datePosted` | string | `""` | Recency filter (24h/3d/7d/14d/30d) | | `remoteOnly` | boolean | `false` | Restrict to remote positions only | | `includeCompanyDetails` | boolean | `true` | Fetch extra company information | | `includeSalary` | boolean | `true` | Include compensation data | ### Output Format Each scraped listing produces a JSON object with these fields: ```json { "jobTitle": "Senior Software Engineer", "companyName": "Example Corp", "location": "US", "salary": "$120,000 - $160,000", "jobType": "Full-time", "experienceLevel": "Senior", "postedDate": "2 days ago", "applyUrl": "https://www.glassdoor.com/job/12345", "companyUrl": "https://www.glassdoor.com/company/example", "description": "We are looking for a skilled engineer...", "requirements": ["JavaScript", "Node.js", "React"], "benefits": ["Health Insurance", "Remote Work"], "sourcePortal": "Glassdoor", "country": "US", "scrapedAt": "2025-01-15T10:30:00.000Z" } ```` ### Proxy Handling Proxy management follows a graduated fallback pattern for optimal success rates. 1. **Apify Residential Proxy** (country-targeted) — First choice for Glassdoor 2. **Apify Residential Proxy** (any region) — Fallback if country proxy unavailable 3. **Apify Datacenter Proxy** — Secondary fallback for cost efficiency 4. **Direct Connection** — Last resort when all proxies fail Proxies auto-rotate on each request. Blocked sessions are discarded and replaced automatically. ### Retry Logic Built-in resilience retries unsuccessful requests with new proxy identities. - Maximum 5 retries per request - Fresh browser session on each retry - Automatic proxy rotation between attempts - Blocked status codes (401, 403, 429) trigger session refresh - Configurable request timeout (120 seconds) ### Anti-block Handling Advanced evasion methods reduce the likelihood of being flagged as automated. - `navigator.webdriver` property masked - Human-like delays between page interactions (2–5 seconds) - Browser language and plugin fingerprints normalised - Session pool with automatic rotation on blocks - CAPTCHA detection with graceful retry - Rate limit detection (HTTP 429) with backoff ### Sample Input ```json { "keyword": "data analyst", "location": "US", "maxItems": 25, "proxyEnabled": true, "sortBy": "date", "remoteOnly": false } ``` ### Sample Output ```json { "jobTitle": "Data Analyst", "companyName": "TechCorp International", "location": "US", "salary": "Competitive", "jobType": "Full-time", "experienceLevel": "Mid-level", "postedDate": "1 day ago", "applyUrl": "https://www.glassdoor.com/job/example-123", "companyUrl": "", "description": "Seeking a detail-oriented data analyst to join our growing team...", "requirements": ["SQL", "Python", "Tableau"], "benefits": ["Health Insurance", "Flexible Hours"], "sourcePortal": "Glassdoor", "country": "US", "scrapedAt": "2025-01-15T14:22:00.000Z" } ``` ### Usage #### Local Development ```bash ## Install dependencies npm install ## Set Apify token (required for proxy) export APIFY_TOKEN=your_token_here ## Run the actor npm start ## Validate scraped data node dataset-validator.js ``` #### Apify Platform ```bash ## Login to Apify apify login ## Push actor to platform apify push ## Run from Apify Console or API ``` ### Deployment 1. Ensure all dependencies are installed: `npm install` 2. Authenticate with Apify: `apify login` 3. Deploy the actor: `apify push` 4. Configure input in the Apify Console 5. Schedule runs or trigger via API / webhooks ### Limitations - Results depend on the portal's current HTML structure; layout changes may require selector updates - Some job details (salary, benefits) may not be available for all listings - Rate limiting by the portal may reduce throughput during high-volume scrapes - CAPTCHA challenges may interrupt scraping on heavily protected pages - Glassdoor may modify their anti-bot measures, requiring periodic updates - Maximum items per run is capped at 1000 to prevent excessive resource usage - Proxy costs apply when using Apify residential or datacenter proxies # Actor input Schema ## `keyword` (type: `string`): Job title or keywords to search for. ## `location` (type: `string`): City, state, or region to search in. ## `country` (type: `string`): Country code or name. ## `maxItems` (type: `integer`): Maximum number of job listings to scrape. ## `proxyEnabled` (type: `boolean`): Enable proxy rotation for anti-blocking. ## `sortBy` (type: `string`): Sort order for results. ## `jobType` (type: `string`): Filter by employment type (full-time, part-time, contract, etc.). ## `experienceLevel` (type: `string`): Filter by seniority (entry, mid, senior, etc.). ## `datePosted` (type: `string`): Filter by posting recency. ## `remoteOnly` (type: `boolean`): Only return remote/work-from-home positions. ## `includeCompanyDetails` (type: `boolean`): Extract additional company information when available. ## `includeSalary` (type: `boolean`): Extract salary/compensation details when available. ## Actor input object example ```json { "keyword": "software engineer", "location": "", "country": "US", "maxItems": 50, "proxyEnabled": true, "sortBy": "relevance", "jobType": "", "experienceLevel": "", "datePosted": "", "remoteOnly": false, "includeCompanyDetails": true, "includeSalary": true } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("jobscrawler/glassdoor-jobs-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("jobscrawler/glassdoor-jobs-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call jobscrawler/glassdoor-jobs-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=jobscrawler/glassdoor-jobs-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Glassdoor Jobs Scraper", "description": "Extract job listings and company insights from Glassdoor, the leading employer review and job search platform.", "version": "1.0", "x-build-id": "XMQzDedXkGC0P2vWE" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/jobscrawler~glassdoor-jobs-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-jobscrawler-glassdoor-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/jobscrawler~glassdoor-jobs-scraper/runs": { "post": { "operationId": "runs-sync-jobscrawler-glassdoor-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/jobscrawler~glassdoor-jobs-scraper/run-sync": { "post": { "operationId": "run-sync-jobscrawler-glassdoor-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "keyword": { "title": "Search Keyword", "type": "string", "description": "Job title or keywords to search for.", "default": "software engineer" }, "location": { "title": "Location", "type": "string", "description": "City, state, or region to search in.", "default": "" }, "country": { "title": "Country", "type": "string", "description": "Country code or name.", "default": "US" }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of job listings to scrape.", "default": 50 }, "proxyEnabled": { "title": "Enable Proxy", "type": "boolean", "description": "Enable proxy rotation for anti-blocking.", "default": true }, "sortBy": { "title": "Sort By", "enum": [ "relevance", "date", "salary" ], "type": "string", "description": "Sort order for results.", "default": "relevance" }, "jobType": { "title": "Job Type", "type": "string", "description": "Filter by employment type (full-time, part-time, contract, etc.).", "default": "" }, "experienceLevel": { "title": "Experience Level", "type": "string", "description": "Filter by seniority (entry, mid, senior, etc.).", "default": "" }, "datePosted": { "title": "Date Posted", "enum": [ "", "24h", "3d", "7d", "14d", "30d" ], "type": "string", "description": "Filter by posting recency.", "default": "" }, "remoteOnly": { "title": "Remote Only", "type": "boolean", "description": "Only return remote/work-from-home positions.", "default": false }, "includeCompanyDetails": { "title": "Include Company Details", "type": "boolean", "description": "Extract additional company information when available.", "default": true }, "includeSalary": { "title": "Include Salary", "type": "boolean", "description": "Extract salary/compensation details when available.", "default": true } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```