# Job Boards Scraper (`ahmed_hrid/job-boards-scraper`) Actor Scrape job listings from Workday, iCIMS, Workable, Aderant, and EmployInc in a single run. This job board scraper searches all | platforms in parallel by job title and returns structured data — no URLs needed. Perfect for recruiters, lead generation, and market research - **URL**: https://apify.com/ahmed\_hrid/job-boards-scraper.md - **Developed by:** [Ahmed hrid](https://apify.com/ahmed_hrid) (community) - **Categories:** Jobs, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 90.9% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 record scrapeds This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Multi-Platform Job Scraper — Workday, iCIMS, Workable & More **Search across 5 major job platforms simultaneously and get structured job listings in seconds — no API keys, no manual searching.** - ✅ One search query → results from 5 platforms at once - ✅ Structured JSON output ready for your pipeline - ✅ Browser-grade requests that bypass bot detection - ✅ Residential proxy support for reliable scraping at scale --- ### 📌 What This Actor Does This Apify Actor automates job discovery across the most widely used Applicant Tracking Systems (ATS) and job boards on the web. Instead of visiting each platform manually, you provide a list of job titles — and the Actor searches all platforms in parallel, returning clean, structured job postings in a single dataset. **Supported platforms:** | Platform | Type | Notes | |---|---|---| | **Workday** (Workday Inc.) | Corporate ATS | Two-step auth with CSRF token | | **iCIMS** | Corporate ATS | Global careers network | | **Aderant** | Workday-based ATS | Legal/professional sector | | **EmployInc** (Talemetry) | Job board | JazzHR, Lever, Jobvite ecosystem | | **Workable** | Job board | Thousands of SMB & startup listings | **Who is it for?** - 🧑‍💼 **Recruiters** building candidate pipelines and market maps - 📊 **HR analysts** tracking job market trends across platforms - 🚀 **Startups** monitoring competitor hiring activity - 🤖 **Developers** building job aggregators or internal tools - 📈 **Lead generation agencies** identifying companies that are actively hiring --- ### ✨ Key Features - **5 platforms, one run** — all scraped simultaneously via `Promise.all`, not sequentially - **Keyword-based search** — search by job title, not by URL; no platform knowledge needed - **Smart pagination** — automatically handles offset-based, page-based, and cursor-based pagination depending on the platform - **Browser fingerprinting** — uses `impit` with Chrome impersonation to avoid detection without a headless browser overhead - **Residential proxy support** — routes requests through Apify's residential proxy network for maximum reliability - **Global job cap** — set a hard limit on total jobs across all platforms to control costs - **Free tier limits** — built-in daily quotas protect fair usage (50 jobs / 2 runs per day on the free plan) - **Structured output** — every job has a consistent set of fields regardless of the source platform --- ### 🧠 Why This Actor is Different Most job scrapers target a single platform or require you to provide a list of URLs. This Actor works differently: | Feature | This Actor | Typical Job Scrapers | |---|---|---| | Platforms covered | 5 (in one run) | Usually 1 | | Input required | Just job titles | URLs per platform | | Execution model | All platforms in parallel | Sequential | | Bot detection bypass | Browser fingerprinting via impit | Basic headers only | | Output consistency | Normalized fields across platforms | Platform-specific | Because all platforms are scraped at the same time, a run that covers 5 platforms takes roughly the same wall-clock time as scraping a single one. --- ### ⚙️ Input Configuration #### Fields | Field | Type | Default | Description | |---|---|---|---| | `jobTitles` | `string[]` | — | **Required.** List of job titles to search for | | `maxJobsPerSearch` | `integer` | `0` | Max jobs per platform per title. `0` = unlimited | | `maxJobsTotal` | `integer` | `100` | Hard cap on total jobs across all platforms and titles. `0` = unlimited | | `proxyConfiguration` | `object` | RESIDENTIAL/US | Proxy settings | #### Example Input ```json { "jobTitles": ["Software Engineer", "Data Analyst"], "maxJobsPerSearch": 20, "maxJobsTotal": 100, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "US" } } ```` #### Tips for Best Results - **Use specific job titles** — `"Senior React Engineer"` returns more relevant results than `"Engineer"` - **Search multiple titles in one run** — each title is searched across all 5 platforms simultaneously - **Set `maxJobsTotal`** — keeps costs predictable if you're running on a schedule - **Use RESIDENTIAL proxies** — datacenter proxies may be blocked by some platforms; residential is strongly recommended *** ### 📤 Output Format Jobs are pushed to the Apify dataset one at a time as they are found. Each record contains: | Field | Description | |---|---| | `source` | Platform name (`workday`, `icims`, `aderant`, `employinc`, `workable`) | | `searchedJobTitle` | The job title you searched for | | `title` | The actual job title as listed | | `url` | Direct link to the job posting | | `location` | City, state, country | | `workplace` | `on_site`, `remote`, or `hybrid` (where available) | | `employmentType` | e.g., `Full-time`, `Part-time` | | `department` | Team or department (where available) | | `company` | Hiring company name (Workable only) | | `companyUrl` | Company profile URL (Workable only) | | `jobId` | Platform-specific job identifier | | `postedOn` | Date the job was posted | | `scrapedAt` | ISO timestamp of when the record was scraped | #### Sample Output Record ```json { "source": "workable", "searchedJobTitle": "Software Engineer", "title": "Senior Software Engineer", "url": "https://jobs.workable.com/view/abc123/senior-software-engineer-at-acme", "location": "New York, New York, United States", "workplace": "hybrid", "employmentType": "Full-time", "department": "Engineering", "company": "Acme Corp", "companyUrl": "https://jobs.workable.com/company/xyz/jobs-at-acme", "jobId": "8791be7f-ad00-47a8-a15a-74cda1250850", "postedOn": "2026-06-01T12:00:00.000Z", "scrapedAt": "2026-06-27T10:23:41.123Z" } ``` *** ### ▶️ How to Use #### Option 1 — Apify Console (No Code) 1. Go to the Actor page in the [Apify Store](https://apify.com/store) 2. Click **Try for free** 3. In the **Input** tab, enter your job titles 4. Set `maxJobsTotal` to control how many results you want 5. Click **Start** and wait for the run to finish 6. Download your results as **JSON**, **CSV**, or **Excel** from the **Storage** tab #### Option 2 — Apify API ```bash curl -X POST "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=YOUR_TOKEN" \ -H "Content-Type: application/json" \ -d '{ "jobTitles": ["Product Manager", "UX Designer"], "maxJobsTotal": 200, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } }' ``` #### Option 3 — Apify Client (JavaScript) ```javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: 'YOUR_TOKEN' }); const run = await client.actor('YOUR_ACTOR_ID').call({ jobTitles: ['Machine Learning Engineer'], maxJobsTotal: 50, proxyConfiguration: { useApifyProxy: true, apifyProxyGroups: ['RESIDENTIAL'] }, }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(items); ``` #### Option 4 — Scheduled Runs Set up a **scheduled trigger** in the Apify Console to run this Actor daily or weekly and always have fresh job data without manual effort. *** ### 📈 Use Cases #### 1. Talent Market Intelligence Track how many companies are hiring for a given role (e.g., `"AI Engineer"`) across all platforms each week. Spot hiring trends before they hit the headlines. #### 2. Competitive Hiring Analysis Monitor which roles your competitors are posting. Scrape for their company name or sector-specific titles to understand their growth plans. #### 3. Lead Generation for B2B Services Companies actively posting jobs signal growth and budget. If a company is hiring 10 software engineers, they likely need SaaS tools, cloud infrastructure, or consulting services — find them first. #### 4. Job Aggregator or Internal Job Board Aggregate job listings from multiple ATS platforms into your own product, Notion database, or Airtable without paying for multiple vendor APIs. #### 5. Salary & Benefits Research Collect job descriptions at scale to extract salary ranges, required skills, and benefits data for compensation benchmarking. *** ### 🛠️ Advanced Tips #### Control Costs with `maxJobsTotal` Each run charges per job scraped. Setting `maxJobsTotal: 100` on a scheduled daily run keeps your monthly spend predictable. Combine with `maxJobsPerSearch` if you want an equal spread across platforms. #### Search Multiple Titles Together Searching 5 job titles costs the same wall-clock time as 1, since all platforms are hit in parallel per title. Batch your searches: ```json { "jobTitles": [ "Frontend Engineer", "React Developer", "UI Engineer", "JavaScript Developer" ], "maxJobsTotal": 400 } ``` #### Proxy Country Targeting Change `apifyProxyCountry` to target a specific market: ```json { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "GB" } } ``` #### Integrating with Google Sheets / Airtable Use Apify's native **Google Sheets integration** or **Webhooks** to automatically push new job results to your spreadsheet after each run — no code required. *** ### ❓ FAQ & Troubleshooting **Q: Why are some platforms returning 0 results?** Some platforms occasionally block requests or return empty results for certain queries. The Actor retries up to 5 times with exponential backoff. If a platform consistently fails, try changing the proxy country. **Q: Can I scrape jobs for a specific company?** This Actor searches by job title across all companies on each platform. Company-specific filtering is not currently supported — for that, use the platform's own search UI to find their ATS URL. **Q: How fresh is the data?** Data is scraped live on each run — there is no cache. Job listings reflect what is currently published on each platform at the time of the run. **Q: Why do some jobs have `null` for certain fields?** Not all platforms expose the same data. For example, `company` is only available on Workable. Fields not provided by the source platform are set to `null`. **Q: What is the free plan limit?** Free plan users can scrape up to **50 jobs per day** across a maximum of **2 runs per day**. Upgrade to a paid plan to remove these limits. **Q: Is this legal?** This Actor only scrapes publicly available job listings — no login, no private data, no personal information. Always ensure your use complies with the terms of service of each platform and applicable laws in your jurisdiction. *** ### 📞 Support - **Bug reports & feature requests:** Open an issue via the Apify Console or email - **General questions:** Use the **Reviews** section on the Actor page — we respond to every question - **Response time:** Within 24 hours on business days # Actor input Schema ## `jobTitles` (type: `array`): List of job titles to search for across all platforms. ## `maxJobsPerSearch` (type: `integer`): Maximum jobs to scrape per platform per job title. 0 means no limit. ## `maxJobsTotal` (type: `integer`): Hard cap on total jobs scraped across all platforms and titles. 0 means no limit. ## `proxyConfiguration` (type: `object`): Residential proxy is recommended to avoid blocks. ## Actor input object example ```json { "jobTitles": [ "Software Engineer" ], "maxJobsPerSearch": 0, "maxJobsTotal": 100, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "jobTitles": [ "Software Engineer" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }; // Run the Actor and wait for it to finish const run = await client.actor("ahmed_hrid/job-boards-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "jobTitles": ["Software Engineer"], "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "US", }, } # Run the Actor and wait for it to finish run = client.actor("ahmed_hrid/job-boards-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "jobTitles": [ "Software Engineer" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }' | apify call ahmed_hrid/job-boards-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=ahmed_hrid/job-boards-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Job Boards Scraper", "description": "Scrape job listings from Workday, iCIMS, Workable, Aderant, and EmployInc in a single run. This job board scraper searches all \n | platforms in parallel by job title and returns structured data — no URLs needed. Perfect for recruiters, lead generation, and market research", "version": "0.0", "x-build-id": "NdnUlDWt0sEH8Eoov" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/ahmed_hrid~job-boards-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-ahmed_hrid-job-boards-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/ahmed_hrid~job-boards-scraper/runs": { "post": { "operationId": "runs-sync-ahmed_hrid-job-boards-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/ahmed_hrid~job-boards-scraper/run-sync": { "post": { "operationId": "run-sync-ahmed_hrid-job-boards-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "jobTitles" ], "properties": { "jobTitles": { "title": "Job titles", "type": "array", "description": "List of job titles to search for across all platforms.", "items": { "type": "string" } }, "maxJobsPerSearch": { "title": "Max jobs per platform per title", "minimum": 0, "type": "integer", "description": "Maximum jobs to scrape per platform per job title. 0 means no limit.", "default": 0 }, "maxJobsTotal": { "title": "Max jobs total", "minimum": 0, "type": "integer", "description": "Hard cap on total jobs scraped across all platforms and titles. 0 means no limit.", "default": 100 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Residential proxy is recommended to avoid blocks." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```