🌍 Multi Job Board Scraper

Scrape job listings from LinkedIn, Indeed, Glassdoor, Google Jobs, ZipRecruiter, Bayt, BDJobs, and Naukri simultaneously with a single search — and get structured, deduplicated results in one dataset.

---

✨ Features

• 🏢 8 job boards in one run — LinkedIn, Indeed, Glassdoor, Google Jobs, ZipRecruiter, Bayt, BDJobs, Naukri
• 💰 Rich salary data — min/max, currency, interval, annual normalization
• 📋 Deep company info — size, revenue, rating, industry, logo, description
• 🎯 Advanced filters — remote only, job type, hours posted, distance, easy apply, LinkedIn company targeting
• 📝 Flexible output — Markdown or HTML descriptions
• 🔁 Auto-deduplication — same job posted on multiple boards appears only once
• 🛡️ Proxy support — residential proxies recommended for LinkedIn
• 🤖 Custom User-Agent — bypass board-specific blocks
• 🔐 CA cert support — for enterprise proxy authentication

---

📥 Input

🔴 Required

Field	Type	Description
searchTerm 🔍	string	Job title or keyword (e.g. "software engineer", "data analyst")

---

📍 Search & Location

Field	Type	Default	Description
location 📍	string	—	City, state, or country (e.g. "New York", "London", "Remote")
distance 📏	integer	50	Search radius in miles from location
sites 🏢	array	All 8	Job boards: linkedin, indeed, glassdoor, google, zip_recruiter, bayt, bdjobs, naukri
countryIndeed 🌐	string	usa	Country for Indeed/Glassdoor (usa, uk, canada, australia, germany, france, india, etc.)
googleSearchTerm 🔎	string	—	Custom search term for Google Jobs only (copy from Google Jobs UI for best results)

---

🎛️ Filters

Field	Type	Default	Description
maxResults 📊	integer	20	Max results per site (1–100)
isRemote 🏠	boolean	false	Remote jobs only
jobType 💼	string	—	fulltime, parttime, contract, internship, temporary
hoursOld ⏰	integer	—	Jobs posted within N hours (e.g. 24 = last day, 168 = last week)
easyApply ⚡	boolean	false	Quick-apply jobs only (hosted on the job board)
offset ⏭️	integer	—	Skip first N results (pagination)

---

🔗 LinkedIn-Specific

Field	Type	Default	Description
linkedinFetchDescription 🔗	boolean	false	Fetch full descriptions + direct URLs (more requests, slower)
linkedinCompanyIds 🏭	array	—	Restrict to specific LinkedIn company IDs (e.g. ["1441", "2382910"])

---

⚙️ Output & Advanced Options

Field	Type	Default	Description
descriptionFormat 📝	string	markdown	Job description format: markdown or html
enforceAnnualSalary 💰	boolean	false	Convert all wages to yearly equivalents
userAgent 🤖	string	—	Override default User-Agent header
caCert 🔐	string	—	CA certificate path for proxy auth
proxyConfiguration 🛡️	object	RESIDENTIAL	Proxy settings (residential recommended for LinkedIn)

---

📤 Output

Each item contains:

Field	Description
title	Job title
company	Company name
location	Job location
job_url	Link to job listing
job_url_direct	Direct apply URL (when available)
site	Source job board
date_posted	Date the job was posted
job_type	Employment type
is_remote	Remote flag
job_level	Seniority level (LinkedIn)
job_function	Role category
company_industry	Industry
company_num_employees	Employee count
company_employees_label	Human-readable employee range (e.g. "1001-5000")
company_revenue	Company revenue
company_revenue_label	Human-readable revenue (e.g. "$1B+")
company_country	Company country (Indeed)
company_rating	Company rating
company_reviews_count	Number of reviews
company_logo	Logo URL
company_description	Company description
salary_min	Minimum salary
salary_max	Maximum salary
salary_currency	Currency
salary_interval	Pay period (yearly, monthly, hourly)
description	Full job description (Markdown or HTML)
emails	Emails extracted from description
skills	Skills extracted from description (Naukri)
experience_range	Required experience (Naukri)
vacancy_count	Open positions (Naukri)
work_from_home_type	WFH type (Naukri)

---

💵 Pricing

$0.003 per job scraped (pay-per-event, charged only for results delivered)

---

⚠️ Important Notes

API Limitations

• LinkedIn ⚠️ — Cannot combine hoursOld with easyApply in the same search
• Indeed ⚠️ — Cannot combine hoursOld with jobType, isRemote, or easyApply in the same search

Site-Specific Notes

Board	Notes
🔵 LinkedIn	Rate-limited ~100 results per IP. Use residential proxies for large runs. Enable linkedinFetchDescription for full descriptions.
🟢 Indeed	Most reliable, no rate limiting. Best for large scrapes.
🟡 Glassdoor	Requires countryIndeed for country targeting.
🔴 Google Jobs	Best with a custom googleSearchTerm copied from the browser UI.
🟠 ZipRecruiter	US & Canada only.
🌙 Bayt	Middle East job market. Only searchTerm filter supported.
🟢 Naukri	India job market. Returns skills, experience_range, company_rating.
🔵 BDJobs	Bangladesh job market.

---

🧪 Examples

Basic Search

{
  "searchTerm": "software engineer",
  "location": "New York"
}

🏠 Remote Full-time Jobs — Last 24 Hours

{
  "searchTerm": "data analyst",
  "isRemote": true,
  "jobType": "fulltime",
  "hoursOld": 24,
  "sites": ["indeed", "google", "zip_recruiter"]
}

🏭 LinkedIn Company-Specific Search

{
  "searchTerm": "product manager",
  "location": "San Francisco",
  "sites": ["linkedin"],
  "linkedinCompanyIds": ["1441", "2382910"],
  "linkedinFetchDescription": true
}

🌏 Global Multi-Board Search with Salary Normalization

{
  "searchTerm": "machine learning engineer",
  "location": "London",
  "sites": ["linkedin", "indeed", "glassdoor"],
  "countryIndeed": "uk",
  "maxResults": 50,
  "enforceAnnualSalary": true,
  "descriptionFormat": "markdown"
}

🌙 Middle East + India Search

{
  "searchTerm": "DevOps engineer",
  "sites": ["bayt", "naukri"],
  "maxResults": 30
}

---

📝 Changelog

v1.0.20 — 2026-04-23

Quality & reliability: resolved "under maintenance" flag.

Apify's automated quality tests run the actor with only the prefilled input values. When v1.0.18 added multi-term search, the hard requirement on searchTerm was relaxed — which meant the QA runs submitted empty input and hit a ValueError crash, which triggered the maintenance flag.

• 🩹 Prefilled inputs for automated testing: searchTerm →

  "software engineer"
  , location → "New York, NY". New users opening the actor for the first time also see these working defaults instead of a blank form.
• 🩹 Graceful empty-input fallback: if neither searchTerm nor searchTerms is provided, the actor now pushes a single usage-hint row and exits cleanly (exit 0) instead of raising a ValueError (exit 91). No user is ever charged for a pointless failed run.
• 📦 All 8 job boards still selectable by default — Google & ZipRecruiter remain available even though those platforms are currently rate-limiting automated traffic and may intermittently return no results.

Verified on Apify: empty-input run now succeeds in <1s instead of crashing; prefilled input returns 60 jobs across LinkedIn/Indeed/Glassdoor.

v1.0.18 — 2026-04-21

Multi-term OR search (based on store-review feedback).

• New optional searchTerms array (max 5). Runs each query in turn, merges the results, and tags every row with matched_search_term so you can see which query surfaced each job.
• Existing single searchTerm field unchanged and fully backwards compatible.
• Example:

  {
    "searchTerms": ["AI consultant", "AI help"],
    "location": "Remote",
    "sites": ["linkedin", "indeed"]
  }
  

v1.0.17 — 2026-04-20

Glassdoor: fixed — now returns real results again. Three fixes for changes Glassdoor made to its site that had been causing every Glassdoor search to return 0 results:

• 🩹 CSRF token URL: the old bootstrap URL (/Job/computer-science-jobs.htm) began returning HTTP 403 after Glassdoor's Next.js migration, so the session was initialized without a valid token → every Glassdoor search silently returned 0 results. Switched to /Job/index.htm, which returns 200 and the token parses cleanly.
• 🩹 Location URL-encoding: location strings with commas or spaces (e.g. "Nashville, TN", "New York, NY") were interpolated raw into the location lookup URL, triggering HTTP 400 "location not parsed". Now wrapped with urllib.parse.quote.
• 🩹 Non-fatal GraphQL errors: Glassdoor's API often returns peripheral errors on SEO-only fields (jobsPageSeoData) alongside fully populated job listings. These were previously treated as fatal, dropping all the good data. Now we only fail when the core job-listings data is actually missing.

Verified locally before deploy: Nashville, TN + "software engineer" → 10 real jobs returned (Deloitte, KPMG, PwC, Amazon, etc.). Full regression on Indeed / LinkedIn / combined runs passed.

v1.0.x (pre-fix)

• BDJobs user_agent kwarg compatibility shim (still active).
• Multi-site concurrent scraping across 8 boards.
• Rich salary, company, and filter support.