🌍 Multi Job Board Scraper

Scrape job listings from LinkedIn, Indeed, Glassdoor, Google Jobs, ZipRecruiter, Bayt, BDJobs, and Naukri simultaneously with a single search — and get structured, deduplicated results in one dataset.

---

✨ Features

• 🏢 8 job boards in one run — LinkedIn, Indeed, Glassdoor, Google Jobs, ZipRecruiter, Bayt, BDJobs, Naukri
• 💰 Rich salary data — min/max, currency, interval, annual normalization
• 📋 Deep company info — size, revenue, rating, industry, logo, description
• 🎯 Advanced filters — remote only, job type, hours posted, distance, easy apply, LinkedIn company targeting
• 📝 Flexible output — Markdown or HTML descriptions
• 🔁 Auto-deduplication — same job posted on multiple boards appears only once
• 🛡️ Proxy support — residential proxies recommended for LinkedIn
• 🤖 Custom User-Agent — bypass board-specific blocks
• 🔐 CA cert support — for enterprise proxy authentication

---

📥 Input

🔴 Required

Field	Type	Description
searchTerm 🔍	string	Job title or keyword (e.g. "software engineer", "data analyst")

---

📍 Search & Location

Field	Type	Default	Description
location 📍	string	—	City, state, or country (e.g. "New York", "London", "Remote")
distance 📏	integer	50	Search radius in miles from location
sites 🏢	array	All 8	Job boards: linkedin, indeed, glassdoor, google, zip_recruiter, bayt, bdjobs, naukri
countryIndeed 🌐	string	usa	Country for Indeed/Glassdoor (usa, uk, canada, australia, germany, france, india, etc.)
googleSearchTerm 🔎	string	—	Custom search term for Google Jobs only (copy from Google Jobs UI for best results)

---

🎛️ Filters

Field	Type	Default	Description
maxResults 📊	integer	20	Max results per site (1–100)
isRemote 🏠	boolean	false	Remote jobs only
jobType 💼	string	—	fulltime, parttime, contract, internship, temporary
hoursOld ⏰	integer	—	Jobs posted within N hours (e.g. 24 = last day, 168 = last week)
easyApply ⚡	boolean	false	Quick-apply jobs only (hosted on the job board)
offset ⏭️	integer	—	Skip first N results (pagination)

---

🔗 LinkedIn-Specific

Field	Type	Default	Description
linkedinFetchDescription 🔗	boolean	false	Fetch full descriptions + direct URLs (more requests, slower)
linkedinCompanyIds 🏭	array	—	Restrict to specific LinkedIn company IDs (e.g. ["1441", "2382910"])

---

⚙️ Output & Advanced Options

Field	Type	Default	Description
descriptionFormat 📝	string	markdown	Job description format: markdown or html
enforceAnnualSalary 💰	boolean	false	Convert all wages to yearly equivalents
userAgent 🤖	string	—	Override default User-Agent header
caCert 🔐	string	—	CA certificate path for proxy auth
proxyConfiguration 🛡️	object	RESIDENTIAL	Proxy settings (residential recommended for LinkedIn)

---

📤 Output

Each item contains:

Field	Description
title	Job title
company	Company name
location	Job location
job_url	Link to job listing
job_url_direct	Direct apply URL (when available)
site	Source job board
date_posted	Date the job was posted
job_type	Employment type
is_remote	Remote flag
job_level	Seniority level (LinkedIn)
job_function	Role category
company_industry	Industry
company_num_employees	Employee count
company_employees_label	Human-readable employee range (e.g. "1001-5000")
company_revenue	Company revenue
company_revenue_label	Human-readable revenue (e.g. "$1B+")
company_country	Company country (Indeed)
company_rating	Company rating
company_reviews_count	Number of reviews
company_logo	Logo URL
company_description	Company description
salary_min	Minimum salary
salary_max	Maximum salary
salary_currency	Currency
salary_interval	Pay period (yearly, monthly, hourly)
description	Full job description (Markdown or HTML)
emails	Emails extracted from description
skills	Skills extracted from description (Naukri)
experience_range	Required experience (Naukri)
vacancy_count	Open positions (Naukri)
work_from_home_type	WFH type (Naukri)

---

💵 Pricing

$0.003 per job scraped (pay-per-event, charged only for results delivered)

---

⚠️ Important Notes

API Limitations

• LinkedIn ⚠️ — Cannot combine hoursOld with easyApply in the same search
• Indeed ⚠️ — Cannot combine hoursOld with jobType, isRemote, or easyApply in the same search

Site-Specific Notes

Board	Notes
🔵 LinkedIn	Rate-limited ~100 results per IP. Use residential proxies for large runs. Enable linkedinFetchDescription for full descriptions.
🟢 Indeed	Most reliable, no rate limiting. Best for large scrapes.
🟡 Glassdoor	Requires countryIndeed for country targeting.
🔴 Google Jobs	Best with a custom googleSearchTerm copied from the browser UI.
🟠 ZipRecruiter	US & Canada only.
🌙 Bayt	Middle East job market. Only searchTerm filter supported.
🟢 Naukri	India job market. Returns skills, experience_range, company_rating.
🔵 BDJobs	Bangladesh job market.

---

🧪 Examples

Basic Search

{
  "searchTerm": "software engineer",
  "location": "New York"
}

🏠 Remote Full-time Jobs — Last 24 Hours

{
  "searchTerm": "data analyst",
  "isRemote": true,
  "jobType": "fulltime",
  "hoursOld": 24,
  "sites": ["indeed", "google", "zip_recruiter"]
}

🏭 LinkedIn Company-Specific Search

{
  "searchTerm": "product manager",
  "location": "San Francisco",
  "sites": ["linkedin"],
  "linkedinCompanyIds": ["1441", "2382910"],
  "linkedinFetchDescription": true
}

🌏 Global Multi-Board Search with Salary Normalization

{
  "searchTerm": "machine learning engineer",
  "location": "London",
  "sites": ["linkedin", "indeed", "glassdoor"],
  "countryIndeed": "uk",
  "maxResults": 50,
  "enforceAnnualSalary": true,
  "descriptionFormat": "markdown"
}

🌙 Middle East + India Search

{
  "searchTerm": "DevOps engineer",
  "sites": ["bayt", "naukri"],
  "maxResults": 30
}

---

📝 Changelog

v1.0.20 — 2026-04-23

Quality & reliability: resolved "under maintenance" flag.

Apify's automated quality tests run the actor with only the prefilled input values. When v1.0.18 added multi-term search, the hard requirement on searchTerm was relaxed — which meant the QA runs submitted empty input and hit a ValueError crash, which triggered the maintenance flag.

• 🩹 Prefilled inputs for automated testing: searchTerm →

  "software engineer"
  , location → "New York, NY". New users opening the actor for the first time also see these working defaults instead of a blank form.
• 🩹 Graceful empty-input fallback: if neither searchTerm nor searchTerms is provided, the actor now pushes a single usage-hint row and exits cleanly (exit 0) instead of raising a ValueError (exit 91). No user is ever charged for a pointless failed run.
• 📦 All 8 job boards still selectable by default — Google & ZipRecruiter remain available even though their upstream scrapers are currently unreliable (tracked in JobSpy issues #284 / #302 / #283).

Verified on Apify: empty-input run now succeeds in <1s instead of crashing; prefilled input returns 60 jobs across LinkedIn/Indeed/Glassdoor.

v1.0.18 — 2026-04-21

Multi-term OR search (based on store-review feedback).

• New optional searchTerms array (max 5). Runs each query in turn, merges the results, and tags every row with matched_search_term so you can see which query surfaced each job.
• Existing single searchTerm field unchanged and fully backwards compatible.
• Example:

  {
    "searchTerms": ["AI consultant", "AI help"],
    "location": "Remote",
    "sites": ["linkedin", "indeed"]
  }
  

v1.0.17 — 2026-04-20

Glassdoor: fixed — now returns real results again. Backported three open upstream patches from speedyapply/JobSpy (PR #347, PR #350) that had not yet been merged into the pinned python-jobspy==1.1.82:

• 🩹 CSRF token URL: the old bootstrap URL (/Job/computer-science-jobs.htm) began returning HTTP 403 after Glassdoor's Next.js migration, so the session was initialized without a valid token → every Glassdoor search silently returned 0 results. Switched to /Job/index.htm, which returns 200 and the token parses cleanly.
• 🩹 Location URL-encoding: location strings with commas or spaces (e.g. "Nashville, TN", "New York, NY") were interpolated raw into the location lookup URL, triggering HTTP 400 "location not parsed". Now wrapped with urllib.parse.quote.
• 🩹 Non-fatal GraphQL errors: Glassdoor's /graph endpoint often returns peripheral errors on SEO-only fields (jobsPageSeoData) alongside fully populated data.jobListings. Upstream treated any errors field as fatal and dropped all the good data. Now we only fail when core jobListings data is actually missing.

Verified locally before deploy: Nashville, TN + "software engineer" → 10 real jobs returned (Deloitte, KPMG, PwC, Amazon, etc.). Full regression on Indeed / LinkedIn / combined runs passed.

v1.0.x (pre-fix)

• BDJobs user_agent kwarg compatibility shim (still active).
• Multi-site concurrent scraping across 8 boards.
• Rich salary, company, and filter support.