🌐 Universal Job Scraper — 5 Platforms, Any Role, Any Location

Search any job type across 5 platforms in one run. Filter by location, job type, and experience level. Every result is scored and optionally paired with a personalised outreach message.

---

What Makes This Different

Most job scrapers only hit one platform and dump raw data.
This actor scrapes 5 platforms simultaneously, deduplicates across them, scores every result, and remembers what you've already seen — so repeat runs only cost you for new jobs.

Step	What happens
Scrape	Hits Remotive, RemoteOK, We Work Remotely, Wellfound & Indeed
Filter	Location, job type (remote/full-time/contract), experience level, custom keywords
Deduplicate	Removes cross-platform duplicates — exact + fuzzy matching
Score	Relevance Score (matches your keywords) + Opportunity Score (company signals)
Outreach	Optional: generates a personalised cold DM per job using Claude AI
Incremental	Remembers seen jobs — you only pay for new results on repeat runs

---

Platforms

Platform	Method	Job Types
Remotive	JSON API — fast & free	Remote tech, marketing, design, sales
RemoteOK	JSON API — fast & free	Remote startup roles, any field
We Work Remotely	RSS — fast & free	Remote roles across all categories
Wellfound	Playwright	Startup roles, any function
Indeed	Playwright + Proxy	Broadest coverage — all types & locations

Tip: Start with the 3 API platforms (no proxy needed, lowest cost). Add Wellfound & Indeed for higher volume or non-remote roles.

---

Input Options

Field	Type	Default	Description
queries	string[]	["software engineer"]	Job titles or search terms
location	string	""	City, country, or "Remote". Blank = anywhere
jobType	select	"any"	any / remote / full-time / part-time / contract
experienceLevel	select	"any"	any / entry / mid / senior
platforms	string[]	API 3	Which platforms to scrape
maxResultsPerPlatform	integer	50	Cap per platform (max 500)
targetKeywords	string[]	[]	Optional: only return jobs with these keywords
excludePatterns	string[]	[]	Optional: skip jobs containing these words
enableScoring	boolean	true	Compute Relevance + Opportunity scores
enableOutreach	boolean	false	Generate Claude AI outreach messages
anthropicApiKey	string	—	Required only for outreach
proxyConfig	object	Residential	For Wellfound & Indeed

---

Output Fields

Field	Description
title	Job title
company	Company name
location	Location or "Remote"
url	Direct apply link
salary	Salary if listed
tags	Keywords matched from your filters
datePosted	Date posted
source	Which platform
relevance_score	0–100 — how well the job matches your keywords
opportunity_score	0–100 — company signals: startup stage, manual processes, growth
outreach_message	Ready-to-send personalised DM (if enabled)

---

Example Inputs

Remote software jobs anywhere

{
  "queries": ["software engineer", "backend developer", "fullstack developer"],
  "platforms": ["remotive", "remoteok", "weworkremotely"],
  "jobType": "remote",
  "experienceLevel": "mid",
  "maxResultsPerPlatform": 100
}

Senior marketing roles in London

{
  "queries": ["marketing manager", "growth manager", "head of marketing"],
  "platforms": ["indeed", "wellfound"],
  "location": "London",
  "jobType": "full-time",
  "experienceLevel": "senior",
  "excludePatterns": ["unpaid", "commission only"],
  "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }
}

Contract data roles with keyword filter

{
  "queries": ["data analyst", "data engineer", "BI developer"],
  "platforms": ["remotive", "remoteok", "weworkremotely", "indeed"],
  "jobType": "contract",
  "targetKeywords": ["Python", "SQL", "dbt", "Snowflake"],
  "enableScoring": true
}

---

Scoring Explained

Relevance Score (0–100)

How well the job matches your targetKeywords. Title matches score higher than description matches.
If no keywords are set → score defaults to 50 (neutral).

Opportunity Score (0–100)

Universal company signals — applies to any industry:

• 🚀 Growth signals: Series A/B, seed round, scaling fast
• 🔧 Process signals: manual workflows, spreadsheets, bottlenecks
• 🔗 Integration signals: API, CRM, webhook, workflow mentions
• 👥 Team signals: startup, small team, early-stage, contractor

---

Incremental Runs — Only Pay for New Jobs

The actor stores all processed job IDs in Apify's Key-Value Store.
On repeat runs, already-seen jobs are skipped — you only process and pay for genuinely new listings.

Recommended schedule: Daily at 08:00 via Apify Schedules.

---

Cost Estimate

Mode	Compute Units / 1,000 results
API only (Remotive + RemoteOK + WWR)	~2 CU
+ Playwright (Wellfound / Indeed)	~8–12 CU
+ AI Outreach (Claude, billed separately)	~12 CU + ~$0.01/job

---

Use Cases

• 🔍 Job seekers — daily multi-platform alerts, pre-filtered to your role & location
• 💼 Recruiters — source candidates across 5 boards in minutes, not hours
• 🤝 Freelancers & consultants — find companies actively hiring = warm leads
• 🛠️ HR tech & job boards — feed structured data into your product
• 📊 Market researchers — track hiring trends by role, location, company type

---

FAQ

Q: Do I need proxies?
Only for Wellfound and Indeed. The 3 API platforms work without any proxy.

Q: Can I scrape any job type — not just tech?
Yes. Search for "nurse", "accountant", "sales rep", "chef" — any query works.

Q: Do I need an Anthropic key?
Only if enableOutreach: true. The actor works fully without it.

Q: How do I avoid duplicates across runs?
Automatically handled. The KV store remembers every job ID already pushed.

Q: Can I run this on a schedule?
Yes — use Apify Schedules. Daily runs with incremental state = zero wasted compute.

---

Support

Open an issue on the actor page or contact via Apify console. Response within 24 hours.