💼📊 StepStone Job Scraper (AI + IT + General Jobs API)

StepStone job scraper that extracts rich, structured job data via API. Collects titles, companies, locations, salaries, labels, work-from-home info, and full descriptions with fast pagination and clean normalized output ready for datasets, analytics, or job platforms.

It extracts structured job listings with full pagination support and normalized enterprise-grade output.

---

🚀 What this scraper does

This actor extracts structured job market intelligence from StepStone:

💼 Job Data

• Job title
• Job ID (internal StepStone ID)
• Full job URL
• Section (main / promoted / sponsored)
• Labels (Quick Apply, Top Job, etc.)

---

🏢 Company Data

• Company name
• Company ID
• Company profile URL
• Company logo

---

📍 Location & Work Setup

• City / region
• Remote / hybrid level (workFromHome)
• Job placement metadata

---

💰 Salary Intelligence

• Min / max salary (if available)
• Currency
• Salary type (yearly/monthly)
• Salary availability flag

---

📊 Job Metadata

• Posting date
• Position ranking on page
• Absolute ranking across dataset
• Harmonised job ID (deduplication key)

---

🧠 Enrichment Fields

• Skills (if available)
• Snippet / preview description
• Top labels (featured jobs, urgent, etc.)
• Sponsored / highlighted flags

---

🔁 Pagination Engine

• Fully automatic multi-page crawling
• Stops when maxItems is reached
• Uses StepStone internal paging links

---

⚙️ Input

🔎 Basic search example

{
  "startUrls": [
    {
      "url": "https://www.stepstone.de/jobs/ai?page=1&searchOrigin=Homepage_top-search"
    }
  ],
  "maxItems": 100,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

🧠 Multi-category scraping

{
  "startUrls": [
    {
      "url": "https://www.stepstone.de/jobs/it-jobs"
    },
    {
      "url": "https://www.stepstone.de/jobs/data-scientist"
    }
  ],
  "maxItems": 500
}

---

⚡ High-scale mode

{
  "startUrls": [
    {
      "url": "https://www.stepstone.de/jobs/ai"
    }
  ],
  "maxItems": 10000,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

🔎 Crawling Architecture

📡 API MODE (Core Engine)

This scraper uses StepStone internal endpoint:

POST /public-api/resultlist/unifiedResultlist

It handles:

• pagination links
• filtering
• job enrichment
• regional sorting

---

📦 Normalization Layer

Each job is transformed into:

• stable schema
• deduplicated structure
• enriched company mapping
• safe fallback values

---

📤 Output

Each item represents one job listing.

---

💼 Example Output

{
	"id": 13953979,
	"title": "Solution Architect - AI Applications (m/w/d)",
	"labels": [],
	"url": "https://www.stepstone.de/stellenangebote--Solution-Architect-AI-Applications-m-w-d-Bremen-Rheinmetall--13953979-inline.html?rltr=26_1_25_seorl_m_0_0_0_0_0_0",
	"companyId": 1262,
	"companyName": "Rheinmetall",
	"companyUrl": "https://www.stepstone.de/cmp/de/rheinmetall-1262/jobs",
	"companyLogoUrl": "https://www.stepstone.de/upload_DE/logo/B/logoRheinmetall-Group-1262DE-2101221907.gif",
	"datePosted": "2026-04-27T04:16:49+02:00",
	"location": "Bremen",
	"isAnonymous": false,
	"salary": "",
	"postCode": null,
	"partnership": {
		"isPartnershipJob": false,
		"showPartnershipLabel": false,
		"isBackfilled": false,
		"sourceSiteFriendlyName": "",
		"isCrossPosted": false
	},
	"unifiedSalary": {
		"min": null,
		"max": null,
		"currency": null,
		"period": null,
		"salaryAvailable": true,
		"salaryType": null
	},
	"workFromHome": "2",
	"metaData": {
		"positionOnPage": 1,
		"positionAbsolute": 26
	},
	"harmonisedId": "30619100-db32-4ad2-86b5-cfee63c36539",
	"jobPostingSequence": null,
	"periodPostedDate": null,
	"publishFromDate": null,
	"publishToDate": null,
	"hasFuturePosting": false,
	"fingerprintCount": null,
	"section": "main",
	"topLabels": [],
	"skills": [],
	"textSnippet": "Als Solution Designer (m/w/d) für <strong>AI</strong> Applications verantworten Sie die technologische Produktplanung und die Umsetzung komplexer Softwareentwicklungsprojekte.",
	"cvToJobScore": null,
	"isHighlighted": false,
	"isSponsored": false,
	"travelTime": null,
	"unifiedTravelTime": null,
	"isTopJob": false,
	"isTrafficFromPartner": false,
	"sourceUrl": "https://www.stepstone.de/jobs/ai?page=2&searchOrigin=Homepage_top-search"
}

---

📊 Features

• ⚡ High-speed API scraping (no DOM scraping needed)
• 🔁 Full pagination support
• 🧠 Smart normalization layer
• 🏢 Company enrichment
• 📍 Work-from-home detection
• 💰 Salary structure parsing
• 🧩 Clean dataset output (ETL ready)

---

💡 Use Cases

• AI job market tracking
• Recruitment intelligence systems
• Salary analytics
• Talent sourcing tools
• Job board aggregation
• HR data pipelines

---

⚠️ Notes

• Residential proxy recommended for stability
• Works best with AI / IT / Germany job queries
• Designed for scalable production scraping