Public Job Postings Scraper

💼 Public Job Postings Scraper is a powerful Apify Actor designed to discover, track, and collect live Public Job listings directly from company career pages via the Greenhouse and Lever applicant tracking systems (ATS). This tool provides comprehensive Public Job intelligence including titles, locations, departments, posting dates, and full job descriptions. Whether you're building a job board, tracking hiring trends, or monitoring company growth, the Public Job Postings Scraper delivers actionable Public Job insights efficiently.

With multi-ATS integration across Greenhouse and Lever, keyword and location filtering, and reliable Apify Dataset delivery, the Public Job Postings Scraper ensures comprehensive Public Job discovery across a curated list of companies. It focuses on key Public Job signals including job title, department, location, and posting date, making it an essential tool for hiring research and talent market intelligence.

---

📋 Table of Contents

• Features
• Data Sources
• How It Works
• Input
• Output
• Technical Stack
• Data Fields
• Use Cases
• Quick Start
• Configuration
• Performance
• Billing
• Important Notes
• Changelog
• Support
• License & Legal

---

🔥 Features

• Greenhouse Integration – Direct integration with the Greenhouse Job Board API.
• Lever Integration – Direct integration with the Lever Postings API.
• Multi-Company Coverage – Aggregates Public Job listings from a curated set of companies including Figma, Discord, Coinbase, Palantir, Stripe, Robinhood, Netflix, and Spotify.
• Keyword Filtering – Filter Public Job results by title keyword.
• Location Filtering – Filter by location, with smart matching for "US"/"USA"/"United States" including common remote and city terms.
• HTML-Cleaned Descriptions – Automatically strips HTML tags and entities from job descriptions.
• Department Extraction – Captures department or team for each posting.
• Posting Date Tracking – Records when each job was posted or last updated.
• Direct Job URLs – Provides direct links to each job posting.
• Per-Company Limiting – Configurable maximum jobs returned per company.
• Residential Proxy Support – Apify residential proxy for reliable, uninterrupted access.
• Real-Time Dataset Push – Pushes results to Apify Dataset with metadata.
• Detailed Logging – Comprehensive logging of per-company progress and match counts.
• Asyncio-Friendly – Non-blocking async/await architecture with httpx.
• Graceful Error Handling – Skips a failing company's ATS without stopping the whole run.

---

📊 Data Sources

1. Greenhouse Job Board API

• Endpoint: boards-api.greenhouse.io/v1/boards/{token}/jobs
• Coverage: Companies using Greenhouse as their ATS
• Data: Job title, location, departments, full HTML content, last-updated timestamp
• Access: Public, no authentication required

2. Lever Postings API

• Endpoint: api.lever.co/v0/postings/{slug}
• Coverage: Companies using Lever as their ATS
• Data: Job title, location, team/department, plain-text or HTML description, creation timestamp
• Access: Public, no authentication required

Included Companies

Company	ATS
Figma	Greenhouse
Discord	Greenhouse
Coinbase	Greenhouse
Palantir	Lever
Stripe	Greenhouse
Robinhood	Greenhouse
Netflix	Lever
Spotify	Lever

---

⚙️ How It Works

The Public Job Postings Scraper loops through a configured list of companies, each tagged with its ATS type (Greenhouse or Lever). For Greenhouse companies, it queries the Job Board API using the company's board token. For Lever companies, it queries the Postings API using the company's slug. Each returned job is normalized into a common structure, HTML is stripped from descriptions, and keyword/location filters are applied. Matching jobs are collected across all companies and pushed to the Apify Dataset in a single batch.

Key Processing Steps:

1. Input Parsing – Accept keyword filter, location filter, and per-company job limit
2. Proxy Setup – Configure Apify residential proxy
3. Company Loop – Iterate through each configured company
4. Greenhouse Query – Fetch jobs via the Job Board API for Greenhouse companies
5. Lever Query – Fetch jobs via the Postings API for Lever companies
6. HTML Stripping – Clean job description content of tags and entities
7. Keyword Filtering – Match job titles against the keyword filter
8. Location Filtering – Match job locations against the location filter, with US-term expansion
9. Per-Company Limiting – Truncate results to the configured maximum
10. Dataset Push – Push combined matching jobs in a single batch
11. Summary Logging – Report per-company and total match counts

Key Benefits:

• Monitor Public Job openings across multiple companies from one run
• Track hiring trends and department growth
• Filter down to only the roles and locations that matter
• Build a talent-market dataset without visiting each career page manually
• Re-run on a schedule to catch newly posted roles

---

📥 Input

The Actor accepts the following input parameters:

Field	Type	Default	Description
keyword_filter	string	""	Only include Public Job postings whose title contains this keyword
location_filter	string	""	Only include postings matching this location (supports "US"/"USA"/"United States" expansion)
max_jobs_per_company	integer	0	Maximum jobs returned per company (0 = no limit)
useApifyProxy	boolean	true	Enable Apify residential proxies
apifyProxyGroups	array	["RESIDENTIAL"]	Proxy group configuration

Example Input:

{
  "keyword_filter": "engineer",
  "location_filter": "US",
  "max_jobs_per_company": 20
}

Search for Remote Design Roles:

{
  "keyword_filter": "design",
  "location_filter": "remote"
}

---

📤 Output

The Actor pushes Public Job records with the following structure:

Field	Type	Description
company	string	Name of the hiring company
source	string	ATS the job was sourced from (greenhouse or lever)
title	string	Job title
location	string	Job location as listed by the company
department	string	Department or team the role belongs to
posted_at	string	ISO 8601 date the job was posted or last updated
job_url	string	Direct link to the job posting
description	string	Full job description, HTML-stripped
scraped_at	string	ISO 8601 timestamp of when the job was scraped

Example Public Job Record:

{
  "company": "Stripe",
  "source": "greenhouse",
  "title": "Senior Backend Engineer, Payments",
  "location": "San Francisco, CA",
  "department": "Engineering",
  "posted_at": "2026-07-18T09:32:00Z",
  "job_url": "https://job-boards.greenhouse.io/stripe/jobs/1234567",
  "description": "We're looking for a Senior Backend Engineer to join our Payments team...",
  "scraped_at": "2026-07-25T12:00:00Z"
}

---

🧰 Technical Stack

• APIs: Greenhouse Job Board API, Lever Postings API
• HTTP Client: httpx for async HTTP requests
• HTML Cleaning: regex + html.unescape for description sanitization
• Date Parsing: datetime with timezone-aware UTC timestamps
• Filtering: Custom keyword and location matching logic
• Async: asyncio for non-blocking, multi-company fetching
• Proxy: Apify Proxy with RESIDENTIAL configuration
• Logging: Apify Actor logging system
• Platform: Apify Actor serverless environment

---

📊 Data Fields Explained

Job Identification

• title: The role's job title
• job_url: Direct link to apply or view the posting
• source: Which ATS the listing came from

Company Context

• company: The hiring company's name
• department: Team or department the role sits in

Location & Timing

• location: Where the role is based (or remote)
• posted_at: When the job was posted or last updated
• scraped_at: When the Actor captured the listing

Content

• description: Full plain-text job description

---

🎯 Use Cases

• Talent Market Research – Track Public Job openings across major tech employers
• Hiring Trend Analysis – Monitor which departments and roles are growing
• Competitor Intelligence – See where competitors are actively hiring
• Job Board Aggregation – Power a niche job board with live listings
• Recruiting Prospecting – Identify companies actively hiring for specific roles
• Location-Based Search – Filter for remote or region-specific roles
• Academic/Labor Research – Build datasets on hiring patterns over time

---

🚀 Quick Start

1. Prepare Input

Go to Apify Console and enter:

{
  "keyword_filter": "product manager",
  "location_filter": "US"
}

2. Run the Actor

Click Start. The Actor will:

• Query Greenhouse for each Greenhouse-listed company
• Query Lever for each Lever-listed company
• Clean and filter job postings
• Push matching results to the Dataset

3. Monitor Progress

Console shows:

Initializing Scraper for Keyword: 'product manager' | Location: 'US'
[Greenhouse] Searching jobs for Figma...
 -> Figma: 3 matching job(s) found.
[Lever] Searching jobs for Palantir...
 -> Palantir: 5 matching job(s) found.
Done! Saved 27 matching job postings to Apify Dataset.

4. View & Download Results

• Results Tab: All Public Job records
• Export: JSON, CSV, Excel, or HTML
• Filter: By company, department, or location
• API Access: Available via the Apify API

---

⚙️ Configuration

Broad search, no filters:

{}

Keyword only:

{
  "keyword_filter": "data scientist"
}

Location only, capped results:

{
  "location_filter": "New York",
  "max_jobs_per_company": 10
}

---

📈 Performance

Processing Speed

• Fast per-company requests with a short delay between companies
• Single API call per company (no pagination overhead)
• Filtering applied in-memory after each fetch

Resource Usage

• Memory: Low, proportional to total jobs returned
• Network: One request per company per run
• API calls: 8 requests total across the default company list

---

💰 Billing

Batch Billing

• Billing Model: Batch push (not per-job PPE)
• Typical Cost: Single operation across all configured companies
• Efficiency: High efficiency, low-resource processing

---

⚠️ Important Notes

Legal & Compliance

• Fair Use: Respects each ATS provider's public API and rate limits
• Public Data Only: Extracts only publicly listed job postings
• Accuracy: Data as recorded on each company's careers page
• Verification: Verify details on the original job posting before applying or reporting on it
• Legal: Not legal advice — consult counsel regarding data reuse policies

Data Quality

• Freshness: Reflects live ATS data at time of run
• Completeness: Dependent on what each company publishes via their ATS
• Accuracy: Sourced directly from official Greenhouse/Lever APIs
• Verification: Cross-check against the live job board when precision matters

Best Practices

• Use keyword_filter and location_filter together to narrow noisy results
• Set max_jobs_per_company to keep runs fast and predictable
• Re-run periodically to catch newly posted roles
• Extend the company list with additional Greenhouse/Lever tokens as needed
• Respect each company's careers page Terms of Service

---

📦 Changelog

v1.0.0 (July 2026)

Initial Release:

• Greenhouse Job Board API integration
• Lever Postings API integration
• Multi-company aggregation across 8 default companies
• Keyword-based title filtering
• Location filtering with US-term expansion
• HTML stripping and description cleanup
• Department and posting-date extraction
• Per-company job limiting
• Apify residential proxy support
• Real-time Dataset push
• Per-company error handling and logging
• Asyncio + httpx async architecture

---

🧑‍💻 Support & Feedback

• Issues: Submit via Apify console with the filters used
• Documentation: Check the Actor details page
• Community: Apify forum discussions
• Feature Requests: Suggest additional companies or ATS providers to support
• Bug Reports: Include the filters and error details

---

📄 License & Legal

Terms of Use:

• Use for legitimate hiring and market research
• Respect each ATS provider's Terms of Service
• Don't republish full job postings without permission
• Use data responsibly

Disclaimer: Public Job Postings Scraper is provided as-is for research purposes. Users are responsible for compliance with each source's ToS. This is not legal advice.

---

🎉 Get Started Today

Deploy now for Public Job research!

Use for:

• 📊 Hiring Trend Analysis
• 🔍 Company Monitoring
• 💡 Talent Market Research
• 📈 Job Board Aggregation
• 🎯 Recruiting Intelligence

Perfect for:

• Recruiters
• Talent Researchers
• Job Board Operators
• Market Analysts

---

Last Updated: July 2026 Version: 1.0.0 Status: Production Ready Platform: Apify Actor Architecture: Async/Await Data Sources: Greenhouse, Lever

---

📚 Related Tools

• Salary Trends Scraper
• Angel Investor Contact Finder
• Investor Presentation Scraper

Your complete Apify-powered Public Job research solution! 🚀✨

---

⚖️ Public Job Excellence

This Actor is optimized for Public Job research with:

• ✅ Multi-ATS Greenhouse and Lever integration
• ✅ Keyword and location filtering
• ✅ Clean, HTML-free descriptions
• ✅ Per-company error isolation
• ✅ Real-time Dataset push
• ✅ Production-ready code

Discover public job openings effortlessly! 💎🚀