# Universal Job Postings Scraper · Any Job Site (`bibian/universal-job-postings-scraper`) Actor

Extract job postings from any job board or company career site that publishes schema.org JobPosting data: title, company, location, remote, salary range, contract type and full description. Give domains, the actor finds the offers through their sitemaps.

- **URL**: https://apify.com/bibian/universal-job-postings-scraper.md
- **Developed by:** [Vivien MORVAN](https://apify.com/bibian) (community)
- **Categories:** Jobs
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.00 / 1,000 job postings

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Universal Job Postings Scraper · Any Job Site

Scrape job postings from any job board or company career site that publishes schema.org `JobPosting` data. Most of them do, because Google for Jobs requires it. Give the actor a list of domains: it finds the offers through each site's sitemap, reads the structured data of every offer page and returns clean, uniform records, whatever the site.

### What you can do with it

- **Monitor hiring on many sites with one input**: job boards, company career pages and niche boards in the same run, with the same output fields.
- **Feed a job alert or an aggregator**: newest offers come first, and expired offers are skipped by default.
- **Find companies that are hiring**: employer, location, contract type and remote policy for each posting.
- **Benchmark salaries**: published salary ranges, currency and period, when the employer publishes them.

### How it works

1. The actor reads the `robots.txt` of each domain. Pages disallowed for `User-agent: *` are never loaded.
2. It reads the sitemap and keeps the most recent pages that look like job pages.
3. Sitemaps mix offers with category and search pages, so it tests a sample of each kind of address and only keeps reading the kinds that contain a `JobPosting`.
4. It turns each `JobPosting` into one record. Contact details are never exported.

### Input

| Field | What it does |
|---|---|
| Domains | Job boards or company career sites, for example `remoteok.com`. Up to 50. |
| Start URLs | Optional. A listing page or a single offer: the actor reads it and follows the job links found on the same site. Use it when a site has no useful sitemap. |
| Keywords | Keep only the postings whose title or description contains this text. |
| Job URL pattern | Optional regular expression that the address of an offer must match. Empty means automatic detection. |
| Maximum number of postings | The run stops once this many postings are saved, across all domains. |
| Maximum postings per domain | Keeps one big site from filling the whole run. |
| Include expired postings | Off by default. |
| Include full descriptions | Adds the description as plain text. |

### Output

One record per posting:

```json
{
  "url": "https://example.com/jobs/data-engineer-12345",
  "domain": "example.com",
  "id": "REQ-77",
  "title": "Data Engineer",
  "companyName": "ACME",
  "companyUrl": "https://acme.example",
  "employmentType": ["FULL_TIME"],
  "city": "Paris",
  "region": "Île-de-France",
  "postalCode": "75001",
  "country": "FR",
  "locationLabel": "Paris, Île-de-France, FR",
  "remote": false,
  "salaryMin": 50000,
  "salaryMax": 60000,
  "salaryCurrency": "EUR",
  "salaryPeriod": "YEAR",
  "datePosted": "2026-10-01",
  "validThrough": "2026-12-01",
  "description": "…"
}
```

Export the dataset as JSON, CSV or Excel, or read it through the Apify API.

### Sites tested

Checked on 09/10/2026: remoteok.com, infoempleo.com, welcometothejungle.com, free-work.com, reed.co.uk, remotive.com, cadremploi.fr, jobteaser.com and jobicy.com. Any other site with `JobPosting` data and a sitemap should work the same way.

### Good to know

- The actor only extracts what a site publishes as `JobPosting` structured data. A site without it returns nothing, and the run log says so.
- Fields a site does not publish, such as salary, stay empty.
- Some sites block automated visits. The actor retries through Apify Proxy, and reports the sites it cannot read.
- Postings come newest first, so a small limit stays fast and cheap.
- The dataset contains job postings only. Recruiter and candidate contact details are never exported.

### Pricing

Pay per result: **$3.00 per 1,000 postings**, plus $0.00005 per run start. For example, 100 postings cost about $0.30. You only pay for the postings you receive, and platform usage is included in that price.

### Run it from your code

JavaScript:

```js
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('bibian/universal-job-postings-scraper').call({
  domains: ['remoteok.com'],
  keywords: 'python',
  maxItems: 50,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
```

Python:

```python
from apify_client import ApifyClient

client = ApifyClient(token="<APIFY_TOKEN>")
run = client.actor("bibian/universal-job-postings-scraper").call(run_input={
    "domains": [
        "remoteok.com"
    ],
    "keywords": "python",
    "maxItems": 50
})
items = client.dataset(run["defaultDatasetId"]).list_items().items
```

### Frequently asked questions

**Do I need an account, cookies or a proxy for the sites you list?** No. The actor reads publicly visible pages only.

**How do I get only the new postings every day?** Save a task, set its publication date filter to the shortest window, and schedule it daily with Apify Schedules. Deduplicate on the `id` field if you keep your own copy.

**Which formats can I export?** JSON, CSV, Excel, XML, HTML table or RSS, from the dataset page or through the API.

**Can I connect it to Make, Zapier, n8n or Google Sheets?** Yes, through Apify integrations and webhooks.

**Is it legal to scrape?** The actor collects publicly visible postings and respects the robots.txt rules of the site. How you use the data is your responsibility: check the site's terms and the laws that apply to you, for example the GDPR.

**Something does not work?** Open an issue in the Issues tab. Every public actor is test-run daily and the broken ones are repaired.

**Did this save you time?** A short review on the Store page helps other people find the actor, and tells me what to improve next.

### More job scrapers by the same author

- [Free-Work Jobs & Freelance Missions Scraper (France)](https://apify.com/bibian/free-work-jobs-scraper)
- [Infoempleo Jobs Scraper (Spain)](https://apify.com/bibian/infoempleo-jobs-scraper)
- [Codeur.com Freelance Projects Scraper (France)](https://apify.com/bibian/codeur-projects-scraper)
- [Greenhouse, Lever, Ashby & Workable Scraper](https://apify.com/bibian/multi-ats-jobs-scraper)
- [Welcome to the Jungle Scraper (Jobs, No Login)](https://apify.com/bibian/welcometothejungle-scraper)
- [Emploi-Territorial Jobs Scraper (French Public Sector)](https://apify.com/bibian/emploi-territorial-jobs-scraper)

# Actor input Schema

## `domains` (type: `array`):

Job boards or company career sites to read, for example `remoteok.com` or `jobs.example.com`. The actor finds the offers through each site's sitemap. Up to 50 domains.

## `startUrls` (type: `array`):

Optional. Addresses of a listing page or of a single offer. The actor reads them and follows the job links found on the same site. Use it when a site has no useful sitemap.

## `keywords` (type: `string`):

Keep only the postings whose title or description contains this text, for example `python` or `infirmier`.

## `jobUrlPattern` (type: `string`):

Optional regular expression that the address of an offer must match, for example `/offre/[0-9]+`. Leave empty to detect job pages automatically.

## `maxItems` (type: `integer`):

The run stops once this many postings are saved, across all domains.

## `maxItemsPerDomain` (type: `integer`):

Limit for each domain, so that one big site does not fill the whole run.

## `includeExpired` (type: `boolean`):

Keep postings whose declared end date is already past.

## `includeDescriptions` (type: `boolean`):

Adds the full job description as plain text.

## Actor input object example

```json
{
  "domains": [
    "remoteok.com",
    "www.infoempleo.com"
  ],
  "maxItems": 50,
  "maxItemsPerDomain": 50,
  "includeExpired": false,
  "includeDescriptions": true
}
```

# Actor output Schema

## `postings` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "remoteok.com",
        "www.infoempleo.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("bibian/universal-job-postings-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": [
        "remoteok.com",
        "www.infoempleo.com",
    ] }

# Run the Actor and wait for it to finish
run = client.actor("bibian/universal-job-postings-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "remoteok.com",
    "www.infoempleo.com"
  ]
}' |
apify call bibian/universal-job-postings-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,bibian/universal-job-postings-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/Wfh01zKCbgAtUYOld/builds/u71LE4m61NLJmhzBR/openapi.json