# Bundesagentur fΓΌr Arbeit Scraper (`scraper-engine/bundesagentur-fur-arbeit-scraper`) Actor - **URL**: https://apify.com/scraper-engine/bundesagentur-fur-arbeit-scraper.md - **Developed by:** [Scraper Engine](https://apify.com/scraper-engine) (community) - **Categories:** Jobs, Lead generation, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $4.99 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## πŸ‡©πŸ‡ͺ Bundesagentur fΓΌr Arbeit Job Scraper > πŸš€ **The fastest, most complete Arbeitsagentur.de job scraper on Apify.** Pull thousands of fresh German-language job postings β€” title, employer, salary notes, contract type, contact emails, full description, application URL and 30+ other fields β€” straight into a clean dataset. --- ### πŸ’‘ Why Choose This Scraper? - ⚑ **Blazing fast** β€” async, concurrent fetching of search pages **and** job details simultaneously. - 🎯 **Bulk input** β€” feed any number of Arbeitsagentur.de search URLs and get a single deduped dataset back. - πŸ›°οΈ **Smart proxy fallback** β€” starts direct, auto-escalates to Apify datacenter, then residential proxies on rate limits, then sticks with the upgraded tier. - πŸ’Ύ **Live saving** β€” every job is pushed to the dataset the moment it's ready. A crash mid-run never costs you data. - πŸ›‘οΈ **Production-grade error handling** β€” retries with exponential backoff on every external call. - πŸ“§ **Contact email extraction** β€” automatically pulls application emails out of job descriptions. - πŸ‡ͺπŸ‡Ί **DACH coverage** β€” postings from Germany, Austria, and Switzerland whenever Arbeitsagentur.de surfaces them. --- ### 🎯 Key Features | Feature | Description | |---------|-------------| | πŸ”— **Bulk URL input** | Drop any number of Arbeitsagentur.de search URLs | | πŸ”Ž **Keyword search** | Optional `position` + `location` fallback inputs | | πŸ›°οΈ **Adaptive proxy** | none β†’ datacenter β†’ residential (3 retries) escalation | | πŸ“Š **Rich output** | 38 normalized fields per job | | πŸ’Ύ **Live persistence** | `push_data` after every record β€” no data loss on crash | | πŸ” **Retry policy** | 3 attempts with exponential backoff + jitter | | πŸ“§ **Email extraction** | Regex-pulled application emails from descriptions | | πŸ†” **Deduplication** | By Arbeitsagentur reference number across queries | --- ### πŸ“₯ Input ```json { "startUrls": [ { "url": "https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin" } ], "position": "Softwareentwickler/in", "location": "Berlin", "maxItems": 100, "proxyConfiguration": { "useApifyProxy": false } } ```` | Field | Type | Required | Description | |-------|------|----------|-------------| | πŸ”— `startUrls` | array | βœ… | List of Arbeitsagentur.de job search URLs | | πŸ’Ό `position` | string | β›” | Keyword fallback when no URL is supplied | | πŸ“ `location` | string | β›” | German city, region, or postal code | | 🎯 `maxItems` | integer | β›” | Total result cap across all queries (default `100`) | | πŸ›°οΈ `proxyConfiguration` | object | β›” | Defaults to **no proxy**; auto-falls back on blocks | *** ### πŸ“€ Output Each dataset row looks like: ```json { "title": "Softwareentwickler/in", "mainJob": "Softwareentwickler/in", "descriptionText": "LOCATION: Villach, AT, 9500 REQ ID: 198751 ...", "jobType": "ARBEIT", "referenceNumber": "11949-17224369-S", "publishingStartDate": "2026-05-15", "firstPublicationDate": "2026-05-15", "lastUpdatedAt": "2026-05-15T17:04:43.169", "contractDuration": "UNBEFRISTET", "startDate": "2026-05-16", "salaryNote": "KEINE_ANGABEN", "employerName": "Lam Research AG", "employerWebsite": null, "employerIndustry": null, "location": "9500 Villach-Lind, KAERNTEN, OESTERREICH", "isFullTime": true, "isWorkFromHome": false, "externalURL": "https://jobs.ams.at/public/emps/jobs/...", "isExternal": true, "applicationEmail": null, "url": "https://www.arbeitsagentur.de/jobsuche/jobdetail/11949-17224369-S" } ``` Full list of returned fields: `title`, `mainJob`, `descriptionText`, `jobType`, `referenceNumber`, `publishingStartDate`, `firstPublicationDate`, `lastUpdatedAt`, `contractDuration`, `contractDurationLimitedTo`, `contractDurationMonths`, `startDate`, `entryPeriod`, `salaryNote`, `employerName`, `employerCustomerNumberHash`, `employerWebsite`, `employerIndustry`, `employerFirmSize`, `location`, `employerAddress`, `isFullTime`, `isMarginalEmployment`, `isPartTimeMorning`, `isPartTimeAfternoon`, `isPartTimeEvening`, `isPartTimeFlexible`, `isWorkFromHome`, `nightOrWeekendShift`, `isDisabilityRequired`, `isPrivateAgency`, `isTemporaryEmployment`, `externalURL`, `isExternal`, `applicationEmail`, `allianzpartnerName`, `allianzpartnerUrl`, `url`. *** ### πŸš€ How to Use (Apify Console) 1. πŸ” Log in at https://console.apify.com β†’ **Actors**. 2. πŸ”Ž Open this actor (Bundesagentur fΓΌr Arbeit Job Scraper). 3. βš™οΈ Configure inputs: - Paste one or more **Arbeitsagentur.de search URLs**, or - Provide a **position keyword** + optional **location**. - Set `maxItems` (default: 100). 4. ▢️ Click **Start**. 5. πŸ“œ Watch the live log β€” every saved job appears in real time. 6. πŸ“Š When the run finishes, open the **Output** tab. 7. πŸ“₯ Export as **JSON, CSV, XLSX, HTML, RSS or XML**. *** ### πŸ€– Use via API / curl Run synchronously and stream the dataset back: ```bash curl -X POST "https://api.apify.com/v2/acts/~bundesagentur-fur-arbeit-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{ "startUrls": [ { "url": "https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin" } ], "maxItems": 50 }' ``` Run asynchronously and poll: ```bash curl -X POST "https://api.apify.com/v2/acts/~bundesagentur-fur-arbeit-scraper/runs?token=$APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"startUrls":[{"url":"https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Pflegekraft"}],"maxItems":200}' ``` *** ### πŸ’Ό Best Use Cases - πŸ§‘β€πŸ’Ό **Recruiters** β€” track open vacancies in your sector and city - 🏒 **HR Tech / ATS vendors** β€” enrich your job feed with German listings - πŸ“Š **Market research** β€” analyse the German labor market by region, industry, contract type - πŸ€– **Job aggregators** β€” build vertical job boards on top of the official German source - πŸ“° **Journalists / analysts** β€” quote real numbers on supply and demand *** ### πŸ’° Pricing This actor is on **pay-per-event (PPE)**. | Event | Description | Why | |-------|-------------|-----| | πŸš€ `apify-actor-start` | One charge per run start | Covers warm-up compute | | πŸ“„ `apify-default-dataset-item` | One charge per saved job posting | Pay only for results you actually receive | Synthetic events are configured in the Apify Console. You only pay for **successful, saved results** β€” no data, no charge. *** ### ❓ Frequently Asked Questions **Q: Where does the data come from?** A: The official Arbeitsagentur.de public job search API (the same one powering the website's search and detail pages). **Q: Do I need a proxy?** A: No. The actor defaults to a direct connection. If the upstream rate-limits us, the proxy strategy auto-escalates to Apify datacenter, then residential proxies β€” no input needed. **Q: How fresh is the data?** A: It's a live API call on every run β€” what you get is what Arbeitsagentur.de is serving right now. **Q: How many results can I scrape?** A: As many as Arbeitsagentur.de exposes β€” set `maxItems` to the upper bound you want. **Q: Are application emails always available?** A: No β€” only when the employer included a contact email inside the public description text. We regex-extract whenever present. **Q: Why are some jobs from Austria?** A: Arbeitsagentur.de partners with AMS (Austria) and shows DACH-region postings. We expose the `allianzpartnerName` field so you can filter. *** ### πŸ›‘οΈ Cautions / Legal - 🌐 All data comes from publicly available endpoints. - βš–οΈ End users are responsible for compliance with **GDPR**, the target site's ToS, and any local regulations. - 🀝 The actor honors reasonable rate limits and uses exponential backoff to be a good API citizen. *** ### πŸ“¬ Support & Feedback Spotted a bug? Need a new field? Open an issue from the Apify Console β€” we read every report. πŸ™Œ *** **Built with ❀️ on Apify Β· 2026** # Actor input Schema ## `startUrls` (type: `array`): πŸ“‹ Paste one or more Arbeitsagentur.de job search URLs. Each URL can contain its own filters (keyword, location, contract type, etc.). Example: https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1\&was=Softwareentwickler%2Fin ## `position` (type: `string`): πŸ” Optional keyword used when no search URL is provided (e.g. "Softwareentwickler/in", "Pflegekraft", "Lehrer"). Combined with location below. ## `location` (type: `string`): πŸ™οΈ Optional German city, region or postal code (e.g. "Berlin", "MΓΌnchen", "10115"). Used only when keyword search is active. ## `maxItems` (type: `integer`): πŸ”’ Hard cap on total job postings returned across all search URLs / keywords. Leave large for full pulls; lower it for quick tests. ## `proxyConfiguration` (type: `object`): πŸ›‘οΈ By default the actor goes direct. If Arbeitsagentur.de rate-limits or blocks, it auto-falls back to Apify datacenter and then residential proxies. You can override here. ## Actor input object example ```json { "startUrls": [ "https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin" ], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": false } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ "https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin" ], "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("scraper-engine/bundesagentur-fur-arbeit-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": ["https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin"], "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("scraper-engine/bundesagentur-fur-arbeit-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ "https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin" ], "proxyConfiguration": { "useApifyProxy": false } }' | apify call scraper-engine/bundesagentur-fur-arbeit-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scraper-engine/bundesagentur-fur-arbeit-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Bundesagentur fΓΌr Arbeit Scraper", "description": null, "version": "0.1", "x-build-id": "OmXgjOrQ5OEyno1WF" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scraper-engine~bundesagentur-fur-arbeit-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scraper-engine-bundesagentur-fur-arbeit-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scraper-engine~bundesagentur-fur-arbeit-scraper/runs": { "post": { "operationId": "runs-sync-scraper-engine-bundesagentur-fur-arbeit-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scraper-engine~bundesagentur-fur-arbeit-scraper/run-sync": { "post": { "operationId": "run-sync-scraper-engine-bundesagentur-fur-arbeit-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "πŸ”— Search URLs (bulk)", "type": "array", "description": "πŸ“‹ Paste one or more Arbeitsagentur.de job search URLs. Each URL can contain its own filters (keyword, location, contract type, etc.). Example: https://www.arbeitsagentur.de/jobsuche/suche?angebotsart=1&was=Softwareentwickler%2Fin", "items": { "type": "string" } }, "position": { "title": "πŸ’Ό Job Position / Keyword", "type": "string", "description": "πŸ” Optional keyword used when no search URL is provided (e.g. \"Softwareentwickler/in\", \"Pflegekraft\", \"Lehrer\"). Combined with location below." }, "location": { "title": "πŸ“ Location", "type": "string", "description": "πŸ™οΈ Optional German city, region or postal code (e.g. \"Berlin\", \"MΓΌnchen\", \"10115\"). Used only when keyword search is active." }, "maxItems": { "title": "🎯 Maximum results", "minimum": 1, "maximum": 100000, "type": "integer", "description": "πŸ”’ Hard cap on total job postings returned across all search URLs / keywords. Leave large for full pulls; lower it for quick tests.", "default": 10 }, "proxyConfiguration": { "title": "πŸ›°οΈ Proxy Configuration", "type": "object", "description": "πŸ›‘οΈ By default the actor goes direct. If Arbeitsagentur.de rate-limits or blocks, it auto-falls back to Apify datacenter and then residential proxies. You can override here.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```