# ImmobilienScout24 Real Estate Scraper (`crawlerbros/immoscout24-scraper`) Actor Scrape property listings (apartments, houses, for-sale and rental) from ImmobilienScout24.de with price, living space, rooms, address, realtor, features, images. - **URL**: https://apify.com/crawlerbros/immoscout24-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Real estate, Other, Automation - **Stats:** 1 total users, 0 monthly users, 100.0% runs succeeded, 16 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $1.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## ImmobilienScout24 Real Estate Scraper Scrape property listings from [ImmobilienScout24.de](https://www.immobilienscout24.de), Germany's largest real-estate portal — apartments (`Wohnung`), houses (`Haus`), for-sale and rental inventory. Extracts price, living space, room count, address, realtor, features, images and more. ### Output (per listing) - `type` = `immoscout24_listing` - `id`, `url`, `title` - `price`, `priceCurrency` (`EUR`) - `livingSpace` (m2), `rooms`, `floor`, `yearBuilt`, `energyCertificate` - `address`, `postcode`, `city`, `district` - `latitude`, `longitude` - `images` (array), `features` (array) - `realtor`, `realtorPhone` - `scrapedAt` Fields are only emitted when populated (no nulls). When every residential session is blocked by Cloudflare, the actor emits a single `immoscout24_blocked` sentinel record so the run exits 0. ### Input | Field | Type | Description | |---|---|---| | `searchUrls` | string[] | ImmoScout24 search result URLs (`https://www.immobilienscout24.de/Suche/...`) or direct exposé URLs. Default: `Wohnung-Kauf` nationwide. | | `maxItems` | integer | Max listings to return (default 3, max 500). | | `proxyConfiguration` | object | **Required** Apify RESIDENTIAL DE proxy (hardcoded — do not change). | ### How it works 1. Each `searchUrls` entry is visited through a Patchright (undetected Chromium) session routed over Apify RESIDENTIAL DE. 2. Cloudflare JS challenge is polled for up to 30s per page before giving up on the session. 3. Search results are parsed for expose IDs; each exposé is fetched, parsed from the inline `window.IS24` JSON and JSON-LD fallbacks. 4. Up to 5 residential sessions are rotated with fresh session IDs if a proxy IP is flagged. ### FAQ **Why do I need a RESIDENTIAL DE proxy?** ImmoScout24 is fronted by Cloudflare and geo-checks visitors. Datacenter IPs and non-DE IPs are challenged and return CAPTCHA pages. A German residential IP is required for consistent access. **Can I scrape rentals (`Wohnung-Miete`)?** Yes. Pass any ImmoScout24 search URL, including rental searches (`/Suche/S-T/Wohnung-Miete`), city-specific paths (`/Suche/de/berlin/berlin/wohnung-kaufen`), or direct exposé URLs (`/expose/`). **Why is my run reporting `immoscout24_blocked` with 0 listings?** Residential IPs rotate — Cloudflare occasionally flags a fresh IP. Simply re-run the actor and a new session will be issued. **Are the fields always populated?** The scraper only emits fields it can extract, so the output is free of null values. Required-always fields are `type`, `url`, `id`, `scrapedAt` on every listing record. # Actor input Schema ## `searchUrls` (type: `array`): ImmobilienScout24 search-result URLs (https://www.immobilienscout24.de/Suche/...) or direct exposé URLs. Each URL is enumerated and every listing on the page is scraped up to maxItems. ## `maxItems` (type: `integer`): Maximum number of property listings to return. ## `proxyConfiguration` (type: `object`): Apify RESIDENTIAL DE proxy is REQUIRED — ImmobilienScout24 blocks datacenter IPs at the Cloudflare layer. Do not change these settings. ## Actor input object example ```json { "searchUrls": [ "https://www.immobilienscout24.de/Suche/S-T/Wohnung-Kauf" ], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "DE" } } ```` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchUrls": [ "https://www.immobilienscout24.de/Suche/S-T/Wohnung-Kauf" ], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "DE" } }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/immoscout24-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchUrls": ["https://www.immobilienscout24.de/Suche/S-T/Wohnung-Kauf"], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "DE", }, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/immoscout24-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchUrls": [ "https://www.immobilienscout24.de/Suche/S-T/Wohnung-Kauf" ], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "DE" } }' | apify call crawlerbros/immoscout24-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/immoscout24-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "ImmobilienScout24 Real Estate Scraper", "description": "Scrape property listings (apartments, houses, for-sale and rental) from ImmobilienScout24.de with price, living space, rooms, address, realtor, features, images.", "version": "1.0", "x-build-id": "krSVuZGfkKcU5FVvh" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~immoscout24-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-immoscout24-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~immoscout24-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-immoscout24-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~immoscout24-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-immoscout24-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchUrls" ], "properties": { "searchUrls": { "title": "Search / Listing URLs", "type": "array", "description": "ImmobilienScout24 search-result URLs (https://www.immobilienscout24.de/Suche/...) or direct exposé URLs. Each URL is enumerated and every listing on the page is scraped up to maxItems.", "default": [ "https://www.immobilienscout24.de/Suche/S-T/Wohnung-Kauf" ], "items": { "type": "string" } }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of property listings to return.", "default": 3 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Apify RESIDENTIAL DE proxy is REQUIRED — ImmobilienScout24 blocks datacenter IPs at the Cloudflare layer. Do not change these settings.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "DE" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```