# Dm.de Product Search Scraper (`stealth_mode/dm-product-search-scraper`) Actor Scrape product listings from dm.de search results instantly. This scraper collects titles, prices, ratings, brands, images, pharmacy status, and 14+ fields per product — perfect for price monitoring, market research, and competitive analysis. - **URL**: https://apify.com/stealth\_mode/dm-product-search-scraper.md - **Developed by:** [Stealth mode](https://apify.com/stealth_mode) (community) - **Categories:** Automation, Developer tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## dm.de Product Search Scraper: Extract Beauty & Health Product Data --- ### What Is dm.de? dm.de is Germany's leading pharmacy and drugstore chain, offering an extensive online catalog of health, wellness, beauty, and personal care products. With thousands of SKUs across categories like skincare, cosmetics, vitamins, and household items, dm.de attracts millions of shoppers monthly. Extracting structured product data from dm.de search results manually is cumbersome — the **dm.de Product Search Scraper** automates this, delivering clean, machine-readable product records at scale. --- ### Overview The **dm.de Product Search Scraper** extracts product information from dm.de search result pages, converting listings into structured data records. It is designed for: - **Price monitors** tracking competitor pricing and promotions - **Market researchers** analyzing product assortments and trends - **E-commerce aggregators** feeding product data into comparison platforms - **Business intelligence teams** benchmarking product availability and ratings Key strengths include pagination support via `currentPage` parameters, configurable item limits, and error resilience with `ignore_url_failures`. --- ### Input Format The scraper accepts a JSON configuration object: ```json { "urls": [ "https://www.dm.de/search?query=lips&searchProviderType=dm-products¤tPage=4&loadPrev=false" ], "ignore_url_failures": true, "max_items_per_url": 200 } ```` | Field | Type | Description | |---|---|---| | `urls` | array | Direct links to dm.de product search result pages. Include full URL with search parameters. | | `max_items_per_url` | integer | Maximum products to extract per URL (e.g., `200`). Adjust based on your needs. | | `ignore_url_failures` | boolean | If `true`, scraper continues if some URLs fail; if `false`, execution stops on first error. | **Tips:** - Search URLs must include `?query=` parameter (e.g., `lips`, `vitamin c`, `sunscreen`) - Use `currentPage=1`, `2`, `3` etc. to scrape multiple pages of results for the same query - `loadPrev=false` is typically the default; keep it consistent across runs *** ### Output Format **Sample output** ```json { "a11y_label": "Marke: MAX FACTOR; Produktname: Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve, 3,5 g; Preis: 11,95 €", "brand": { "name": "MAX FACTOR" }, "dan": 3116500, "eyecatchers": null, "gtin": 3616307187565, "images": [ { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F1F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1764855177/assets/pas/images/6b8a692c-5958-4c4d-a92c-dffd7e745107/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F1F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1769814259/assets/pas/images/f04b0dbc-3607-4730-b007-03da1affc3c3/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F1F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1764855170/assets/pas/images/194cb6d8-66ed-4444-b08a-d39b44bf244a/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F1F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773353921/assets/pas/images/32f9c4a7-876c-4893-8fa5-f873e2b5911c/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F2F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773353943/assets/pas/images/d9f86071-5220-4eca-b99a-23094e8b234b/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F2F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773353931/assets/pas/images/484854a7-1e8f-4ed0-8711-a0f9cd8ab071/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F1F2", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773443569/assets/pas/images/2acaa11b-1641-472c-b3b8-b3c56a97453f/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F2F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773443556/assets/pas/images/4d1a1c05-797b-4508-b857-091982a6fbc1/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" }, { "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR", "background_color": "#F9F3F1", "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773443563/assets/pas/images/2983b02a-b094-4d7d-9702-2a5b8e33c61c/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve" } ], "is_pharmacy": false, "net_price": { "prefix": "Einzelpreis", "price": { "current": { "value": "10,04 €" } } }, "price": { "prefix": "Einzelpreis", "price": { "current": { "value": "11,95 €" } } }, "rating": { "rating_count": 31, "rating_value": 4.4839 }, "self": "/p/d/3116500/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve", "title": { "tile_headline": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi..., 3,5 g", "tile_headline_long": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve, 3,5 g" }, "tracking_data": { "brand": "MAX FACTOR", "categories": [ "Lippenstift" ], "currency": "EUR", "is_pharmacy": false, "price": 11.95 }, "from_url": "https://www.dm.de/search?query=lips&searchProviderType=dm-products" } ``` Each product record includes 14 core fields with detailed information: #### Core Product Identity | Field | Meaning | Example | |---|---|---| | `Title` | Product name as displayed on dm.de | "Neutrogena Ultra Sheer Dry-Touch Sunscreen SPF 50+" | | `Brand` | Manufacturer or brand name | "Neutrogena" | | `DAN` | dm.de Article Number (unique internal ID) | "3574660" | | `GTIN` | Global Trade Item Number (barcode) | "9300612345678" | #### Pricing & Availability | Field | Meaning | Example | |---|---|---| | `Price` | Current retail price in EUR | "12.99" | | `Net Price` | Price excluding VAT (net value) | "10.99" | | `Is Pharmacy` | Boolean flag indicating if product requires pharmacy license | `true` or `false` | #### Product Presentation | Field | Meaning | Example | |---|---|---| | `Images` | Array of product image URLs | `["https://cdn.dm.de/product-1.jpg", ...]` | | `Eyecatchers` | Special labels/badges (e.g., "new", "sale", "bio") | `["new arrival", "organic"]` | | `A11y Label` | Accessibility label for screen readers | "Sunscreen lotion, SPF 50, 200ml bottle" | #### Social Proof & Navigation | Field | Meaning | Example | |---|---|---| | `Rating` | Customer review score (typically 1-5 stars) | `4.7` | | `Tracking Data` | Internal tracking IDs for analytics | `{"campaignId": "...", "source": "..."}` | | `Self` | Product metadata and self-referential links | `{"url": "https://www.dm.de/product/...", "id": "..."}` | **Notes:** - Prices are in EUR and include applicable German VAT - `Is Pharmacy` indicates whether the product is subject to pharmacy-only restrictions - `Images` may contain multiple URLs for different product angles or variants - `Rating` data is only available if the product has customer reviews *** ### How to Use 1. **Build search URLs** — Go to dm.de, search for a product category (e.g., "lips", "vitamin c"), and copy the search result page URL. 2. **Modify pagination** — Change `currentPage=1` to `currentPage=2`, etc., for multi-page scrapes. 3. **Configure input** — Paste URLs into the `urls` array. Set `max_items_per_url` to your target volume (e.g., 50–200). 4. **Enable robustness** — Keep `ignore_url_failures: true` to prevent one bad URL from stopping the entire run. 5. **Execute & export** — Run the scraper and download results as JSON, CSV, or Excel. **Troubleshooting:** - If products appear empty, verify the search URL is a result page (not a category or filter page). - Some products may lack ratings if they are newly listed or have few reviews. - Pharmacy-flagged products (`Is Pharmacy: true`) may have restricted availability. *** ### Use Cases & Business Value - **Dynamic price monitoring:** Track price fluctuations on competing beauty and health products in real-time - **Market intelligence:** Identify trending brands, product variants, and category gaps in the German market - **Assortment analysis:** Compare your product catalog against dm.de's offerings - **Content aggregation:** Feed product images, titles, and ratings into e-commerce platforms or review sites - **Promotional tracking:** Monitor eyecatcher labels to identify sales and new product launches The dm.de Product Search Scraper eliminates manual browsing, enabling data-driven decisions for pricing strategy, product sourcing, and competitive positioning. *** ### Conclusion The **dm.de Product Search Scraper** is a powerful tool for anyone needing structured beauty and health product data from Germany's largest pharmacy chain. With 14+ fields per product and flexible pagination, it transforms search results into actionable insights for retailers, researchers, and analysts. Start scraping today and gain a competitive edge in the health and beauty market. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## Actor input object example ```json { "urls": [ "https://www.dm.de/search?query=lips&searchProviderType=dm-products¤tPage=4&loadPrev=false" ], "ignore_url_failures": true, "max_items_per_url": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.dm.de/search?query=lips&searchProviderType=dm-products¤tPage=4&loadPrev=false" ], "ignore_url_failures": true, "max_items_per_url": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("stealth_mode/dm-product-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.dm.de/search?query=lips&searchProviderType=dm-products¤tPage=4&loadPrev=false"], "ignore_url_failures": True, "max_items_per_url": 20, } # Run the Actor and wait for it to finish run = client.actor("stealth_mode/dm-product-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.dm.de/search?query=lips&searchProviderType=dm-products¤tPage=4&loadPrev=false" ], "ignore_url_failures": true, "max_items_per_url": 20 }' | apify call stealth_mode/dm-product-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=stealth_mode/dm-product-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Dm.de Product Search Scraper", "description": "Scrape product listings from dm.de search results instantly. This scraper collects titles, prices, ratings, brands, images, pharmacy status, and 14+ fields per product — perfect for price monitoring, market research, and competitive analysis.", "version": "0.0", "x-build-id": "cqOjXAQyoYrRpepJ4" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/stealth_mode~dm-product-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-stealth_mode-dm-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/stealth_mode~dm-product-search-scraper/runs": { "post": { "operationId": "runs-sync-stealth_mode-dm-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/stealth_mode~dm-product-search-scraper/run-sync": { "post": { "operationId": "run-sync-stealth_mode-dm-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the product search list urls to scrape", "type": "array", "description": "Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```