dm.de Product Search Scraper: Extract Beauty & Health Product Data

---

What Is dm.de?

dm.de is Germany's leading pharmacy and drugstore chain, offering an extensive online catalog of health, wellness, beauty, and personal care products. With thousands of SKUs across categories like skincare, cosmetics, vitamins, and household items, dm.de attracts millions of shoppers monthly. Extracting structured product data from dm.de search results manually is cumbersome — the dm.de Product Search Scraper automates this, delivering clean, machine-readable product records at scale.

---

Overview

The dm.de Product Search Scraper extracts product information from dm.de search result pages, converting listings into structured data records. It is designed for:

• Price monitors tracking competitor pricing and promotions
• Market researchers analyzing product assortments and trends
• E-commerce aggregators feeding product data into comparison platforms
• Business intelligence teams benchmarking product availability and ratings

Key strengths include pagination support via currentPage parameters, configurable item limits, and error resilience with ignore_url_failures.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://www.dm.de/search?query=lips&searchProviderType=dm-products&currentPage=4&loadPrev=false"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Field	Type	Description
urls	array	Direct links to dm.de product search result pages. Include full URL with search parameters.
max_items_per_url	integer	Maximum products to extract per URL (e.g., 200). Adjust based on your needs.
ignore_url_failures	boolean	If true, scraper continues if some URLs fail; if false, execution stops on first error.

Tips:

• Search URLs must include ?query= parameter (e.g., lips, vitamin c, sunscreen)
• Use currentPage=1, 2, 3 etc. to scrape multiple pages of results for the same query
• loadPrev=false is typically the default; keep it consistent across runs

---

Output Format

Sample output

{
  "a11y_label": "Marke: MAX FACTOR; Produktname: Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve, 3,5 g; Preis: 11,95 €",
  "brand": {
    "name": "MAX FACTOR"
  },
  "dan": 3116500,
  "eyecatchers": null,
  "gtin": 3616307187565,
  "images": [
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F1F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1764855177/assets/pas/images/6b8a692c-5958-4c4d-a92c-dffd7e745107/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F1F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1769814259/assets/pas/images/f04b0dbc-3607-4730-b007-03da1affc3c3/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F1F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1764855170/assets/pas/images/194cb6d8-66ed-4444-b08a-d39b44bf244a/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F1F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773353921/assets/pas/images/32f9c4a7-876c-4893-8fa5-f873e2b5911c/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F2F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773353943/assets/pas/images/d9f86071-5220-4eca-b99a-23094e8b234b/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F2F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773353931/assets/pas/images/484854a7-1e8f-4ed0-8711-a0f9cd8ab071/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F1F2",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773443569/assets/pas/images/2acaa11b-1641-472c-b3b8-b3c56a97453f/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F2F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773443556/assets/pas/images/4d1a1c05-797b-4508-b857-091982a6fbc1/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    },
    {
      "alt": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve MAX FACTOR",
      "background_color": "#F9F3F1",
      "tile_src": "https://products.dm-static.com/images/f_auto,q_auto,c_fit,h_320,w_320/v1773443563/assets/pas/images/2983b02a-b094-4d7d-9702-2a5b8e33c61c/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve"
    }
  ],
  "is_pharmacy": false,
  "net_price": {
    "prefix": "Einzelpreis",
    "price": {
      "current": {
        "value": "10,04 €"
      }
    }
  },
  "price": {
    "prefix": "Einzelpreis",
    "price": {
      "current": {
        "value": "11,95 €"
      }
    }
  },
  "rating": {
    "rating_count": 31,
    "rating_value": 4.4839
  },
  "self": "/p/d/3116500/max-factor-lippenstift-2000-calorie-mellow-blur-010-mochi-mauve",
  "title": {
    "tile_headline": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi..., 3,5 g",
    "tile_headline_long": "Lippenstift 2000 Calorie Mellow Blur 010 Mochi Mauve, 3,5 g"
  },
  "tracking_data": {
    "brand": "MAX FACTOR",
    "categories": [
      "Lippenstift"
    ],
    "currency": "EUR",
    "is_pharmacy": false,
    "price": 11.95
  },
  "from_url": "https://www.dm.de/search?query=lips&searchProviderType=dm-products"
}

Each product record includes 14 core fields with detailed information:

Core Product Identity

Field	Meaning	Example
Title	Product name as displayed on dm.de	"Neutrogena Ultra Sheer Dry-Touch Sunscreen SPF 50+"
Brand	Manufacturer or brand name	"Neutrogena"
DAN	dm.de Article Number (unique internal ID)	"3574660"
GTIN	Global Trade Item Number (barcode)	"9300612345678"

Pricing & Availability

Field	Meaning	Example
Price	Current retail price in EUR	"12.99"
Net Price	Price excluding VAT (net value)	"10.99"
Is Pharmacy	Boolean flag indicating if product requires pharmacy license	true or false

Product Presentation

Field	Meaning	Example
Images	Array of product image URLs	["https://cdn.dm.de/product-1.jpg", ...]
Eyecatchers	Special labels/badges (e.g., "new", "sale", "bio")	["new arrival", "organic"]
A11y Label	Accessibility label for screen readers	"Sunscreen lotion, SPF 50, 200ml bottle"

Social Proof & Navigation

Field	Meaning	Example
Rating	Customer review score (typically 1-5 stars)	4.7
Tracking Data	Internal tracking IDs for analytics	{"campaignId": "...", "source": "..."}
Self	Product metadata and self-referential links	{"url": "https://www.dm.de/product/...", "id": "..."}

Notes:

• Prices are in EUR and include applicable German VAT
• Is Pharmacy indicates whether the product is subject to pharmacy-only restrictions
• Images may contain multiple URLs for different product angles or variants
• Rating data is only available if the product has customer reviews

---

How to Use

1. Build search URLs — Go to dm.de, search for a product category (e.g., "lips", "vitamin c"), and copy the search result page URL.
2. Modify pagination — Change currentPage=1 to currentPage=2, etc., for multi-page scrapes.
3. Configure input — Paste URLs into the urls array. Set max_items_per_url to your target volume (e.g., 50–200).
4. Enable robustness — Keep ignore_url_failures: true to prevent one bad URL from stopping the entire run.
5. Execute & export — Run the scraper and download results as JSON, CSV, or Excel.

Troubleshooting:

• If products appear empty, verify the search URL is a result page (not a category or filter page).
• Some products may lack ratings if they are newly listed or have few reviews.
• Pharmacy-flagged products (Is Pharmacy: true) may have restricted availability.

---

Use Cases & Business Value

• Dynamic price monitoring: Track price fluctuations on competing beauty and health products in real-time
• Market intelligence: Identify trending brands, product variants, and category gaps in the German market
• Assortment analysis: Compare your product catalog against dm.de's offerings
• Content aggregation: Feed product images, titles, and ratings into e-commerce platforms or review sites
• Promotional tracking: Monitor eyecatcher labels to identify sales and new product launches

The dm.de Product Search Scraper eliminates manual browsing, enabling data-driven decisions for pricing strategy, product sourcing, and competitive positioning.

---

Conclusion

The dm.de Product Search Scraper is a powerful tool for anyone needing structured beauty and health product data from Germany's largest pharmacy chain. With 14+ fields per product and flexible pagination, it transforms search results into actionable insights for retailers, researchers, and analysts. Start scraping today and gain a competitive edge in the health and beauty market.