Chemist Warehouse Product Search Scraper: Extract Pharmacy Data at Scale

---

About Chemist Warehouse

Chemist Warehouse is Australia's largest pharmacy retailer, offering over 10,000+ health and beauty products online. The platform hosts competitive pricing, detailed product information, customer reviews, and real-time stock data. For price analysts, e-commerce researchers, and competitors monitoring retail trends, manual data collection from search results is impractical — the Chemist Warehouse Product Search Scraper automates this process, delivering structured data from any product search query.

---

Overview

The Chemist Warehouse Product Search Scraper extracts product listings from search results pages, converting unstructured product cards into clean, structured records. It is designed for:

• Price comparison platforms aggregating Australian pharmacy pricing
• Market researchers analyzing health & beauty product availability and trends
• E-commerce developers building price monitoring systems
• Retailers tracking competitor inventory and positioning
• Data analysts studying pharmaceutical and OTC product markets

Key strengths include flexible URL configuration for any search query, configurable item limits, robust error handling, and comprehensive product metadata (pricing, stock, attributes, images).

---

Input Format

The scraper accepts a JSON configuration object targeting Chemist Warehouse search result pages:

{
  "urls": [
    "https://www.chemistwarehouse.com.au/search?query=lips&contexts=default&page=2"
  ],
  "max_items_per_url": 200,
  "ignore_url_failures": true
}

Parameter	Type	Description
urls	Array	Search result URLs from chemistwarehouse.com.au. Any search query works (e.g., "vitamins", "skincare", "pain relief")
max_items_per_url	Integer	Maximum products to extract per URL (range: 1–500). Default: 200
ignore_url_failures	Boolean	If true, scraper continues if URLs fail. Set false to halt on errors

Example URLs:

• https://www.chemistwarehouse.com.au/search?query=vitamin+d
• https://www.chemistwarehouse.com.au/search?query=sunscreen&page=3

Tip: Pagination parameters are auto-handled. Paste any search URL; the scraper extracts all product results up to your max_items_per_url limit.

---

Output Format

Sample output

{
  "attributes": {
    "p_i_m_s_percentage_discount": 17.66,
    "cwr-adult-product": false,
    "cwr-algolia-price": "1399",
    "cwr-au-allowed-schedule-prices": [],
    "cwr-au-appendix-h": false,
    "cwr-au-click-and-collect": true,
    "cwr-au-directions": {
      "en": "Smushy Matte Lip Balm is designed with a flexible, silicone applicator tip for a super-soft glide and even softer lips! 1. Unscrew the cap on your Smushy Matte Lip Balm. 2. Squeeze out enough liquid lip balm to coat the tip of the silicone applicator. 3. Apply to lips, starting at the center and working outward. 4. Apply more coats of lip balm as desired for a deeper lip colour. 5. And that's it! Smooth, comfy-matte lips in a single smush."
    },
    "cwr-au-express-only": false,
    "cwr-au-ingredients": {
      "en": "DIMETHICONE &bull;  DIMETHICONE/VINYL DIMETHICONE CROSSPOLYMER &bull;  DIMETHICONE/VINYLTRIMETHYLSILOXYSILICATE CROSSPOLYMER &bull;  BARIUM SULFATE &bull;  POLYGLYCERYL-2 TRIISOSTEARATE &bull;  TRIBEHENIN &bull;  ACRYLATES COPOLYMER &bull;  PEG-10 DIMETHICONE &bull;  BUTYROSPERMUM PARKII BUTTER / SHEA BUTTER &bull;  PARFUM / FRAGRANCE &bull;  CERAMIDE NP &bull;  TOCOPHERYL ACETATE &bull;  ORYZA SATIVA POWDER / RICE POWDER &bull;  DEHYDROACETIC ACID &bull;  BENZYL BENZOATE (F.I.L. N70057079/1).<br />All reasonable efforts have been made to ensure that ingredient listings, product images, makeup shades and colour swatches and other information for products displayed on this website are up to date, accurate and complete. However, we still recommend that you please check the ingredient listings on a product before use.<br /><br /><br />Please be aware that ingredient lists for the products of our brand are updated regularly. Please refer to the ingredient list on your product package for the most up to date list of ingredients to ensure it is suitable to your personal use."
    },
    "cwr-au-international-shipping": false,
    "cwr-au-marketplace": false,
    "cwr-au-omni-min-stock": 100,
    "cwr-au-prescription-type": {
      "key": "none",
      "label": "None"
    },
    "cwr-au-schedule": {
      "key": "none",
      "label": "None"
    },
    "cwr-brand": {
      "key": "nyx",
      "label": {
        "en": "NYX"
      }
    },
    "cwr-cannabis": false,
    "cwr-depth": 23.6,
    "cwr-epid": 156544,
    "cwr-fast-delivery": true,
    "cwr-generic-brand": false,
    "cwr-height": 89.5,
    "cwr-hide-rrp": false,
    "cwr-manufacturer": {
      "key": "loreal_australia_pty_ltd",
      "label": {
        "en": "L'Oreal Australia Pty Ltd"
      }
    },
    "cwr-multipack-qty": 1,
    "cwr-patient-profile": false,
    "cwr-preferred-generic": false,
    "cwr-product-flags": [
      "in_catalogue"
    ],
    "cwr-review-rating": 4.6625,
    "cwr-review-rating-count": 80,
    "cwr-shipping": {
      "key": "yes",
      "label": "Yes"
    },
    "cwr-supplier-content": {
      "en": "<link rel=\"stylesheet\" type=\"text/css\" href=\"https://legacy-api.chemistwarehouse.com.au/cmsglobalfiles/css/rich-content.css\"> <div id=\"sku_cwhhtml\" class=\"extended\"><div id=\"SKU-SKUItem1-row1\" class=\"extended-row\"><a class=\"image_enlarger\" title=\"LORE\" href=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-1-1.jpeg\" data-title=\"LORE\" data-lightbox=\"EnrichedContentGroup\"><img src=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-1-1.jpeg\" alt=\"LORE\" u=\"image\" itemprop=\"image\"></a></div><div id=\"SKU-SKUItem2-row1\" class=\"extended-row\"><a class=\"image_enlarger\" title=\"LORE\" href=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-2-1.jpeg\" data-title=\"LORE\" data-lightbox=\"EnrichedContentGroup\"><img src=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-2-1.jpeg\" alt=\"LORE\" u=\"image\" itemprop=\"image\"></a></div><div id=\"SKU-SKUItem3-row1\" class=\"extended-row\"><a class=\"image_enlarger\" title=\"LORE\" href=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-3-1.jpeg\" data-title=\"LORE\" data-lightbox=\"EnrichedContentGroup\"><img src=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-3-1.jpeg\" alt=\"LORE\" u=\"image\" itemprop=\"image\"></a></div><div id=\"SKU-SKUItem4-row1\" class=\"extended-row\"><a class=\"image_enlarger\" title=\"LORE\" href=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-4-1.jpeg\" data-title=\"LORE\" data-lightbox=\"EnrichedContentGroup\"><img src=\"https://richcontent.skulibrary.com/LORE/800897271015/1/LORE_800897271015-4-1.jpeg\" alt=\"LORE\" u=\"image\" itemprop=\"image\"></a></div></div>"
    },
    "cwr-ub-omni-min-stock": 5,
    "cwr-weight": 16.1,
    "cwr-width": 29.5,
    "description": {
      "en": "<p>A soft-matte buildable lip color infused with mochi rice powder and sugar ceramides in 8 shades.</p>  Meet our new Smushy Matte Lip Balm! Get this smushy-soft tinted lip balm that delivers a plush, blurred effect and a trendy soft-matte finish. Loaded with mochi rice powder and sugar ceramides, this hydrating lip balm's weightless texture cushions lips in a dreamy, diffused colour. The smushy-soft texture glides on effortlessly with a comfy lip balm feel that lasts all day. Moisture-Locking Ingredients: Infused with Mochi Rice Powder and Sugar Ceramides to lock in lip moisture, experience weightless, pillow-soft lips all day long with our ultra-soft hydrating lip balm. Buildable Soft-Blur Colour: Smushy soft lips in just 1 squeeze! Smush and swipe for the perfect wash of soft matte tinted lip balm colour. Build it up for a more intense look or keep it sheer and sweet. Unique Smushy-Sweet Scent: Each Smushy shade of this scented lip balm features a unique, delicious scent for a truly delightful sensory experience. Collect them all! 8 Craveable Shades: Just swipe on liquid lip balm for a perfect wash of buildable, soft-blur lip colour with our blurring lip balm formula. Whether you're feeling a barely-there nude, a pop of vibrant pink, or a deep berry moment, Smushy Matte Lip Balm has you covered. Explore our range of 8 craveable shades designed for every mood and occasion. Smushy Soft Lip Applicator: The ultra-soft silicone applicator ensures smooth, even application of the liquid lip balm, wrapping your lips in a pillowy-soft colour. Find your perfect match and unleash your inner makeup artist! Smushy Matte Lip Balm is lip care, redefined. Cruelty-free, vegan, and seriously addictive, our blurring lip balm is like a soft hug for your lips. Smush it, love it, flaunt it. <p>Size:  8ml</p>  <p>Fragrance:  NA</p>  <p>KEY FEATURES</p>  &bull; Smack, smooch, and smush with our new Smushy Matte Lip Balm for soft-diffused, comfy matte lip color! Check out these smackin' benefits: Soft matte finish.<br/> &bull; Infused with mochi rice powder and sugar ceramides for an ultra-soft feel.<br/> &bull; Ultra-soft silicone applicator: lip balm applies evenly, easily, and smoothly.<br/> &bull; Blurs the appearance of lip lines and does not settle into lip lines.<br/> &bull; Diffused, blurred colour.<br/>"
    },
    "gwp_product": false,
    "instant_consult": false,
    "mandatory_code": {
      "key": "None",
      "label": {
        "en": "None"
      }
    },
    "pims_volume": 62.31,
    "practitioner_use": false,
    "product_form": {
      "key": "balm",
      "label": {
        "en": "Balm"
      }
    }
  },
  "calculated_price": 1399,
  "categories": {
    "en": {
      "lvl0": [
        "Ultra Beauty Australia",
        "Ultra Beauty Australia",
        "Chemist Warehouse Australia",
        "Chemist Warehouse Australia",
        "Chemist Warehouse Australia",
        "Chemist Warehouse Australia",
        "Chemist Warehouse Australia",
        "Ultra Beauty Australia"
      ],
      "lvl1": [
        "Ultra Beauty Australia > Categories",
        "Ultra Beauty Australia > Brands",
        "Chemist Warehouse Australia > Categories",
        "Chemist Warehouse Australia > Categories",
        "Chemist Warehouse Australia > Brands",
        "Chemist Warehouse Australia > Brands",
        "Chemist Warehouse Australia > Categories",
        "Ultra Beauty Australia > Categories"
      ],
      "lvl2": [
        "Ultra Beauty Australia > Categories > Makeup",
        "Ultra Beauty Australia > Brands > NYX",
        "Chemist Warehouse Australia > Categories > Skincare",
        "Chemist Warehouse Australia > Categories > Skincare",
        "Chemist Warehouse Australia > Brands > NYX",
        "Chemist Warehouse Australia > Brands > NYX",
        "Chemist Warehouse Australia > Categories > Skincare",
        "Ultra Beauty Australia > Categories > Makeup"
      ],
      "lvl3": [
        "Chemist Warehouse Australia > Categories > Skincare > Facial Skincare",
        "Chemist Warehouse Australia > Categories > Skincare > Facial Skincare",
        "Chemist Warehouse Australia > Brands > NYX > NYX Lips",
        "Ultra Beauty Australia > Categories > Makeup > Lips"
      ],
      "lvl4": [
        "Chemist Warehouse Australia > Categories > Skincare > Facial Skincare > Lip Balms & Treatments"
      ]
    }
  },
  "category_facet_keys": {
    "en": [
      "Makeup",
      "Skincare",
      "Facial Skincare",
      "Lip Balms & Treatments",
      "Lips"
    ]
  },
  "category_keys": {
    "en": [
      "Ultra Beauty Australia",
      "Categories",
      "Makeup",
      "Brands",
      "NYX",
      "Chemist Warehouse Australia",
      "Skincare",
      "Facial Skincare",
      "Lip Balms & Treatments",
      "NYX Lips",
      "Lips"
    ]
  },
  "category_page_id": [
    "Chemist Warehouse Australia",
    "Chemist Warehouse Australia > Brands",
    "Chemist Warehouse Australia > Brands > NYX",
    "Chemist Warehouse Australia > Brands > NYX > NYX Lips",
    "Chemist Warehouse Australia > Categories",
    "Chemist Warehouse Australia > Categories > Skincare",
    "Chemist Warehouse Australia > Categories > Skincare > Facial Skincare",
    "Chemist Warehouse Australia > Categories > Skincare > Facial Skincare > Lip Balms & Treatments",
    "Ultra Beauty Australia",
    "Ultra Beauty Australia > Brands",
    "Ultra Beauty Australia > Brands > NYX",
    "Ultra Beauty Australia > Categories",
    "Ultra Beauty Australia > Categories > Makeup",
    "Ultra Beauty Australia > Categories > Makeup > Lips"
  ],
  "category_slugs": {
    "en": [
      "5112-makeup",
      "900010-nyx",
      "215-lip-balms-treatments",
      "300002-face",
      "6437-nyx",
      "6457-nyx-lips",
      "665-skin-care",
      "5114-lips"
    ]
  },
  "created_at": "2025-08-11T02:33:44.776Z",
  "description": {
    "en": "<p>A soft-matte buildable lip color infused with mochi rice powder and sugar ceramides in 8 shades.</p>  Meet our new Smushy Matte Lip Balm! Get this smushy-soft tinted lip balm that delivers a plush, blurred effect and a trendy soft-matte finish. Loaded with mochi rice powder and sugar ceramides, this hydrating lip balm's weightless texture cushions lips in a dreamy, diffused colour. The smushy-soft texture glides on effortlessly with a comfy lip balm feel that lasts all day. Moisture-Locking Ingredients: Infused with Mochi Rice Powder and Sugar Ceramides to lock in lip moisture, experience weightless, pillow-soft lips all day long with our ultra-soft hydrating lip balm. Buildable Soft-Blur Colour: Smushy soft lips in just 1 squeeze! Smush and swipe for the perfect wash of soft matte tinted lip balm colour. Build it up for a more intense look or keep it sheer and sweet. Unique Smushy-Sweet Scent: Each Smushy shade of this scented lip balm features a unique, delicious scent for a truly delightful sensory experience. Collect them all! 8 Craveable Shades: Just swipe on liquid lip balm for a perfect wash of buildable, soft-blur lip colour with our blurring lip balm formula. Whether you're feeling a barely-there nude, a pop of vibrant pink, or a deep berry moment, Smushy Matte Lip Balm has you covered. Explore our range of 8 craveable shades designed for every mood and occasion. Smushy Soft Lip Applicator: The ultra-soft silicone applicator ensures smooth, even application of the liquid lip balm, wrapping your lips in a pillowy-soft colour. Find your perfect match and unleash your inner makeup artist! Smushy Matte Lip Balm is lip care, redefined. Cruelty-free, vegan, and seriously addictive, our blurring lip balm is like a soft hug for your lips. Smush it, love it, flaunt it. <p>Size:  8ml</p>  <p>Fragrance:  NA</p>  <p>KEY FEATURES</p>  &bull; Smack, smooch, and smush with our new Smushy Matte Lip Balm for soft-diffused, comfy matte lip color! Check out these smackin' benefits: Soft matte finish.<br/> &bull; Infused with mochi rice powder and sugar ceramides for an ultra-soft feel.<br/> &bull; Ultra-soft silicone applicator: lip balm applies evenly, easily, and smoothly.<br/> &bull; Blurs the appearance of lip lines and does not settle into lip lines.<br/> &bull; Diffused, blurred colour.<br/>"
  },
  "has_image": true,
  "images": [
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/2DF_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD3_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD4_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD5_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD6_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD7_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD8_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD9_800.jpg",
    "https://static.chemistwarehouse.com.au/ams/media/pi/156544/ADD10_800.jpg"
  ],
  "is_in_stock": true,
  "is_master_variant": true,
  "key": "4d030daf-4371-4ab1-8c19-2d57266544b7",
  "name": {
    "en": "NYX Smushy Matte Lip Balm Swipe Sesh"
  },
  "prices": {
    "a_u_d": {
      "max": 1399,
      "min": 1399,
      "price_values": [
        {
          "channel_i_d": "091dd48b-a8e3-41eb-8517-ce57d4474055",
          "custom_fields": {
            "rrp": {
              "cent_amount": 1699,
              "currency_code": "AUD",
              "fraction_digits": 2,
              "type": "centPrecision"
            }
          },
          "id": "3de22484-5f33-4246-b0ea-9356fbeb715b",
          "value": 1399
        }
      ]
    }
  },
  "prices_custom_fields": {
    "a_u_d": {
      "rrp": {
        "cent_amount": 1699,
        "currency_code": "AUD",
        "fraction_digits": 2,
        "type": "centPrecision"
      }
    }
  },
  "product_id": null,
  "product_key": "4d030daf-4371-4ab1-8c19-2d57266544b7",
  "product_type": "Skincare",
  "ranking": {
    "bayes_average": 4.6,
    "buckets": {
      "equal_distribution_3": 5,
      "equal_distribution_5": 10,
      "k_means": 0,
      "sales_projection_score": 0.5,
      "standard_dev": 0
    },
    "sales_projection_score": 0.5,
    "top_performer": false
  },
  "sku": "2734925",
  "slug": {
    "en": "156544-nyx-smushy-matte-lip-balm-swipe-sesh"
  },
  "object_id": null,
  "highlight_result": null,
  "from_url": "https://www.chemistwarehouse.com.au/search?query=lips&contexts=default&page=2"
}

Each product record returns 26+ structured fields:

Product Identification

Field	Meaning	Example
Product ID	Unique Chemist Warehouse product identifier	12345678
Product Key	Internal product reference key	prod-sk001
Key	Alternative product key/SKU reference	sku-12345
Name	Product name as displayed	Lip Balm SPF 30 - Coconut
Slug	URL-friendly product identifier	lip-balm-spf-30-coconut
SKU	Stock Keeping Unit for inventory tracking	LIP-BAL-001
Object ID	Search index object identifier (Algolia)	product_12345678

Pricing & Commerce

Field	Meaning	Example
Prices	Product price(s) in AUD	{"regular": 12.99, "sale": 9.99}
Calculated Price	Final displayed price after discounts	9.99
Prices Custom Fields	Additional pricing metadata (loyalty discounts, bulk rates)	{"loyalty_discount": 0.05}

Inventory & Availability

Field	Meaning	Example
Is In Stock	Boolean indicating stock availability	true or false
Is Master Variant	Whether this is the parent product (not a variant)	true

Product Content

Field	Meaning	Example
Description	Long-form product description	"Hydrating lip balm with SPF 30 protection..."
Attributes	Product properties (ingredients, brand, size, format)	{"brand": "Sundown", "size": "15g", "format": "stick"}
Images	Array of product image URLs	["https://img.chemistwarehouse.com.au/p1.jpg", "https://img.chemistwarehouse.com.au/p2.jpg"]
Has Image	Boolean confirming image availability	true

Categorization

Field	Meaning	Example
Categories	Product category hierarchy (full path)	["Health & Beauty", "Lips", "Lip Balms"]
Category Keys	Internal category identifiers	["health-beauty", "lips", "lip-balms"]
Category Slugs	URL-friendly category names	["health-beauty", "lips", "lip-balms"]
Category Facet Keys	Faceted search filters applicable to this product	["brand", "price_range", "size"]
Category Page ID	ID of the product category page	cat-5001

Metadata & Search

Field	Meaning	Example
Product Type	Classification (e.g., beauty, supplement, wellness)	beauty
Ranking	Product popularity/relevance score in search	95
Created At	Product upload/creation timestamp	2023-06-15T10:30:00Z
Highlight Result	Search highlight snippet (relevant text matched to query)	"<em>Lip</em> Balm SPF 30 - Premium hydration"

---

How to Use

1. Build your search URL — Visit chemistwarehouse.com.au, search for a product category (e.g., "vitamins", "acne treatment"), and copy the full URL.
2. Configure input — Paste the URL into the urls array. Set max_items_per_url based on your needs (200 is a good default; max 500).
3. Set error handling — Leave ignore_url_failures: true for uninterrupted bulk runs.
4. Execute the scraper — Start the run and monitor progress in the log.
5. Process output — Download results as JSON or CSV for analysis, price comparison, or database import.

Best practices:

• Test with 50 items first to verify output quality before scaling to 500.
• Use unique search queries to capture different product segments (e.g., "vitamins A-Z", "skincare", "fitness").
• Export to CSV for spreadsheet-friendly analysis or JSON for database integration.

---

Use Cases & Business Value

• Price monitoring: Track Chemist Warehouse pricing trends daily and alert on competitor undercuts
• Market analysis: Analyze which health & beauty categories are growing or shrinking
• Inventory insights: Monitor stock availability for popular products across search results
• Competitor intelligence: Compare product mix, pricing strategy, and promotional activity
• E-commerce research: Benchmark product descriptions, imagery, and attributes against your catalog

The Chemist Warehouse Product Search Scraper delivers market data that would take hours to collect manually, enabling data-driven decisions in retail, e-commerce, and healthcare tech.

---

Conclusion

The Chemist Warehouse Product Search Scraper is an essential tool for anyone needing reliable Australian pharmacy product data. With 26+ fields covering pricing, inventory, images, and categorization, it enables competitive analysis, market research, and price intelligence at scale. Start scraping today and unlock insights from Australia's largest pharmacy retailer.