Boots Product Search Scraper: Extract Beauty & Health Product Data

---

What Is Boots.com?

Boots is a leading pharmacy and beauty retailer operating globally, with a flagship presence in the UK and Europe. The platform hosts hundreds of thousands of product listings across beauty, skincare, fragrance, vitamins, and health categories. Manually extracting product data from Boots search results is tedious and error-prone — the Boots Product Search Scraper automates this, turning search result pages into structured, analysis-ready datasets.

---

Overview

The Boots Product Search Scraper extracts comprehensive product information from Boots.com search and category pages, converting listings into clean, structured records. It is designed for:

• E-commerce analysts monitoring competitor pricing and promotions
• Market researchers studying beauty and health product trends
• Price intelligence teams building dynamic pricing databases
• Retailers analyzing product attributes, variants, and stock availability
• Data scientists training machine learning models on product data

Key strengths include support for bulk URL collection, configurable item limits, graceful error handling, and rich output spanning 20+ fields per product.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://www.boots.com/shop-all-dior"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Field	Type	Description
urls	Array	URLs of Boots product search/category pages. Supports multiple URLs (e.g., "shop-all-dior", "search?query=sunscreen")
max_items_per_url	Integer	Maximum products extracted per URL (default: 20, max: 200+). Higher values yield more comprehensive datasets
ignore_url_failures	Boolean	If true, skips failed URLs without halting the entire run. Essential for large-scale scraping

Tip: Use category or brand filter URLs (e.g., shop-all-dior, skincare) to focus on specific product segments.

---

Output Format

Example Output Record

{
  "ppu_quantity": "100ML",
  "pricing": {
    "per_unit": "£976.00 per 1L",
    "regular": {
      "value": 122,
      "currency": "GBP",
      "text": "£122.00"
    },
    "current": {
      "value": 97.6,
      "currency": "GBP",
      "text": "£97.60"
    },
    "saving": {
      "value": 24.4,
      "currency": "GBP",
      "text": "£24.40"
    }
  },
  "object_id": "2096107",
  "brand": "CHRISTIAN DIOR",
  "attributes": {
    "fragrance_scent": [
      "woody",
      "spicy",
      "amber"
    ],
    "stock_override_message": "STOCK_COMING_SOON",
    "gender": "mens",
    "fragrance_type": "eau de parfum",
    "reporting__category": "fragrance",
    "gift_type": "fragrance gifts",
    "hidden_exclude_from_recs": "No",
    "product_type": "aftershave",
    "size": "71-100",
    "pharmacy_medicine": "no",
    "hero_child": "Y",
    "recipient": "gifts for men",
    "has_price_advantage_deal": false,
    "product_review_flag": "1"
  },
  "variants": {
    "colours": [],
    "has_colours": false,
    "has_sizes": false
  },
  "categories": [
    [
      {
        "name": "father's day",
        "label": "father's day"
      },
      {
        "name": "toiletries",
        "label": "toiletries"
      },
      {
        "name": "gift",
        "label": "gift"
      },
      {
        "name": "men's",
        "label": "men's"
      },
      {
        "name": "fragrance",
        "label": "fragrance"
      }
    ],
    [
      {
        "name": "men's toiletries",
        "label": "toiletries > men's toiletries"
      },
      {
        "name": "gift by occasion",
        "label": "gift > gift by occasion"
      },
      {
        "name": "men's toiletries",
        "label": "men's > men's toiletries"
      },
      {
        "name": "aftershave",
        "label": "fragrance > aftershave"
      },
      {
        "name": "fragrance offers",
        "label": "fragrance > fragrance offers"
      },
      {
        "name": "gift by recipient",
        "label": "gift > gift by recipient"
      },
      {
        "name": "aftershave",
        "label": "men's > aftershave"
      },
      {
        "name": "luxury fragrance",
        "label": "fragrance > luxury fragrance"
      },
      {
        "name": "shop all fragrance",
        "label": "fragrance > shop all fragrance"
      },
      {
        "name": "gifts for him",
        "label": "gift > gifts for him"
      },
      {
        "name": "luxury gifts",
        "label": "gift > luxury gifts"
      },
      {
        "name": "all gifts",
        "label": "gift > all gifts"
      }
    ],
    [
      {
        "name": "aftershave",
        "label": "toiletries > men's toiletries > aftershave"
      },
      {
        "name": "valentine's day",
        "label": "gift > gift by occasion > valentine's day"
      },
      {
        "name": "aftershave",
        "label": "men's > men's toiletries > aftershave"
      },
      {
        "name": "luxury aftershave balms, lotions & shower gel",
        "label": "fragrance > aftershave > luxury aftershave balms, lotions & shower gel"
      },
      {
        "name": "shop all aftershave",
        "label": "fragrance > aftershave > shop all aftershave"
      },
      {
        "name": "woody aftershave",
        "label": "fragrance > aftershave > woody aftershave"
      },
      {
        "name": "Triple points on top scents",
        "label": "fragrance > fragrance offers > Triple points on top scents"
      },
      {
        "name": "Collect £10 worth of points when you spend £60",
        "label": "fragrance > fragrance offers > Collect £10 worth of points when you spend £60"
      },
      {
        "name": "Save 15% on 100s of fragrances",
        "label": "fragrance > fragrance offers > Save 15% on 100s of fragrances"
      },
      {
        "name": "father's day",
        "label": "gift > gift by occasion > father's day"
      },
      {
        "name": "gifts for boyfriends",
        "label": "gift > gift by recipient > gifts for boyfriends"
      },
      {
        "name": "luxury aftershave balms, lotions & shower gel",
        "label": "men's > aftershave > luxury aftershave balms, lotions & shower gel"
      },
      {
        "name": "shop all aftershave",
        "label": "men's > aftershave > shop all aftershave"
      },
      {
        "name": "woody aftershave",
        "label": "men's > aftershave > woody aftershave"
      }
    ],
    [
      {
        "name": "luxury aftershave balms, lotions & shower gel",
        "label": "toiletries > men's toiletries > aftershave > luxury aftershave balms, lotions & shower gel"
      },
      {
        "name": "shop all aftershave",
        "label": "toiletries > men's toiletries > aftershave > shop all aftershave"
      },
      {
        "name": "woody aftershave",
        "label": "toiletries > men's toiletries > aftershave > woody aftershave"
      },
      {
        "name": "Valentines gifts for him",
        "label": "gift > gift by occasion > valentine's day > Valentines gifts for him"
      },
      {
        "name": "shop all Valentines gifts",
        "label": "gift > gift by occasion > valentine's day > shop all Valentines gifts"
      },
      {
        "name": "luxury aftershave balms, lotions & shower gel",
        "label": "men's > men's toiletries > aftershave > luxury aftershave balms, lotions & shower gel"
      },
      {
        "name": "shop all aftershave",
        "label": "men's > men's toiletries > aftershave > shop all aftershave"
      },
      {
        "name": "woody aftershave",
        "label": "men's > men's toiletries > aftershave > woody aftershave"
      }
    ]
  ],
  "reviews": {
    "average": 4.69,
    "count": 3059,
    "rounded": 4
  },
  "parent": {
    "product": "2096106",
    "part_number": "10243637.P",
    "model": "10243637",
    "manufacturer_model": "8076251"
  },
  "images": {
    "thumbnail": "https://boots.scene7.com/is/image/Boots/10243637?wid=45&hei=60&op_sharpen=1"
  },
  "offers": [
    {
      "text": "Complimentary Gift - Receive a limited-edition Dior Sauvage Duo Kit when you purchase Sauvage 100ml and above or Sauvage Elixir - online only, whilst stock lasts"
    },
    {
      "text": "Use code NEXTDAY for FREE next day delivery across selected favourites - online only"
    },
    {
      "text": "Save up to 25 percent on selected Fragrance"
    }
  ],
  "actions": {},
  "icon_uri": "https://boots.scene7.com/is/image/Boots/10243637?op_sharpen=1",
  "title": "DIOR Sauvage Eau de Parfum 100ml",
  "reference_uri": "/dior-sauvage-eau-de-parfum-100ml-10243637",
  "can_add_to_basket": "yes",
  "opticians": false,
  "in_stock": true,
  "express_delivery": false,
  "has_other_promotion": true,
  "channel_promotional_text_map": {
    "-1": [
      "Complimentary Gift - Receive a limited-edition Dior Sauvage Duo Kit when you purchase Sauvage 100ml and above or Sauvage Elixir - online only, whilst stock lasts",
      "Use code NEXTDAY for FREE next day delivery across selected favourites - online only",
      "Save up to 25 percent on selected Fragrance"
    ],
    "-6": [
      "Complimentary Gift - Receive a limited-edition Dior Sauvage Duo Kit when you purchase Sauvage 100ml and above or Sauvage Elixir - online only, whilst stock lasts",
      "Use code NEXTDAY for FREE next day delivery across selected favourites - online only",
      "Save up to 25 percent on selected Fragrance"
    ]
  },
  "product_espot_stock_override_message": "<h5> Stock coming soon </h5>",
  "ad_card_points": 291,
  "from_url": "https://www.boots.com/shop-all-dior"
}

Each scraped product returns a rich record with 20+ fields:

Core Product Data

Field	Meaning
Object ID	Unique identifier for the product in Boots' system
Title	Official product name as displayed on Boots.com
Brand	Manufacturer or brand name (e.g., "Dior", "Olay")
Reference URI	Canonical product URL on Boots.com
Parent	Parent product reference (for variants)

Pricing & Promotion

Field	Meaning
Pricing	Current retail price (may include currency, sale price, RRP)
PPU Quantity	Price per unit quantity for bulk comparison
Offers	Active promotions (e.g., "Buy 1 Get 1", "20% off")
Channel Promotional Text Map	Promotional messaging tailored by sales channel
Has Other Promotion	Boolean flag indicating additional ongoing promotions

Product Details & Variants

Field	Meaning
Attributes	Product attributes (e.g., shade, size, scent, SPF level)
Variants	Available variations (different sizes, colors, formats)
Categories	Product categorization (Beauty, Skincare, Fragrance, Health)
Images	Product image URLs (primary and secondary photos)

Availability & Fulfillment

Field	Meaning
In Stock	Boolean or quantity indicator of current stock availability
Can Add To Basket	Whether the product is currently purchasable
Express Delivery	Whether fast delivery options are available
Product Espot Stock Override Message	Custom messaging when stock is limited or unavailable

Customer & Additional Data

Field	Meaning
Reviews	Customer review ratings, counts, and aggregate scores
Ad Card Points	Boots Loyalty Points or rewards accrual for the product
Icon URI	Product icon or small image URI
Actions	Available customer actions (e.g., "Add to Wishlist", "Compare")
Opticians	Flag for optician-managed products (if applicable)

---

How to Use

1. Identify target URLs — Navigate to Boots.com and open a search or category page (e.g., "shop-all-dior", "search?query=moisturiser"). Copy the full URL.
2. Configure input — Paste URLs into the urls array. Adjust max_items_per_url based on desired volume (20–200 items).
3. Enable error tolerance — Set ignore_url_failures: true to continue if individual pages fail to load.
4. Run the scraper — Execute the actor and monitor progress in the run log.
5. Download results — Export data as JSON, CSV, or Excel for analysis.

Best practices:

• Use specific category or brand URLs for focused datasets
• Set max_items_per_url to 200 for comprehensive product coverage
• Run scrapes during off-peak hours to reduce server load
• Validate output for completeness before downstream processing

---

Use Cases & Business Value

• Price monitoring: Track competitor prices on bestselling beauty brands in real-time
• Promotional intelligence: Capture active offers and plan competitive promotions
• Inventory insights: Monitor stock levels and product availability trends
• Product research: Analyze attributes, variants, and customer reviews at scale
• Market analysis: Benchmark your product portfolio against market leaders
• Loyalty program optimization: Analyze Points accrual to refine rewards strategy

The Boots Product Search Scraper eliminates manual data collection, enabling rapid iteration on pricing, merchandising, and product strategy decisions.

---

Conclusion

The Boots Product Search Scraper is an essential tool for beauty and health e-commerce professionals. With 20+ data fields and flexible configuration, it transforms Boots search pages into actionable product intelligence. Start scraping today and unlock competitive advantages in pricing, promotions, and product development.