Waitrose Product Search Scraper: Extract Grocery Data & Pricing

---

What Is Waitrose?

Waitrose is a premium British supermarket chain offering an extensive online grocery platform at waitrose.com. With thousands of products across fresh produce, bakery, dairy, and specialty items, Waitrose pricing and inventory data is valuable for price comparison, market analysis, and retail intelligence. Manually collecting product information from search results is tedious—the Waitrose Product Search Scraper automates this, delivering structured product data in seconds.

---

Overview

The Waitrose Product Search Scraper extracts product listings from Waitrose category and search pages, returning comprehensive product records with pricing, promotions, images, and metadata. It is ideal for:

• Price comparison platforms monitoring UK grocery pricing
• Retail analysts tracking competitor product assortment
• Researchers studying food retail trends and HFSS (High Fat, Salt, Sugar) labeling
• E-commerce developers building product aggregators
• Marketing teams analyzing promotional strategies

Key strengths include configurable item limits per URL, automatic error recovery, and rich output spanning 32+ product attributes.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://www.waitrose.com/ecom/shop/browse/groceries/bakery"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Field	Description	Example
urls	Array of Waitrose product search or category page URLs	["https://www.waitrose.com/ecom/shop/browse/groceries/bakery"]
max_items_per_url	Maximum products to extract per URL (1-200)	200
ignore_url_failures	If true, scraper continues if a URL fails; if false, stops on error	true or false

Tips:

• Use full category URLs (e.g., /groceries/bakery, /groceries/dairy)
• Use search result URLs for keyword-based scraping (e.g., /search?query=gluten-free)
• Max 200 items per URL prevents excessive runtime; paginated results require separate URL entries

---

Output Format

Sample ouput

{
  "result_type": "GENERAL",
  "id": "900132-1-2",
  "line_number": "900132",
  "product_type": "W",
  "name": "Wildfarmed Sourdough",
  "size": "640g",
  "thumbnail": "https://ecom-su-static-prod.wtrecom.com/images/products/9/LN_900132_BP_9.jpg",
  "reviews": {
    "average_rating": 5,
    "review_count": 2
  },
  "current_sale_unit_price": {
    "quantity": {
      "amount": 1,
      "uom": "C62"
    },
    "price": {
      "amount": 2.5,
      "currency_code": "GBP"
    }
  },
  "default_quantity": {
    "amount": 1,
    "uom": "C62"
  },
  "promotions": [
    {
      "promotion_unit_price": {
        "amount": 2.25,
        "currency_code": "GBP"
      },
      "promotion_description": "Introductory Offer",
      "promotion_type_code": "INT",
      "promotion_expiry_date": "2026-07-21",
      "promotion_id": 540719,
      "promotional_price_per_unit": "(£3.52 per kg)",
      "pyo_promotion": false,
      "my_waitrose_promotion": false,
      "groups": [
        {
          "threshold": 1,
          "name": "X"
        }
      ]
    }
  ],
  "persist_default": true,
  "display_price": "£2.25",
  "display_price_estimated": false,
  "display_price_qualifier": "£3.52/kg",
  "lead_time": 0,
  "max_personalised_message_length": 0,
  "product_image_urls": {
    "small": "https://ecom-su-static-prod.wtrecom.com/images/products/9/LN_900132_BP_9.jpg",
    "medium": "https://ecom-su-static-prod.wtrecom.com/images/products/3/LN_900132_BP_3.jpg",
    "large": "https://ecom-su-static-prod.wtrecom.com/images/products/11/LN_900132_BP_11.jpg",
    "extra_large": "https://ecom-su-static-prod.wtrecom.com/images/products/4/LN_900132_BP_4.jpg"
  },
  "weights": {
    "uoms": [
      "C62"
    ],
    "price_per_uom_qualifier": "£3.52/kg",
    "per_uom_qualifier": "(per kg)"
  },
  "restriction": {
    "available_dates": []
  },
  "substitutions_prohibited": false,
  "ad_tech_sponsored_position": 1,
  "marked_for_delete": false,
  "minimum_life_to_customer": 0,
  "brand": "Wildfarmed",
  "sponsorship_id": "display_LwwZfZmG_mfMcQOe72cgobCIFoMKCAoGOTAwMTMyEgAaCwiQmcjSBhDKvf4rIgIIAQ==",
  "categories": [
    {
      "id": "10051",
      "name": "Groceries"
    },
    {
      "id": "300119",
      "name": "Bakery"
    },
    {
      "id": "300121",
      "name": "Bread"
    },
    {
      "id": "300164",
      "name": "Sourdough Bread"
    }
  ],
  "hfss": {
    "scope_category": {
      "code": 14
    },
    "status": false
  },
  "sponsored": true,
  "marketing_badges": [
    {
      "name": "New"
    }
  ],
  "promotion": null,
  "from_url": "https://www.waitrose.com/ecom/shop/browse/groceries/bakery"
}

Each product record contains 32 fields capturing identity, pricing, availability, and marketing data:

Product Identification

Field	Meaning	Example
ID	Unique Waitrose product identifier	12345678
Name	Full product name as displayed	Organic Free-Range Eggs, 6 Pack
Product Type	Item category classification	Grocery, Fresh, Bakery
Brand	Manufacturer or own-label brand	Waitrose Essentials, Tesco
Line Number	Sequential position in results	1, 2, 3
Result Type	Classification of search result	Product, Promotion, Sponsored

Pricing & Availability

Field	Meaning	Example
Current Sale Unit Price	Active price per unit (in £)	1.50, 3.99
Display Price	Formatted price shown to customers	£1.50, 2 for £5.00
Display Price Estimated	Boolean: price is estimated or variable	true, false
Display Price Qualifier	Additional pricing context	per 100g, per unit, each
Default Quantity	Quantity included in standard purchase	1, 6, 500g
Lead Time	Delivery or availability window	Next day delivery, In stock

Product Details

Field	Meaning	Example
Size	Package or portion size	500g, 6 Pack, 1L
Weights	Nutritional or product weight data	{"net": "500g", "drained": "350g"}
Categories	Product classification hierarchy	["Groceries", "Bakery", "Bread"]
HFSS	High Fat, Salt, Sugar flag (UK health labeling)	true, false
Restriction	Age or dietary restrictions	Age 18+, Allergen warning
Substitutions Prohibited	Whether item cannot be replaced	true, false
Minimum Life To Customer	Shelf life remaining at delivery	5 days, 7 days

Media & Reviews

Field	Meaning	Example
Thumbnail	Small product image URL	https://...waitrose.com/.../thumb.jpg
Product Image URLs	Array of all available product images	["url1", "url2", "url3"]
Reviews	Customer rating and review count	{"rating": 4.5, "count": 127}

Promotions & Marketing

Field	Meaning	Example
Promotions	Active price reductions or offers	[{"type": "Money Off", "value": "50p"}]
Promotion	Promotional banner or label	"3 for 2 on selected items"
Marketing Badges	Visual badges (e.g., "Organic", "Vegan")	["Organic", "Fairtrade"]
Sponsored	Boolean: product paid placement	true, false
Sponsorship ID	ID of sponsoring brand (if sponsored)	98765432
Ad Tech Sponsored Position	Whether item occupies ad placement	true, false

System & Admin

Field	Meaning	Example
Persist Default	Stores customer's preferred quantity	true, false
Marked For Delete	Internal flag for item discontinuation	true, false
Max Personalised Message Length	Character limit for notes	500

---

How to Use

1. Identify URLs — Navigate Waitrose.com and browse to product category (e.g., Bakery, Dairy) or search results. Copy the full URL.
2. Configure settings — Paste URLs into the urls array. Set max_items_per_url (default 20, max 200).
3. Run the scraper — Initiate the actor. It will fetch product pages and extract items.
4. Handle failures — If ignore_url_failures: true, scraper skips failed URLs; if false, execution halts.
5. Export data — Download results as JSON, CSV, or Excel.

Best practices:

• Start with smaller max_items_per_url (50-100) to test, then scale up.
• For multi-page categories, add each page URL separately to the urls array.
• Use pagination URL parameters if Waitrose supports them (e.g., ?page=2).

Common scenarios:

• Price monitoring: Schedule weekly runs on competitor categories to track price changes.
• Promotion analysis: Scrape the same category monthly to detect promotional cycles.
• Product assortment: Compare product availability across regions using regional Waitrose URLs.

---

Use Cases & Business Value

• Retail competitive intelligence: Monitor Waitrose pricing vs. Tesco, Sainsbury's, Asda
• Price comparison websites: Automate Waitrose data feeds for UK grocery aggregators
• Supply chain analytics: Track product availability and stock levels over time
• Market research: Analyze HFSS labeling, promotional frequency, and organic product adoption
• Procurement: Extract supplier/brand data for B2B food sourcing

The Waitrose Product Search Scraper transforms unstructured web content into machine-readable product records, enabling rapid market analysis, competitive benchmarking, and integration into retail analytics platforms.

---

Conclusion

The Waitrose Product Search Scraper is a powerful tool for anyone needing accurate, up-to-date UK grocery product data. With 32+ output fields covering pricing, promotions, imagery, and metadata, it cuts manual data collection time from hours to minutes. Whether you're running a price comparison platform, conducting retail research, or building a competitor intelligence dashboard, this scraper delivers reliable, actionable product intelligence.