Sainsbury's Product Search Scraper: Extract UK Grocery Data at Scale

---

What Is Sainsbury's.com?

Sainsbury's is the UK's leading online supermarket, offering millions of products across groceries, fresh produce, household items, and branded goods. Its search and category pages display dynamic product information including Nectar member pricing, promotions, availability, and customer reviews. Manually tracking product data across Sainsbury's vast catalog is impractical — the Sainsbury's Product Search Scraper automates extraction, delivering clean, structured product records for analysis and integration.

---

Overview

The Sainsbury's Product Search Scraper extracts comprehensive product data from Sainsbury's search results and category pages, transforming HTML listings into machine-readable records. It is designed for:

• Price intelligence platforms monitoring UK grocery pricing trends
• Retail analysts benchmarking competitor product assortments
• E-commerce researchers studying product metadata and promotions
• Market researchers analyzing consumer product availability and reviews
• Supply chain teams tracking product availability and stock status

Key strengths include support for Nectar member pricing, promotion extraction, review aggregation, and robust handling of large result sets via max_items_per_url.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=2"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Parameter	Type	Description
urls	Array of strings	Direct links to Sainsbury's product search or category pages
max_items_per_url	Integer	Maximum products extracted per URL (default: 20, max recommended: 200)
ignore_url_failures	Boolean	If true, skips failed URLs and continues; if false, stops on first failure

Input Tips:

• URLs can reference search results (e.g., ?q=rice), category pages, or promotional offers pages like Nectar pricing
• Use pagination parameters (e.g., pageNumber=2) to scrape multiple pages — add each as a separate URL for control
• max_items_per_url: 200 is suitable for bulk collection; lower values reduce runtime and memory

---

Output Format

Sample output

{
  "sain_id": "3fr9860y",
  "product_uid": "8048938",
  "favourite_uid": null,
  "eans": [
    "0000000415958"
  ],
  "product_type": "BASIC",
  "name": "Sainsbury's Strawberry & Vanilla Cones 4x110ml",
  "image": "https://assets.sainsburys-groceries.co.uk/gol/8048938/image.jpg",
  "image_zoom": "",
  "image_thumbnail": "",
  "image_thumbnail_small": "",
  "full_url": "https://www.sainsburys.co.uk/gol-ui/product/sainsburys-strawberry-vanilla-cones-4x110ml",
  "unit_price": {
    "price": 2.7,
    "measure": "ltr",
    "measure_amount": 1
  },
  "retail_price": {
    "price": 1.19,
    "measure": ""
  },
  "original_unit_price": {
    "price": 2.7,
    "measure": "ltr",
    "measure_amount": 1
  },
  "is_available": true,
  "promotions": [],
  "associations": [],
  "is_alcoholic": false,
  "relevancy_rank": 1,
  "is_spotlight": false,
  "is_intolerant": false,
  "is_mhra": false,
  "badges": [],
  "labels": [
    {
      "label_uid": "Frozen",
      "text": "Frozen",
      "alt_text": "Frozen",
      "color": "#005096",
      "link_opens_in_new_window": false
    },
    {
      "label_uid": "ALDI PRICE MATCH*",
      "text": "ALDI PRICE MATCH*",
      "alt_text": "ALDI PRICE MATCH*",
      "color": "#D70000",
      "link": "https://www.sainsburys.co.uk/gol-ui/events/aldi-price-match",
      "link_opens_in_new_window": false
    }
  ],
  "zone": null,
  "department": null,
  "reviews": {
    "is_enabled": true,
    "product_uid": "8048938",
    "total": 56,
    "average_rating": 4.75
  },
  "breadcrumbs": [],
  "details_html": "",
  "assets": {
    "plp_image": "https://assets.sainsburys-groceries.co.uk/gol/8048938/image.jpg",
    "images": [],
    "video": []
  },
  "description": [],
  "important_information": [],
  "attachments": [],
  "categories": [
    {
      "id": "419879",
      "name": "Handheld ice cream and lollies"
    }
  ],
  "is_supply_chain_orderable": false,
  "display_icons": [],
  "pdp_deep_link": "",
  "promise": {
    "type": "",
    "earliest_promise_date": null,
    "last_amendment_date": null,
    "status": {
      "label": "",
      "type": "NONE"
    }
  },
  "source": null,
  "from_url": "https://www.sainsburys.co.uk/groceries/search?searchTerm=ice+cream&utm_campaign=&utm_content=&utm_custom1=&utm_custom2=&utm_custom6=&utm_medium=&utm_source=&utm_term=&gclid=&dclid=&cmpid=&src=&gad_source=&fbclid=&msclkid=&gclsrc=&gad_campaignid=&page=2"
}

Each scraped product returns a rich record with 40+ fields:

Product Identity & URLs

Field	Meaning
Sain ID	Sainsbury's internal product identifier
Product UID	Unique identifier for product tracking
Favourite UID	ID used for customer favorites/wishlist functionality
EANs	European Article Numbers (barcodes) for the product
Full URL	Direct link to the product detail page
PDP Deep Link	Deep link to product display page
Source	Data source (e.g., Sainsbury's production environment)

Product Details & Classification

Field	Meaning
Name	Official product name as displayed on Sainsbury's
Product Type	Category or product classification (e.g., "Fresh Produce", "Packaged Foods")
Department	Retailer department (e.g., Grocery, Fresh, Bakery)
Zone	Physical or digital zone/section within Sainsbury's
Categories	Hierarchical category tags (breadcrumb path)
Breadcrumbs	Navigation path showing product categorization
Description	Detailed product description (plain text)
Details HTML	Full HTML product details and specifications

Pricing & Promotions

Field	Meaning
Unit Price	Current price per unit (e.g., per 100g)
Retail Price	List/shelf price shown to customers
Original Unit Price	Pre-discount or original price for comparison
Promotions	Active promotional offers (e.g., "3 for 2", "% off")
Is Spotlight	Flag indicating featured/spotlight promotion status

Images & Visual Content

Field	Meaning
Image	Primary product image URL (high resolution)
Image Zoom	Zoomable high-resolution product image
Image Thumbnail	Standard thumbnail image URL
Image Thumbnail Small	Small thumbnail for list views
Assets	Collection of all associated media URLs

Availability & Stock

Field	Meaning
Is Available	Boolean: whether the product is currently in stock
Is Supply Chain Orderable	Whether the item can be ordered via B2B supply chain
Promise	Delivery or fulfillment promise (e.g., "Next day delivery")

Customer Data & Reviews

Field	Meaning
Reviews	Aggregated customer reviews and ratings
Relevancy Rank	Search result relevancy score (higher = more relevant)

Attributes & Labels

Field	Meaning
Is Alcoholic	Boolean: whether product contains alcohol
Is Intolerant	Boolean: flags products with common allergens/intolerances
Is MHRA	Flag for medications/health products requiring regulatory compliance
Badges	Special badges (e.g., "Organic", "Vegan", "Fairtrade")
Labels	Additional product labeling (nutritional claims, origin, etc.)
Display Icons	Visual icons for product attributes

Relationships & Metadata

Field	Meaning
Associations	Related or recommended products

---

How to Use

1. Prepare URLs — Navigate to Sainsbury's.co.uk, perform a search or browse a category, and copy the full URL. Examples:

   • Search: https://www.sainsburys.co.uk/gol-ui/search/rice?pageNumber=1
   • Category: https://www.sainsburys.co.uk/gol-ui/browse/fresh-produce/vegetables
   • Promotions: https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=1

2. Configure input — Paste URLs into the urls array and set max_items_per_url (typically 50–200 for balance between speed and data volume).

3. Enable pagination — For large result sets, add multiple URLs with different pageNumber parameters:

"urls": [
     "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=1",
     "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=2",
     "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=3"
   ]

4. Run the scraper — Start execution and monitor logs for completion.

5. Export & analyze — Download results as JSON, CSV, or Excel for analysis, database import, or API integration.

Best practices:

• Use ignore_url_failures: true for resilience when scraping multiple pages
• Space out large runs to avoid rate limiting
• Regularly verify URLs remain valid, as Sainsbury's occasionally restructures pages
• Test with max_items_per_url: 20 before running large batches

---

Use Cases & Business Value

• Price monitoring: Track competitor pricing trends, promotions, and price changes over time
• Assortment analysis: Compare product ranges across categories and competitor stores
• Promotion tracking: Identify and monitor active offers, discounts, and bundle deals
• Product research: Analyze product attributes, badges (organic, vegan, etc.), and customer reviews
• Market intelligence: Benchmark UK grocery market trends, new product launches, and availability
• Data enrichment: Populate internal product catalogs with Sainsbury's product metadata

By automating product data collection, teams eliminate manual spreadsheet work and unlock real-time market insights.

---

Conclusion

The Sainsbury's Product Search Scraper is an essential tool for retail analysts, price intelligence platforms, and supply chain professionals who need accurate, up-to-date UK grocery data. With 40+ data fields covering pricing, promotions, availability, reviews, and product classifications, it enables data-driven decisions across commerce, research, and business intelligence workflows. Start scraping today and transform Sainsbury's product listings into actionable insights.