Sainsbury's Product Search Scraper: Extract UK Grocery Data at Scale

---

What Is Sainsbury's.com?

Sainsbury's is the UK's leading online supermarket, offering millions of products across groceries, fresh produce, household items, and branded goods. Its search and category pages display dynamic product information including Nectar member pricing, promotions, availability, and customer reviews. Manually tracking product data across Sainsbury's vast catalog is impractical — the Sainsbury's Product Search Scraper automates extraction, delivering clean, structured product records for analysis and integration.

---

Overview

The Sainsbury's Product Search Scraper extracts comprehensive product data from Sainsbury's search results and category pages, transforming HTML listings into machine-readable records. It is designed for:

• Price intelligence platforms monitoring UK grocery pricing trends
• Retail analysts benchmarking competitor product assortments
• E-commerce researchers studying product metadata and promotions
• Market researchers analyzing consumer product availability and reviews
• Supply chain teams tracking product availability and stock status

Key strengths include support for Nectar member pricing, promotion extraction, review aggregation, and robust handling of large result sets via max_items_per_url.

---

Input Format

The Actor supports two scraping modes — use only one at a time:

1. Scrape by URLs — scrape data directly from a list of Sainsbury's product search or category page URLs.

{
  "urls": [
    "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=2"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

2. Scrape by search filters — scrape data using a keyword and additional filters (sorting, allergies, dietary preferences, etc.) instead of providing URLs.

{
  "keyword": "cakes",
  "sort_by": "price",
  "allergy_and_intolerance": "",
  "dietary_and_lifestyle": "",
  "page": 2,
  "max_items_per_url": 200
}

There is also a General settings group that applies to both modes.

1. Scrape by URLs

Use this mode when you already have specific search result or category URLs. When this mode is used, all options in the "Scrape by search filters" section will be disabled.

Field	Type	Default	Description
urls	array	(required)	One or more Sainsbury's product search or category page URLs to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. URLs can reference search results (e.g. ?q=rice), category pages, or promotional offers pages like Nectar pricing.
ignore_url_failures	boolean	true	If true, the scraper continues running when a URL fails instead of stopping the entire run. Recommended for bulk jobs.

Tip: To scrape multiple pages, use pagination parameters (e.g. pageNumber=2) and add each page as a separate URL for full control.

2. Scrape by search filters

Use this mode when you want to search using a keyword and additional filter attributes instead of scraping by URLs. If you use this mode, leave the urls field above empty.

Field	Type	Default	Description
keyword	string	—	The keyword to search for.
sort_by	string (-relevance, price, -price, customer rating)	—	Sort results by Relevance, Price (low to high), Price (high to low), or Customer rating.
allergy_and_intolerance	string	—	Filter out items containing a specific allergen, or select a certified gluten-free / gluten-free option. Available values: Any, No Crustaceans, No Lupin, No Celery, No Molluscs, No Egg, No Sesame, No Fish, No Mustard, No Nuts, No Peanuts, Gluten Free, No Lactose, No Milk, No Soya, No Sulphites, Certified Gluten Free.
dietary_and_lifestyle	string	—	Filter by dietary or lifestyle preference. Available values: Any, Vegetarian, Halal, Low Salt, Vegan, Low Fat, Kosher, Low Sugar, 1 of 5 a day.
page	integer	—	The page number to start scraping from.

3. General settings

Applies to both scraping modes above.

Field	Type	Default	Description
max_items_per_url	integer	20	The maximum number of products to extract per URL/search. 200 is suitable for bulk collection; lower values reduce runtime and memory usage.

---

Output Format

Sample output

{
  "sain_id": "3fr9860y",
  "product_uid": "8048938",
  "favourite_uid": null,
  "eans": [
    "0000000415958"
  ],
  "product_type": "BASIC",
  "name": "Sainsbury's Strawberry & Vanilla Cones 4x110ml",
  "image": "https://assets.sainsburys-groceries.co.uk/gol/8048938/image.jpg",
  "image_zoom": "",
  "image_thumbnail": "",
  "image_thumbnail_small": "",
  "full_url": "https://www.sainsburys.co.uk/gol-ui/product/sainsburys-strawberry-vanilla-cones-4x110ml",
  "unit_price": {
    "price": 2.7,
    "measure": "ltr",
    "measure_amount": 1
  },
  "retail_price": {
    "price": 1.19,
    "measure": ""
  },
  "original_unit_price": {
    "price": 2.7,
    "measure": "ltr",
    "measure_amount": 1
  },
  "is_available": true,
  "promotions": [],
  "associations": [],
  "is_alcoholic": false,
  "relevancy_rank": 1,
  "is_spotlight": false,
  "is_intolerant": false,
  "is_mhra": false,
  "badges": [],
  "labels": [
    {
      "label_uid": "Frozen",
      "text": "Frozen",
      "alt_text": "Frozen",
      "color": "#005096",
      "link_opens_in_new_window": false
    },
    {
      "label_uid": "ALDI PRICE MATCH*",
      "text": "ALDI PRICE MATCH*",
      "alt_text": "ALDI PRICE MATCH*",
      "color": "#D70000",
      "link": "https://www.sainsburys.co.uk/gol-ui/events/aldi-price-match",
      "link_opens_in_new_window": false
    }
  ],
  "zone": null,
  "department": null,
  "reviews": {
    "is_enabled": true,
    "product_uid": "8048938",
    "total": 56,
    "average_rating": 4.75
  },
  "breadcrumbs": [],
  "details_html": "",
  "assets": {
    "plp_image": "https://assets.sainsburys-groceries.co.uk/gol/8048938/image.jpg",
    "images": [],
    "video": []
  },
  "description": [],
  "important_information": [],
  "attachments": [],
  "categories": [
    {
      "id": "419879",
      "name": "Handheld ice cream and lollies"
    }
  ],
  "is_supply_chain_orderable": false,
  "display_icons": [],
  "pdp_deep_link": "",
  "promise": {
    "type": "",
    "earliest_promise_date": null,
    "last_amendment_date": null,
    "status": {
      "label": "",
      "type": "NONE"
    }
  },
  "source": null,
  "from_url": "https://www.sainsburys.co.uk/groceries/search?searchTerm=ice+cream&utm_campaign=&utm_content=&utm_custom1=&utm_custom2=&utm_custom6=&utm_medium=&utm_source=&utm_term=&gclid=&dclid=&cmpid=&src=&gad_source=&fbclid=&msclkid=&gclsrc=&gad_campaignid=&page=2"
}

Each scraped product returns a rich record with 40+ fields:

Product Identity & URLs

Field	Meaning
Sain ID	Sainsbury's internal product identifier
Product UID	Unique identifier for product tracking
Favourite UID	ID used for customer favorites/wishlist functionality
EANs	European Article Numbers (barcodes) for the product
Full URL	Direct link to the product detail page
PDP Deep Link	Deep link to product display page
Source	Data source (e.g., Sainsbury's production environment)

Product Details & Classification

Field	Meaning
Name	Official product name as displayed on Sainsbury's
Product Type	Category or product classification (e.g., "Fresh Produce", "Packaged Foods")
Department	Retailer department (e.g., Grocery, Fresh, Bakery)
Zone	Physical or digital zone/section within Sainsbury's
Categories	Hierarchical category tags (breadcrumb path)
Breadcrumbs	Navigation path showing product categorization
Description	Detailed product description (plain text)
Details HTML	Full HTML product details and specifications

Pricing & Promotions

Field	Meaning
Unit Price	Current price per unit (e.g., per 100g)
Retail Price	List/shelf price shown to customers
Original Unit Price	Pre-discount or original price for comparison
Promotions	Active promotional offers (e.g., "3 for 2", "% off")
Is Spotlight	Flag indicating featured/spotlight promotion status

Images & Visual Content

Field	Meaning
Image	Primary product image URL (high resolution)
Image Zoom	Zoomable high-resolution product image
Image Thumbnail	Standard thumbnail image URL
Image Thumbnail Small	Small thumbnail for list views
Assets	Collection of all associated media URLs

Availability & Stock

Field	Meaning
Is Available	Boolean: whether the product is currently in stock
Is Supply Chain Orderable	Whether the item can be ordered via B2B supply chain
Promise	Delivery or fulfillment promise (e.g., "Next day delivery")

Customer Data & Reviews

Field	Meaning
Reviews	Aggregated customer reviews and ratings
Relevancy Rank	Search result relevancy score (higher = more relevant)

Attributes & Labels

Field	Meaning
Is Alcoholic	Boolean: whether product contains alcohol
Is Intolerant	Boolean: flags products with common allergens/intolerances
Is MHRA	Flag for medications/health products requiring regulatory compliance
Badges	Special badges (e.g., "Organic", "Vegan", "Fairtrade")
Labels	Additional product labeling (nutritional claims, origin, etc.)
Display Icons	Visual icons for product attributes

Relationships & Metadata

Field	Meaning
Associations	Related or recommended products

---

How to Use

1. Prepare URLs — Navigate to Sainsbury's.co.uk, perform a search or browse a category, and copy the full URL. Examples:

   • Search: https://www.sainsburys.co.uk/gol-ui/search/rice?pageNumber=1
   • Category: https://www.sainsburys.co.uk/gol-ui/browse/fresh-produce/vegetables
   • Promotions: https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=1

2. Configure input — Paste URLs into the urls array and set max_items_per_url (typically 50–200 for balance between speed and data volume).

3. Enable pagination — For large result sets, add multiple URLs with different pageNumber parameters:

"urls": [
     "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=1",
     "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=2",
     "https://www.sainsburys.co.uk/gol-ui/offers/nectar-prices?pageNumber=3"
   ]

4. Run the scraper — Start execution and monitor logs for completion.

5. Export & analyze — Download results as JSON, CSV, or Excel for analysis, database import, or API integration.

Best practices:

• Use ignore_url_failures: true for resilience when scraping multiple pages
• Space out large runs to avoid rate limiting
• Regularly verify URLs remain valid, as Sainsbury's occasionally restructures pages
• Test with max_items_per_url: 20 before running large batches

---

Use Cases & Business Value

• Price monitoring: Track competitor pricing trends, promotions, and price changes over time
• Assortment analysis: Compare product ranges across categories and competitor stores
• Promotion tracking: Identify and monitor active offers, discounts, and bundle deals
• Product research: Analyze product attributes, badges (organic, vegan, etc.), and customer reviews
• Market intelligence: Benchmark UK grocery market trends, new product launches, and availability
• Data enrichment: Populate internal product catalogs with Sainsbury's product metadata

By automating product data collection, teams eliminate manual spreadsheet work and unlock real-time market insights.

---

Conclusion

The Sainsbury's Product Search Scraper is an essential tool for retail analysts, price intelligence platforms, and supply chain professionals who need accurate, up-to-date UK grocery data. With 40+ data fields covering pricing, promotions, availability, reviews, and product classifications, it enables data-driven decisions across commerce, research, and business intelligence workflows. Start scraping today and transform Sainsbury's product listings into actionable insights.