Woolworths Scraper

Scrape Woolworths Australia (woolworths.com.au) groceries as clean JSON: search results, whole categories, specials pages (Half Price, Lower Shelf Price, Buy More Save More ...) or product pages. Every product comes with price, was-price, savings, unit price, the promotion (half price, special, multibuy), stock and purchase limit, barcode, image, categories, Health Star Rating and rating; product pages add the description, ingredients, allergens, dietary claims, the nutrition panel, serving size, storage, country of origin and all images. Prices are Woolworths' online prices in AUD.

Features

• Search mode - products matching each search term (queries); specialsOnly keeps only products on special.
• Category mode - every product of each category (categories: browse link, path or category id).
• Specials mode - the products on each chosen specials page (specialsPages, Half Price by default).
• Product mode - one product page per input (products: product link or stockcode) with nutrition, ingredients and allergens.
• Up to 2000 products per listing - pages are followed automatically.
• Many inputs per run - search terms, categories or products in parallel.

Use cases

• Price monitoring - track shelf prices, specials and unit prices across categories.
• Promotions research - every Half Price or multibuy deal of the week.
• Nutrition and ingredient databases - nutrition panels, allergens and dietary claims.
• Retail and FMCG analytics - assortment, brands and pricing by category.

Input

Field	Type	Default	Description
mode	string	search	search, category, specials or product.
queries	array	milk	Search terms (search mode).
categories	array	-	Browse links, paths (dairy-eggs-fridge/milk) or category ids (category mode).
specialsPages	array	half-price	Specials pages (specials mode).
products	array	-	Product links or stockcodes (product mode).
maxResults	integer	36	Products per listing (1-2000).
sort	string	relevance	relevance, price_asc, price_desc, unit_price_asc, unit_price_desc, name.
specialsOnly	boolean	false	Search: only products on special.
proxyCountry	string	-	Optional exit-IP country (ISO-2).
concurrency	integer	3	Inputs processed at the same time (1-5).

Example input

{
  "mode": "category",
  "categories": [
    "https://www.woolworths.com.au/shop/browse/dairy-eggs-fridge/milk",
    "snacks-confectionery/chips"
  ],
  "maxResults": 500,
  "sort": "unit_price_asc"
}

Output

One dataset item per product. A listing item (search, category, specials):

{
  "mode": "search",
  "input": "milk",
  "position": 1,
  "id": "88436",
  "name": "Dairy Farmers Full Cream Milk 2L",
  "brand": "Dairy Farmers",
  "size": "2L",
  "url": "https://www.woolworths.com.au/shop/productdetails/88436/dairy-farmers-full-cream-milk-full-cream-milk",
  "barcode": "9310199012717",
  "price": 4.7,
  "wasPrice": null,
  "currency": "AUD",
  "onSale": false,
  "savings": null,
  "promotion": null,
  "unitPrice": {
    "price": 2.35,
    "per": "1L",
    "text": "$2.35 / 1L"
  },
  "soldBy": "Each",
  "inStock": true,
  "available": true,
  "purchaseLimit": 36,
  "isNew": false,
  "onlineOnly": false,
  "sponsored": true,
  "image": "https://cdn1.woolworths.media/content/wowproductimages/large/088436.jpg",
  "categories": [
    "Container Bonus Credits",
    "Dairy, Eggs & Fridge"
  ],
  "healthStarRating": 4.0,
  "rating": null
}

A product-mode item adds the product page's details (lists shortened):

{
  "mode": "product",
  "input": "888137",
  "id": "888137",
  "name": "Woolworths Full Cream Milk 2L",
  "brand": "Woolworths",
  "size": "2L",
  "url": "https://www.woolworths.com.au/shop/productdetails/888137/woolworths-full-cream-milk",
  "barcode": "9300633556143",
  "price": 3.4,
  "wasPrice": null,
  "currency": "AUD",
  "onSale": false,
  "savings": null,
  "promotion": null,
  "unitPrice": {
    "price": 1.7,
    "per": "1L",
    "text": "$1.70 / 1L"
  },
  "soldBy": "Each",
  "inStock": true,
  "available": true,
  "purchaseLimit": 36,
  "isNew": false,
  "onlineOnly": false,
  "sponsored": false,
  "image": "https://cdn0.woolworths.media/content/wowproductimages/large/888137.jpg",
  "categories": [
    "Dairy, Eggs & Fridge",
    "Milk"
  ],
  "healthStarRating": 4.0,
  "rating": null,
  "description": "Woolworths Full Cream Milk 2L",
  "ingredients": "Pasteurised and Homogenised Full Cream Milk.",
  "allergens": {
    "contains": [
      "Milk"
    ],
    "mayContain": [],
    "freeFrom": [
      "Egg Free",
      "Fish Free",
      "Gluten Free",
      "Soy Free",
      "Wheat Free"
    ]
  },
  "dietary": [
    "Gluten Free",
    "Low Salt"
  ],
  "nutrition": [
    {
      "name": "Energy",
      "perServing": "660.0kJ",
      "per100": "264.0kJ"
    },
    {
      "name": "Protein",
      "perServing": "8.2g",
      "per100": "3.3g"
    }
  ],
  "servingSize": "250.0 ML",
  "servingsPerPack": "8.0",
  "storage": null,
  "directions": null,
  "warnings": null,
  "countryOfOrigin": "Australia",
  "countryOfOriginLabel": "Product of Australia",
  "australianIngredientsPercent": 100.0,
  "department": "dairy",
  "aisle": "full cream milk",
  "images": [
    "https://cdn0.woolworths.media/content/wowproductimages/large/888137.jpg",
    "https://cdn0.woolworths.media/content/wowproductimages/large/888137_1.jpg"
  ],
  "variants": []
}

The key-value store also holds:

• LISTINGS - per search term, category or specials listing: total results, pages fetched and products collected.
• ERRORS - inputs that returned no products (no match, unknown product or category, blocked) with the reason. These are not billed.

Pricing

$0.90 per 1000 products. You pay only for products delivered; inputs without products are not charged.

Notes

• Woolworths shows 36 products per page; a listing returns at most maxResults products, sometimes a few less when pages repeat sponsored products.
• healthStarRating and rating are null for products without them.
• This actor is not affiliated with Woolworths.