# Woolworths Scraper - AU Prices, Specials & Unit Price (`haketa/woolworths-scraper`) Actor

Scrape Woolworths Australia products by keyword or category: price, was-price, savings %, half-price & member specials, online vs in-store price, unit price, availability, brand, dietary and allergens. Export to JSON, CSV, Excel.

- **URL**: https://apify.com/haketa/woolworths-scraper.md
- **Developed by:** [Haketa](https://apify.com/haketa) (community)
- **Categories:** E-commerce
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Woolworths Scraper 🛒🇦🇺

**Extract product & price data from Woolworths Australia — the country's largest supermarket — into clean, structured data.** Search by keyword or sweep entire categories and export thousands of products with **price, was-price, savings %, half-price & member specials, online vs in-store price, unit price, availability, brand, dietary and allergen info**. Built for price monitoring, competitor analysis, deal tracking and FMCG market research.

[![Actor](https://img.shields.io/badge/Apify-Actor-00b04f?style=flat-square\&logo=apify)](https://apify.com)
[![Market](https://img.shields.io/badge/Market-Australia%20🇦🇺-012169?style=flat-square)](https://apify.com)
[![Specials](https://img.shields.io/badge/Specials-Tracked-e4002b?style=flat-square)](https://apify.com)
[![Unit price](https://img.shields.io/badge/Unit%20price-Included-brightgreen?style=flat-square)](https://apify.com)
[![In-store](https://img.shields.io/badge/Online%20%2B%20In--store-Dual%20price-success?style=flat-square)](https://apify.com)
[![Output](https://img.shields.io/badge/Output-JSON%20%7C%20CSV%20%7C%20Excel-2b7489?style=flat-square)](https://apify.com)
[![Pagination](https://img.shields.io/badge/Pagination-Automatic-blue?style=flat-square)](https://apify.com)
[![No code](https://img.shields.io/badge/No--code-Friendly-9cf?style=flat-square)](https://apify.com)
[![Maintained](https://img.shields.io/badge/Maintained-Yes-brightgreen?style=flat-square)](https://apify.com)

***

### 🎯 What does Woolworths Scraper do?

Woolworths is Australia's largest grocery retailer, with tens of thousands of products across every aisle. This actor turns any Woolworths search or category into a structured dataset you can download or feed into your own tools.

Give it a **search term** (or a **category / search URL**) and it will:

- 🔎 Search Woolworths or **sweep a whole category** (Fruit & Veg, Dairy, Pantry…)
- 📄 Automatically **paginate** through all pages until it reaches your limit
- 💰 Capture **full pricing** — current price, was-price, **savings %**, half-price & member specials
- 🏬 Return **both online and in-store price** for each product
- 📏 Include the **unit price** ($/100g, $/1L…) for true like-for-like comparison
- 🥗 Add **brand, package size, availability, dietary and allergen** details
- 🏷️ Optionally return **only products on special** — perfect for deal tracking
- 🧹 Deliver **clean, deduplicated, structured records** — no HTML, no clutter
- ⬇️ Export to **JSON, CSV, Excel, HTML or via API** in one click

No login, no browser extensions, no manual copy-paste.

***

### ✨ Key features

| Feature | Description |
| --- | --- |
| **Keyword or category input** | Type search terms, or paste a search / category URL to sweep an entire aisle. |
| **Specials intelligence** | `isOnSpecial`, `isHalfPrice`, `isMemberSpecial`, `wasPrice` and computed `savingsPercent`. |
| **Online + in-store price** | Both the online price and the in-store price for every product — rarely available elsewhere. |
| **Unit price** | Price per unit (e.g. `$2.35 / 1L`) so you can compare value across pack sizes. |
| **Specials-only mode** | One toggle to return just the discounted items — ideal for price-drop monitoring. |
| **Dietary & allergens** | Dietary statements (gluten free, vegan…) and allergen info where provided. |
| **Rich product data** | Brand, package size, barcode, ingredients, availability, image and more. |
| **Automatic pagination** | Walks through all pages up to your `maxItems` limit. |
| **Deduplicated output** | Each product appears once, identified by its unique stockcode. |
| **Clean exports** | JSON, CSV, Excel, HTML table, RSS or JSON API. |

***

### 📥 Input

The actor accepts a simple, no-code input form. You can drive it three ways:

#### Option A — by search term (easiest)

```json
{
    "searchTerms": ["coffee", "chocolate"],
    "maxItems": 200
}
```

#### Option B — sweep a category

```json
{
    "startUrls": [
        { "url": "https://www.woolworths.com.au/shop/browse/fruit-veg" }
    ],
    "maxItems": 500
}
```

#### Option C — specials only (deal tracking)

```json
{
    "searchTerms": ["snacks"],
    "specialsOnly": true,
    "maxItems": 300
}
```

#### Input parameters

| Field | Type | Description |
| --- | --- | --- |
| `searchTerms` | array | Product keywords to search. |
| `startUrls` | array | Woolworths search or category URLs (for full category sweeps or pre-filtered searches). |
| `specialsOnly` | boolean | Return only products currently on special. Default `false`. |
| `maxItems` | integer | Maximum number of products to collect. Default `200`. |
| `proxyConfiguration` | object | Proxy settings. Australian residential proxies are recommended. |

***

### 📤 Output

Each product is returned as a clean JSON object:

```json
{
    "stockcode": 123456,
    "name": "Cadbury Dairy Milk Chocolate Block 180g",
    "brand": "Cadbury",
    "url": "https://www.woolworths.com.au/shop/productdetails/123456/cadbury-dairy-milk",
    "price": 3.5,
    "wasPrice": 7.0,
    "savingsAmount": 3.5,
    "savingsPercent": 50,
    "isOnSpecial": true,
    "isHalfPrice": true,
    "isMemberSpecial": false,
    "inStorePrice": 3.5,
    "inStoreIsOnSpecial": true,
    "unitPrice": 1.94,
    "unitMeasure": "100G",
    "unitPriceLabel": "$1.94 / 100G",
    "packageSize": "180g",
    "unit": "Each",
    "isAvailable": true,
    "isInStock": true,
    "barcode": "9300617000000",
    "dietary": "Gluten Free",
    "allergens": "Contains Milk, Soy",
    "category": "Chocolate",
    "image": "https://cdn1.woolworths.media/content/wowproductimages/large/123456.jpg"
}
```

#### Output fields

| Field | Type | Description |
| --- | --- | --- |
| `stockcode` | number | Unique Woolworths product code. |
| `name` / `brand` | string | Product name and brand. |
| `url` | string | Direct link to the product page. |
| `price` | number | Current online price (AUD). |
| `wasPrice` | number | Previous price, when discounted. |
| `savingsAmount` / `savingsPercent` | number | Amount and % saved. |
| `isOnSpecial` | boolean | Whether the product is on special. |
| `isHalfPrice` | boolean | Whether it's a half-price special. |
| `isMemberSpecial` | boolean | Whether it's an Everyday Rewards member special. |
| `inStorePrice` | number | In-store price. |
| `inStoreWasPrice` / `inStoreIsOnSpecial` | | In-store previous price and special flag. |
| `unitPrice` / `unitMeasure` / `unitPriceLabel` | | Unit price for value comparison. |
| `packageSize` / `unit` | string | Pack size and selling unit. |
| `isAvailable` / `isInStock` | boolean | Availability. |
| `barcode` | string | Product barcode (GTIN). |
| `dietary` / `allergens` / `ingredients` | string | Dietary statements, allergens and ingredients, where provided. |
| `countryOfOrigin` | string | Country of origin, where provided. |
| `category` | string | Category / search label. |
| `image` | string | Product image URL. |

You can download the dataset as **JSON, CSV, Excel, HTML, RSS or XML**, or fetch it programmatically through the Apify API.

***

### 🚀 How to use Woolworths Scraper (step by step)

1. Click **Try for free** / **Start**.
2. Type one or more **search terms** — or paste a **category / search URL** to sweep an aisle.
3. (Optional) Enable **Specials only** to track deals.
4. Set **maxItems** to how many products you want.
5. Click **Save & Start**.
6. When the run finishes, open the **Dataset** tab and **Export** to your preferred format — or grab it via API.

That's it. No code required.

***

### 💡 Use cases

- **Price monitoring** — Track prices across products and categories over time, and get alerted to price drops.
- **Specials & deal tracking** — Use **Specials only** to capture every discount, half-price and member offer daily.
- **Competitor & market analysis** — Benchmark Woolworths pricing against other retailers for FMCG intelligence.
- **Unit-price comparison** — Normalize by `$/100g` or `$/1L` to find the true best value.
- **Product catalogs & apps** — Power price-comparison sites, budgeting apps and shopping tools with fresh data.
- **Range & availability tracking** — Monitor which products are in stock, new, or discontinued in a category.
- **Academic & retail research** — Study grocery inflation, promotions and assortment at scale.

***

### 🏷️ Why the specials & dual-price data matters

Most product feeds give you a single price. This actor returns the **full pricing picture**: the current price, the was-price, the exact **savings %**, whether it's a **half-price** or **member** special, **and** the separate **in-store price** — plus the **unit price** for value comparison. That's everything you need for serious price intelligence, not just a product list.

***

### ⏱️ How many products can I collect?

As many as the search or category contains. Set `maxItems` to control the volume, and **run several searches or categories** for broad catalog coverage. Schedule regular runs to keep prices and specials current.

***

### 🔌 Integrations & automation

Because this runs on Apify, you can:

- 📅 **Schedule** runs (hourly, daily, weekly) to keep a live price & specials feed.
- 🔗 Push results to **Google Sheets, Airtable, Slack, Zapier, Make, or any webhook**.
- 🧩 Call it from your backend with the **Apify API** and SDKs (JavaScript / Python).
- 🔔 Use **webhooks** to trigger downstream workflows the moment a run completes.

#### Call via API (example)

```bash
curl -X POST "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
        "searchTerms": ["coffee"],
        "specialsOnly": true,
        "maxItems": 200
      }'
```

```javascript
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_TOKEN' });
const run = await client.actor('YOUR_ACTOR_ID').call({
    startUrls: [{ url: 'https://www.woolworths.com.au/shop/browse/fruit-veg' }],
    maxItems: 500,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);
```

***

### ❓ FAQ

**Do I need a Woolworths account or API key?**
No. Just provide a search term or a Woolworths URL.

**Does it include specials and discounts?**
Yes — full specials data: `isOnSpecial`, `isHalfPrice`, `isMemberSpecial`, `wasPrice` and a computed `savingsPercent`. Use **Specials only** to return just discounted items.

**Does it include the in-store price too?**
Yes. Each product includes both the online price and the in-store price (with their own special flags).

**What is the unit price?**
The price per standard unit (e.g. `$2.35 / 1L`), so you can compare value across different pack sizes.

**Can I scrape a whole category?**
Yes. Paste a category URL such as `https://www.woolworths.com.au/shop/browse/fruit-veg` and the actor sweeps the whole aisle.

**Are results deduplicated?**
Yes. Each product is uniquely identified by its stockcode and appears only once per run.

**What formats can I export?**
JSON, CSV, Excel, HTML, RSS and XML — via the dashboard or the API.

**How do I keep prices fresh?**
Schedule the actor to run on the interval you need; each run returns the current live prices and specials.

**Do I need a proxy?**
An Australian residential proxy is recommended for reliable, uninterrupted results, and is configured by default.

***

### 📌 Tips for best results

- **Use Specials only for deal feeds.** It's the fastest way to build a daily discount dataset.
- **Sweep by category for catalogs.** Category URLs give broad, structured coverage of an aisle.
- **Compare on unit price.** `unitPrice` / `unitPriceLabel` reveal the true best value across pack sizes.
- **Schedule for freshness.** Grocery prices and specials change weekly — a scheduled run keeps your data current.
- **Split large jobs.** For the whole store, run multiple categories in parallel for speed and completeness.

***

### ⚖️ Legal & responsible use

This actor is intended for lawful data collection such as price monitoring, market research and analytics. You are responsible for how you use the collected data. Only collect publicly available information, respect the target website's Terms of Service and `robots.txt`, and comply with all applicable laws and regulations. Do not use the data for any unlawful purpose. This actor is an independent tool and is **not affiliated with, endorsed by, or connected to Woolworths** or its subsidiaries. All trademarks belong to their respective owners.

***

### 🛟 Support

Questions, feature requests or an issue with the data? Open an issue on the actor's page — feedback is welcome and helps improve the tool.

***

⭐ **If this actor saves you time, please leave a review — it really helps!**

# Actor input Schema

## `searchTerms` (type: `array`):

One or more product keywords to search on Woolworths (e.g. milk, coffee, chocolate). The scraper paginates through all results automatically.

## `startUrls` (type: `array`):

Paste Woolworths search or category URLs — e.g. https://www.woolworths.com.au/shop/search/products?searchTerm=coffee or https://www.woolworths.com.au/shop/browse/fruit-veg. Use these for full category sweeps or pre-filtered searches.

## `specialsOnly` (type: `boolean`):

Return only products currently on special (discounted, half-price or member offers). Great for deal and price-drop tracking.

## `maxItems` (type: `integer`):

Maximum number of products to collect across all search terms and URLs.

## `proxyConfiguration` (type: `object`):

Proxy settings. Apify Proxy is enabled by default and works well; for very large or long-running jobs, Australian residential proxies can improve reliability.

## Actor input object example

```json
{
  "searchTerms": [
    "chocolate"
  ],
  "startUrls": [
    {
      "url": "https://www.woolworths.com.au/shop/browse/fruit-veg"
    }
  ],
  "specialsOnly": false,
  "maxItems": 200,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `stockcode` (type: `string`):

Woolworths product stockcode

## `name` (type: `string`):

Product name

## `brand` (type: `string`):

Brand

## `url` (type: `string`):

Product page URL

## `price` (type: `string`):

Current online price

## `wasPrice` (type: `string`):

Previous price (when on special)

## `savingsPercent` (type: `string`):

Discount percentage

## `isOnSpecial` (type: `string`):

Whether currently on special

## `inStorePrice` (type: `string`):

In-store price

## `unitPriceLabel` (type: `string`):

Price per unit (e.g. $2.35 / 1L)

## `packageSize` (type: `string`):

Package size

## `isAvailable` (type: `string`):

Availability

## `image` (type: `string`):

Product image URL

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchTerms": [
        "chocolate"
    ],
    "startUrls": [
        {
            "url": "https://www.woolworths.com.au/shop/browse/fruit-veg"
        }
    ],
    "maxItems": 200
};

// Run the Actor and wait for it to finish
const run = await client.actor("haketa/woolworths-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "searchTerms": ["chocolate"],
    "startUrls": [{ "url": "https://www.woolworths.com.au/shop/browse/fruit-veg" }],
    "maxItems": 200,
}

# Run the Actor and wait for it to finish
run = client.actor("haketa/woolworths-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchTerms": [
    "chocolate"
  ],
  "startUrls": [
    {
      "url": "https://www.woolworths.com.au/shop/browse/fruit-veg"
    }
  ],
  "maxItems": 200
}' |
apify call haketa/woolworths-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,haketa/woolworths-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/mH9GqDlzbVmw9L4rN/builds/epIhLSNI00IrIdYT8/openapi.json
