# Australian Supermarket Scraper: Coles, Woolworths & ALDI Prices (`ksvan/au-supermarket-scraper`) Actor

Scrape grocery prices from Coles, Woolworths and ALDI Australia in one unified format: price, was price, savings, unit price, specials, brand, size, category, barcode, image and product link. Search by keyword, scrape category pages or the weekly specials.

- **URL**: https://apify.com/ksvan/au-supermarket-scraper.md
- **Developed by:** [K.S. Van](https://apify.com/ksvan) (community)
- **Categories:** E-commerce, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

$0.70 / 1,000 products

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Australian Supermarket Scraper: Coles, Woolworths & ALDI Prices

Scrape **grocery prices from Coles, Woolworths and ALDI Australia** in **one unified format**. Search by keyword, scrape category pages or pull the weekly **specials catalogues**. Every product comes with its price, was price, savings, unit price, special flag, brand, size, category, image and product link, plus the barcode and rating for Woolworths.

One keyword runs in all three stores at once, so a single run gives you a ready-made **price comparison across Australia's big supermarkets**. No login, no browser. Pay only per product delivered.

### What you can scrape

- **Search keywords** in every selected store: `milk`, `tim tam`, `olive oil`, `nappies`
- **Category pages**:
  - Coles: `https://www.coles.com.au/browse/dairy-eggs-fridge`
  - Woolworths: `https://www.woolworths.com.au/shop/browse/fruit-veg`
  - ALDI: `https://www.aldi.com.au/products/fruits-vegetables/k/950000000`
- **Specials** (one switch): Coles On Special, Woolworths Half Price, Lower Shelf Price, Online Only, Seasonal and Buy More Save More, ALDI Lower Prices

### What you get

| Field | Example |
|---|---|
| `store`, `productId`, `name`, `brand`, `size` | woolworths, 6084122, Nivea Lip Balm 4.8g, Nivea, 4.8g |
| `price`, `wasPrice`, `savings`, `discountPercent` | 3.00, 6.00, 3.00, 50.0 |
| `isOnSpecial`, `promotion` | true, SPECIAL |
| `unitPrice`, `unitPriceText` | 6.25, $6.25 / 10G |
| `inStock` | true (Coles, Woolworths; ALDI sells in store only, so `null`) |
| `category` | Dairy, Eggs & Fridge |
| `barcode`, `rating`, `reviewCount` | 4006000156170 (Woolworths) |
| `imageUrl`, `url` | product image and product page |
| `source`, `input`, `scrapedAt` | search, milk, 2026-10-20T10:00:00+00:00 |

Prices are in AUD. Fields a store does not publish are `null`.

### Use cases

- **Price comparison** sites and apps: Coles vs Woolworths vs ALDI for the same basket.
- **Specials tracking**: who has the deepest half-price deals this week.
- **Food inflation and market research**: run on a schedule and follow prices over time.
- **Brands and suppliers**: monitor your shelf price, promotions and competitors in each chain.

### How to use

1. Pick the stores and add search keywords and/or category URLs.
2. Optionally turn on **Scrape specials** and **Only products on special**.
3. Set **Max products per keyword / category** and run. Each product is one dataset record.

#### Example input

```json
{
  "stores": ["coles", "woolworths", "aldi"],
  "searchQueries": ["milk", "coffee beans"],
  "categoryUrls": [{"url": "https://www.woolworths.com.au/shop/browse/fruit-veg"}],
  "scrapeSpecials": true,
  "maxProductsPerSource": 200
}
```

### Pricing

- **Product**: charged per product saved to the dataset. Keywords or categories that fail are reported as `error` records and are **not charged**. With **Only products on special**, products filtered out are not charged either.

### Tips and limits

- Use **Schedules** in Apify Console to collect prices daily or weekly.
- Coles sometimes answers with a bot check. The actor then retries from a new proxy IP (up to **Max retries per request**), so a run finishes instead of failing.
- Prices are the online prices shown without a selected store. In-store prices can differ by location.
- ALDI products are in-store items, so there is no stock flag.

### FAQ

**Is it legal?** The actor reads publicly visible product listings. Use the data in line with each store's terms and applicable law.

**Can I compare the same product across stores?** Search the same keyword in all three stores; for exact matches use the Woolworths `barcode` or compare `name` and `size`.

**Something missing?** Open an issue on the Issues tab and I will look at it.

# Actor input Schema

## `stores` (type: `array`):

Which supermarkets to scrape. Every keyword runs in every selected store, so you get a ready-made price comparison.

## `searchQueries` (type: `array`):

Products to search for, e.g. 'milk', 'tim tam', 'olive oil'.

## `categoryUrls` (type: `array`):

Optional category pages: coles.com.au/browse/dairy-eggs-fridge, woolworths.com.au/shop/browse/fruit-veg, aldi.com.au/products/fruits-vegetables/k/950000000. Each URL is scraped only in its own store.

## `scrapeSpecials` (type: `boolean`):

Add the specials catalogues: Coles On Special, Woolworths Half Price / Lower Shelf Price / Online Only / Seasonal / Buy More Save More, ALDI Lower Prices.

## `onlySpecials` (type: `boolean`):

Keep only discounted products (from searches and categories too). Products filtered out are not charged.

## `maxProductsPerSource` (type: `integer`):

Limit for each keyword, category or specials catalogue in each store.

## `maxItems` (type: `integer`):

Stop after this many products in total. 0 = no limit.

## `proxyConfiguration` (type: `object`):

Apify datacenter proxy works well. Coles sometimes shows a bot check; the request is then retried from a new IP.

## `maxRetries` (type: `integer`):

Retries with a fresh proxy IP before a keyword or category is reported as failed.

## Actor input object example

```json
{
  "stores": [
    "coles",
    "woolworths",
    "aldi"
  ],
  "searchQueries": [
    "milk",
    "coffee beans"
  ],
  "scrapeSpecials": false,
  "onlySpecials": false,
  "maxProductsPerSource": 200,
  "maxItems": 0,
  "proxyConfiguration": {
    "useApifyProxy": true
  },
  "maxRetries": 8
}
```

# Actor output Schema

## `results` (type: `string`):

One record per product per store (failed searches or categories appear as error records and are not charged).

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "stores": [
        "coles",
        "woolworths",
        "aldi"
    ],
    "searchQueries": [
        "milk",
        "coffee beans"
    ],
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("ksvan/au-supermarket-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "stores": [
        "coles",
        "woolworths",
        "aldi",
    ],
    "searchQueries": [
        "milk",
        "coffee beans",
    ],
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("ksvan/au-supermarket-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "stores": [
    "coles",
    "woolworths",
    "aldi"
  ],
  "searchQueries": [
    "milk",
    "coffee beans"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call ksvan/au-supermarket-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,ksvan/au-supermarket-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/vFlZfwj3lCF9gq9gI/builds/AMlTPjhfRDjjGysLZ/openapi.json
