Woolworths Scraper 🛒🇦🇺

Extract product & price data from Woolworths Australia — the country's largest supermarket — into clean, structured data. Search by keyword or sweep entire categories and export thousands of products with price, was-price, savings %, half-price & member specials, online vs in-store price, unit price, availability, brand, dietary and allergen info. Built for price monitoring, competitor analysis, deal tracking and FMCG market research.

---

🎯 What does Woolworths Scraper do?

Woolworths is Australia's largest grocery retailer, with tens of thousands of products across every aisle. This actor turns any Woolworths search or category into a structured dataset you can download or feed into your own tools.

Give it a search term (or a category / search URL) and it will:

• 🔎 Search Woolworths or sweep a whole category (Fruit & Veg, Dairy, Pantry…)
• 📄 Automatically paginate through all pages until it reaches your limit
• 💰 Capture full pricing — current price, was-price, savings %, half-price & member specials
• 🏬 Return both online and in-store price for each product
• 📏 Include the unit price ($/100g, $/1L…) for true like-for-like comparison
• 🥗 Add brand, package size, availability, dietary and allergen details
• 🏷️ Optionally return only products on special — perfect for deal tracking
• 🧹 Deliver clean, deduplicated, structured records — no HTML, no clutter
• ⬇️ Export to JSON, CSV, Excel, HTML or via API in one click

No login, no browser extensions, no manual copy-paste.

---

✨ Key features

Feature	Description
Keyword or category input	Type search terms, or paste a search / category URL to sweep an entire aisle.
Specials intelligence	isOnSpecial, isHalfPrice, isMemberSpecial, wasPrice and computed savingsPercent.
Online + in-store price	Both the online price and the in-store price for every product — rarely available elsewhere.
Unit price	Price per unit (e.g. $2.35 / 1L) so you can compare value across pack sizes.
Specials-only mode	One toggle to return just the discounted items — ideal for price-drop monitoring.
Dietary & allergens	Dietary statements (gluten free, vegan…) and allergen info where provided.
Rich product data	Brand, package size, barcode, ingredients, availability, image and more.
Automatic pagination	Walks through all pages up to your maxItems limit.
Deduplicated output	Each product appears once, identified by its unique stockcode.
Clean exports	JSON, CSV, Excel, HTML table, RSS or JSON API.

---

📥 Input

The actor accepts a simple, no-code input form. You can drive it three ways:

Option A — by search term (easiest)

{
    "searchTerms": ["coffee", "chocolate"],
    "maxItems": 200
}

Option B — sweep a category

{
    "startUrls": [
        { "url": "https://www.woolworths.com.au/shop/browse/fruit-veg" }
    ],
    "maxItems": 500
}

Option C — specials only (deal tracking)

{
    "searchTerms": ["snacks"],
    "specialsOnly": true,
    "maxItems": 300
}

Input parameters

Field	Type	Description
searchTerms	array	Product keywords to search.
startUrls	array	Woolworths search or category URLs (for full category sweeps or pre-filtered searches).
specialsOnly	boolean	Return only products currently on special. Default false.
maxItems	integer	Maximum number of products to collect. Default 200.
proxyConfiguration	object	Proxy settings. Australian residential proxies are recommended.

---

📤 Output

Each product is returned as a clean JSON object:

{
    "stockcode": 123456,
    "name": "Cadbury Dairy Milk Chocolate Block 180g",
    "brand": "Cadbury",
    "url": "https://www.woolworths.com.au/shop/productdetails/123456/cadbury-dairy-milk",
    "price": 3.5,
    "wasPrice": 7.0,
    "savingsAmount": 3.5,
    "savingsPercent": 50,
    "isOnSpecial": true,
    "isHalfPrice": true,
    "isMemberSpecial": false,
    "inStorePrice": 3.5,
    "inStoreIsOnSpecial": true,
    "unitPrice": 1.94,
    "unitMeasure": "100G",
    "unitPriceLabel": "$1.94 / 100G",
    "packageSize": "180g",
    "unit": "Each",
    "isAvailable": true,
    "isInStock": true,
    "barcode": "9300617000000",
    "dietary": "Gluten Free",
    "allergens": "Contains Milk, Soy",
    "category": "Chocolate",
    "image": "https://cdn1.woolworths.media/content/wowproductimages/large/123456.jpg"
}

Output fields

Field	Type	Description
stockcode	number	Unique Woolworths product code.
name / brand	string	Product name and brand.
url	string	Direct link to the product page.
price	number	Current online price (AUD).
wasPrice	number	Previous price, when discounted.
savingsAmount / savingsPercent	number	Amount and % saved.
isOnSpecial	boolean	Whether the product is on special.
isHalfPrice	boolean	Whether it's a half-price special.
isMemberSpecial	boolean	Whether it's an Everyday Rewards member special.
inStorePrice	number	In-store price.
inStoreWasPrice / inStoreIsOnSpecial		In-store previous price and special flag.
unitPrice / unitMeasure / unitPriceLabel		Unit price for value comparison.
packageSize / unit	string	Pack size and selling unit.
isAvailable / isInStock	boolean	Availability.
barcode	string	Product barcode (GTIN).
dietary / allergens / ingredients	string	Dietary statements, allergens and ingredients, where provided.
countryOfOrigin	string	Country of origin, where provided.
category	string	Category / search label.
image	string	Product image URL.

You can download the dataset as JSON, CSV, Excel, HTML, RSS or XML, or fetch it programmatically through the Apify API.

---

🚀 How to use Woolworths Scraper (step by step)

1. Click Try for free / Start.
2. Type one or more search terms — or paste a category / search URL to sweep an aisle.
3. (Optional) Enable Specials only to track deals.
4. Set maxItems to how many products you want.
5. Click Save & Start.
6. When the run finishes, open the Dataset tab and Export to your preferred format — or grab it via API.

That's it. No code required.

---

💡 Use cases

• Price monitoring — Track prices across products and categories over time, and get alerted to price drops.
• Specials & deal tracking — Use Specials only to capture every discount, half-price and member offer daily.
• Competitor & market analysis — Benchmark Woolworths pricing against other retailers for FMCG intelligence.
• Unit-price comparison — Normalize by $/100g or $/1L to find the true best value.
• Product catalogs & apps — Power price-comparison sites, budgeting apps and shopping tools with fresh data.
• Range & availability tracking — Monitor which products are in stock, new, or discontinued in a category.
• Academic & retail research — Study grocery inflation, promotions and assortment at scale.

---

🏷️ Why the specials & dual-price data matters

Most product feeds give you a single price. This actor returns the full pricing picture: the current price, the was-price, the exact savings %, whether it's a half-price or member special, and the separate in-store price — plus the unit price for value comparison. That's everything you need for serious price intelligence, not just a product list.

---

⏱️ How many products can I collect?

As many as the search or category contains. Set maxItems to control the volume, and run several searches or categories for broad catalog coverage. Schedule regular runs to keep prices and specials current.

---

🔌 Integrations & automation

Because this runs on Apify, you can:

• 📅 Schedule runs (hourly, daily, weekly) to keep a live price & specials feed.
• 🔗 Push results to Google Sheets, Airtable, Slack, Zapier, Make, or any webhook.
• 🧩 Call it from your backend with the Apify API and SDKs (JavaScript / Python).
• 🔔 Use webhooks to trigger downstream workflows the moment a run completes.

Call via API (example)

curl -X POST "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
        "searchTerms": ["coffee"],
        "specialsOnly": true,
        "maxItems": 200
      }'

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_TOKEN' });
const run = await client.actor('YOUR_ACTOR_ID').call({
    startUrls: [{ url: 'https://www.woolworths.com.au/shop/browse/fruit-veg' }],
    maxItems: 500,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

---

❓ FAQ

Do I need a Woolworths account or API key? No. Just provide a search term or a Woolworths URL.

Does it include specials and discounts? Yes — full specials data: isOnSpecial, isHalfPrice, isMemberSpecial, wasPrice and a computed savingsPercent. Use Specials only to return just discounted items.

Does it include the in-store price too? Yes. Each product includes both the online price and the in-store price (with their own special flags).

What is the unit price? The price per standard unit (e.g. $2.35 / 1L), so you can compare value across different pack sizes.

Can I scrape a whole category? Yes. Paste a category URL such as https://www.woolworths.com.au/shop/browse/fruit-veg and the actor sweeps the whole aisle.

Are results deduplicated? Yes. Each product is uniquely identified by its stockcode and appears only once per run.

What formats can I export? JSON, CSV, Excel, HTML, RSS and XML — via the dashboard or the API.

How do I keep prices fresh? Schedule the actor to run on the interval you need; each run returns the current live prices and specials.

Do I need a proxy? An Australian residential proxy is recommended for reliable, uninterrupted results, and is configured by default.

---

📌 Tips for best results

• Use Specials only for deal feeds. It's the fastest way to build a daily discount dataset.
• Sweep by category for catalogs. Category URLs give broad, structured coverage of an aisle.
• Compare on unit price. unitPrice / unitPriceLabel reveal the true best value across pack sizes.
• Schedule for freshness. Grocery prices and specials change weekly — a scheduled run keeps your data current.
• Split large jobs. For the whole store, run multiple categories in parallel for speed and completeness.

---

⚖️ Legal & responsible use

This actor is intended for lawful data collection such as price monitoring, market research and analytics. You are responsible for how you use the collected data. Only collect publicly available information, respect the target website's Terms of Service and robots.txt, and comply with all applicable laws and regulations. Do not use the data for any unlawful purpose. This actor is an independent tool and is not affiliated with, endorsed by, or connected to Woolworths or its subsidiaries. All trademarks belong to their respective owners.

---

🛟 Support

Questions, feature requests or an issue with the data? Open an issue on the actor's page — feedback is welcome and helps improve the tool.

---

⭐ If this actor saves you time, please leave a review — it really helps!