🛒 Coles Product Search Scraper

🎯 Pull every product, price, and promotion off Coles.com.au — Australia's #1 supermarket — in seconds.

Scrape product listings from Coles search and category pages with names, brands, sizes, current and was prices, unit pricing, multi-buy promotions, availability, images, and merchandise hierarchy. Built for price monitoring, market research, and competitive intelligence in the Australian grocery sector.

---

🚀 What Does It Do?

This scraper automatically opens any Coles search or category URL and pulls every product it finds into structured, ready-to-use data. No manual browsing, no copy-paste, no login required.

💡 Two modes of operation:

1. 🔍 Keyword Mode — Drop in a list of search terms (e.g. milk, tim tams, gluten free bread) and the scraper builds the search URLs for you.
2. 📋 Direct URL Mode — Paste any Coles search, category, or filtered-results URL and the scraper walks every page until it hits your limit.

🔁 You can also combine both — provide some URLs and some keywords in one run.

---

👥 Who Is This For?

🏢 Use Case	💬 How It Helps
💰 Price Comparison Platforms	Build a live AU grocery price feed alongside Woolworths, IGA, and Aldi — full SKU coverage with promo tracking
📊 FMCG Brands & Suppliers	Monitor where your products sit on Coles, what specials they run, and which brands are out-pricing you
🛍️ Retail Analysts	Track category-level pricing, basket-style promotions, and seasonal pricing rhythms across all categories
🍞 Private-Label Manufacturers	Benchmark Coles "Coles Brand" pricing against name brands in real time
📰 Cost-of-Living Reporters	Measure shrinkflation, weekly specials, and trolley-cost shifts with hard data
🤖 AI / Data Teams	Feed structured grocery data into pricing models, recommendation engines, and demand-forecasting pipelines

---

✨ Features

• 🌐 Any Coles URL Works — Search results, category browses, brand filters, "On Special" pages. Just paste, hit Start.
• 🔎 Keyword Search Mode — Drop in a list of search terms; the scraper turns each one into a search URL automatically.
• 💸 Full Pricing Breakdown — Current price, was price, savings amount, and unit price (e.g. $1.20 per 100g) for every item.
• 🏷️ Promotion Detection — Catches "1/2 Price", "Save $X", "Down Down", multi-buy bundles, and member-only specials.
• 🏪 Coles Brand vs Name Brand — Brand field is normalised so private-label vs branded analysis is one filter away.
• 📦 Pack Sizes & Unit Prices — See 1L, 500g, 12pk next to the price for accurate cost-per-unit comparisons.
• 🗂️ Merchandise Hierarchy — Every product carries its full Coles category breadcrumb (e.g. Dairy & Eggs → Milk → Full Cream).
• 📍 Availability Status — Know whether a product is in stock, out of stock, or location-restricted.
• 🖼️ Product Images — Full-resolution image URLs ready to plug into your catalog or BI dashboard.
• 🔄 Auto Pagination — Walks every results page until the limit you set or the very last page.
• 🛡️ Anti-Blocking — Stealth browser fingerprints + Australian residential proxies built in.
• ⚡ Fast & Scalable — Run thousands of queries per day; concurrency is fully configurable.
• 📤 Export Anywhere — Download results as JSON, CSV, Excel, or push to Google Sheets, Zapier, Make, or your CRM.

---

🎛️ Filters & Options

Option	What It Does
🔗 URLs	Direct Coles search, category, or filtered URLs to scrape
🔎 Search Queries	Plain keywords — the scraper builds the search URL for each one
🔢 Max Items Per URL	Cap how many products to extract per URL or query (set 0 for unlimited)
🔁 Max Retries Per URL	How many times to retry a failed page load before giving up
🛟 Ignore URL Failures	Keep going on errors instead of halting the whole run — perfect for bulk jobs
⚙️ Max Concurrency	How many pages to load in parallel — keep it modest, Coles is heavily protected
🌏 Proxy Configuration	Defaults to Apify residential proxies in Australia for best results

---

📦 What You Get (Output Fields)

Every product includes:

Identity

Field	Example
productId	"5051077"
name	"Coles Full Cream Milk 2L"
brand	"Coles"
size	"2L"
description	"Coles full cream milk in a 2 litre bottle."
url	"https://www.coles.com.au/product/coles-full-cream-milk-2l-5051077"

Pricing

Field	Example
price.current	3.10
price.was	3.40
price.savings	0.30
price.currency	"AUD"
pricePerUnit	"$1.55 per 1L"

Promotions

Field	Example
promotion.label	"Save $0.30"
promotion.type	"PRICE_DROP"
promotion.startDate	"2026-04-30"
promotion.endDate	"2026-05-06"

Categorisation

Field	Example
category.breadcrumbs	["Dairy, Eggs & Fridge", "Milk", "Full Cream"]
category.category	"Dairy, Eggs & Fridge"
category.subCategory	"Milk"
category.aisle	"Aisle 12"

Availability & Media

Field	Example
availability	"In Stock"
locationRestricted	false
images	["https://shop.coles.com.au/wcsstore/Coles-CAS/images/5/0/5/5051077-th.jpg"]
featured	false
adId	null
adSource	null
scrapedAt	"2026-05-02T19:48:00.000Z"

---

📊 Example Output

{
    "productId": "5051077",
    "name": "Coles Full Cream Milk 2L",
    "brand": "Coles",
    "size": "2L",
    "description": null,
    "price": {
        "current": 3.1,
        "was": 3.4,
        "savings": 0.3,
        "currency": "AUD"
    },
    "pricePerUnit": "$1.55 per 1L",
    "promotion": {
        "label": "Save $0.30",
        "type": "PRICE_DROP",
        "startDate": "2026-04-30",
        "endDate": "2026-05-06"
    },
    "availability": "In Stock",
    "category": {
        "breadcrumbs": ["Dairy, Eggs & Fridge", "Milk", "Full Cream"],
        "category": "Dairy, Eggs & Fridge",
        "subCategory": "Milk",
        "aisle": "Aisle 12"
    },
    "url": "https://www.coles.com.au/product/coles-full-cream-milk-2l-5051077",
    "images": ["https://shop.coles.com.au/wcsstore/Coles-CAS/images/5/0/5/5051077-th.jpg"],
    "featured": false,
    "adId": null,
    "adSource": null,
    "locationRestricted": false,
    "scrapedAt": "2026-05-02T19:48:00.000Z"
}

---

📋 Dataset Views

The Apify Console gives you 2 ready-made table views to quickly browse your results:

View	What It Shows
📊 Overview	Product name, brand, size, current price, was price, promotion, availability, URL, image
💰 Pricing	Price-focused view with current, was, savings, unit price, and promotion label per row

---

❓ FAQ

🤔 Why are Australian residential proxies recommended? Coles aggressively blocks data-center IPs and non-AU traffic. Residential AU proxies look like real shoppers and dramatically reduce blocks. They're enabled by default.

🤔 Does it handle promotions and "1/2 Price" specials? Yes — every product carries a promotion object with the label, type, and start/end dates whenever a special is active.

🤔 Can I scrape an entire category? Yes — paste any Coles category URL (e.g. /browse/dairy-eggs-fridge/milk) and set max_items_per_url to 0 for unlimited. The scraper walks every page automatically.

🤔 Can I export the data? Yes — JSON, CSV, Excel, XML, HTML, RSS. You can also push data directly to Google Sheets, Zapier, Make, or any webhook/API endpoint.

🤔 How often should I run this? For fresh price data, run daily. For weekly specials tracking, run every Wednesday morning when Coles refreshes its catalogue. You can schedule automatic runs on Apify with just a few clicks.

🤔 Does it work with proxies? Yes — residential proxies are recommended for the best results. The scraper works with Apify's built-in proxy service and is preconfigured for Australia.

🤔 What about Woolworths, IGA, and Aldi? I can build a scraper for any of those — see the next section.

---

🛠️ Need Custom Filters or Features?

I'm happy to customize this scraper for your specific needs! 🤝

Whether you need:

• 🎯 Additional filters (price range, "On Special" only, brand-specific, location-specific stock)
• 📊 Extra data fields (full ingredients, nutrition panel, allergen info, ratings & reviews)
• 🔄 Integration with your CRM, Google Sheets, BigQuery, or in-house database
• ⏰ Scheduled scraping with automatic deduplication and price-change alerts
• 🌐 Scraping from other Australian grocery platforms alongside Coles (Woolworths, IGA, Aldi, Harris Farm, Costco)

👉 Don't hesitate to reach out via private message — I respond quickly and I'm always open to building exactly what you need. No request is too small or too specific!

---

⚖️ Legal & Ethical Use

This scraper collects only publicly available information from Coles.com.au. It does not access private customer data, bypass authentication, or collect anything that isn't openly visible on the public website. Please use the data responsibly and in compliance with applicable laws and platform terms of service.