Coles & Woolworths Scraper: Prices, Specials & Unit Prices
Pricing
from $0.45 / 1,000 grocery products
Get Australian supermarket prices from Coles and Woolworths by keyword, category or product ID: current price, was-price, unit price, specials (half price, multi-buy), promotions and stock in one unified format. For price tracking, price comparison apps and grocery specials alerts.
Which supermarkets to search. Search terms, bare product numbers and "Only specials" run on every selected store. Category and product links always run on the store they belong to.
[ "coles", "woolworths"]Keywords to search in each selected store, e.g. "milk", "tim tam", "nappies". Each term returns up to "Max products per search" products per store.
Category pages copied from the store website, e.g. https://www.coles.com.au/browse/dairy-eggs-fridge or https://www.woolworths.com.au/shop/browse/fruit-veg. Sub-categories work too. Use https://www.woolworths.com.au/shop/browse/specials or https://www.coles.com.au/on-special for the current specials.
Specific products to check: product links (https://www.coles.com.au/product/...-1234567, https://www.woolworths.com.au/shop/productdetails/123456/...), prefixed IDs ("coles:1234567", "woolworths:123456") or bare product numbers, which are looked up in every selected store.
Return only products that are on special (a was-price, a half-price or a promotion). With no search terms, categories or products, the Actor returns the stores' full specials lists.
Maximum number of products saved for each search term, category or specials list, per store. You pay only for products saved.
Also save the paid 'sponsored' / 'promoted' products the stores insert into results. Off by default because they often don't match the search and repeat on every page. Sponsored rows are marked with isSponsored.
Proxy used for both stores. The default Apify Proxy works in most cases. If the log says requests are BLOCKED, switch to the RESIDENTIAL group with country Australia (AU) — Coles in particular is protected by Imperva.
{ "useApifyProxy": true}Open the Coles homepage once in a real Chrome browser to pass its bot protection and collect cookies, then load products with fast JSON requests. Keep this on: Coles blocks plain requests. Woolworths never needs it (a browser is only used there if plain requests get blocked).
If fast requests keep getting blocked, load the JSON from inside the real browser (slower, but looks exactly like a visitor). Recommended.
Safety limit on result pages read per search term or category (Coles shows 48 products per page, Woolworths 36). Mostly matters with "Only specials", where many pages may be checked to find enough specials.
How many times a failed or blocked request is retried (with a new IP and new cookies when blocked) before that search is reported as failed.
Average pause between two requests to the same store. Slower is less likely to be blocked.
When a store answers with a block/captcha page, save up to 4 such pages (and a browser screenshot) per store to the run's key-value store as DEBUG-* records. Free; helps report problems.
Add the original product object from the store's API as a "raw" field on every product (large; for debugging or fields not in the unified format).
For testing only: send Coles requests to this address instead of https://www.coles.com.au (e.g. a local mock server). Leave empty.
For testing only: send Woolworths requests to this address instead of https://www.woolworths.com.au (e.g. a local mock server). Leave empty.