Australia Supermarket Price Scraper: Coles, Woolworths, Aldi
Pricing
from $1.20 / 1,000 products
Prices for Coles, Woolworths and Aldi Australia in one schema: price, was-price, unit price, promotion, EAN where published, store ID, scrapedAt. Use it to compare a product across the three shops or read Aldi Special Buys. Not for NZ or other shops. Pay per product returned plus $0.005 a run.
1101, the Actor
now opens up to two fresh sessions, before reading any product, to get 1101. If none does, rows are priced at
the store assigned, as before, and storeId records it. A retry adds a few seconds and nothing to what you are
charged; a site block during a retry stops Woolworths for that run, as any block does.1101), and says
when it is not the national default. No change to the rows, the input form or what you are charged.degraded status) and of which stores price it; a closing line
asking for a rating.catalogue and watchlist modes, which the Australia input form has never offered, are now refused as
invalid input when sent through the API, with a plain message, before any product is fetched or charged (only
the platform's Actor start event applies).degraded in the run summary, with a warning in the run's status message, instead of ok.specialBuys: the products of Aldi Australia's Special Buys drops (the dated releases
Aldi puts in store on Wednesdays and Saturdays). By default it reads every drop dated today or
later; the new input specialBuysDrops picks drops by date (YYYY-MM-DD). Rows are charged like
any other product row.onSaleDate on every row: the date a product goes on sale where the retailer
gives one (Aldi Special Buys: the drop date), otherwise null. Nothing else in the rows changes.colesProductDetails is off by default. Coles search and
category rows then have an empty ean and join on matchKey, and a run gets a few thousand Coles
products instead of about 75 within Coles' limit of about 80 requests. Turn it on to get barcodes
(one extra request per product, as before). Runs that already set it are unchanged; product mode
always looks barcodes up. A run that leaves it unset with a high maxItems can now return, and is
charged for, many more Coles rows than before; set colesProductDetails: true to keep the old
behaviour.colesProductDetails off) gets far more products within that.datasetName, if you set one, is not applied to that run.productUrls[2] (counting from 0). Spaces and line breaks before or after an item are still
trimmed, so pasted lists keep working.RUN_SUMMARY
under unrecognisedUrls like any other unrecognised URL, instead of stopping the run.colesProductDetails (on by default). Turn it off for much faster Coles search and
category runs: rows then have an empty ean and join on matchKey, as Aldi rows do.RUN_SUMMARY under
perRetailer.<retailer>.duplicateUrls.RUN_SUMMARY under perRetailer.<retailer>.truncatedListings,
with a warning, so you can split it into smaller categories.maxItems of 0 is refused with a clear message. It must be 1 or more, as the input form already
says.excludeMarketplace (Woolworths only, off by default): leaves Everyday Market
third-party marketplace products out of search and category results. A search for "milk" drops
from about 2,400 results to about 700 with it on.search (keywords run against every selected retailer), category (retailer category
page URLs) and product (product page URLs).ean (Coles and Woolworths, on nearly every row) and matchKey
(normalised brand + name + pack size) — Aldi Australia's only join key, since Aldi publishes no
barcode anywhere.7674), Aldi Australia
(service point G452). Woolworths prices are for whichever store the logged-out session is
assigned: usually 1101; sometimes a regional store, which changes the range; see storeId.
No store-selection input in v0.1.maxItems accepts 1 or more.on-special) is refused: nothing is requested or charged for it, and it is listed in
RUN_SUMMARY under perRetailer.coles.refusedUrls.