Dan Murphy's Scraper

Scrapes danmurphys.com.au — Australia's largest liquor retailer (Endeavour Group). Products with regular / sale / member-offer pricing, case and per-unit prices, ratings, review counts, stock, country, variety, ABV and awards, from the site's own open JSON API — plain HTTP, no browser automation.

45+ fields per product. Category browse (13 departments, sub-departments), keyword search, brand facet, specials-only and member-offers-only modes, plus incremental monitoring (NEW / UPDATED / REAPPEARED / EXPIRED) for scheduled price-watch runs.

Quick start

• Search mode: pick a department (beer, red-wine, white-wine, champagne-sparkling, spirits, whisky, fortified-wine, premix, …), optionally a sub-department (craft beer, shiraz, scotch whisky), a keyword, or a brand; toggle specialsOnly for current offers.
• URL mode — paste any category route (https://www.danmurphys.com.au/beer/craft-beer, /red-wine/shiraz, /whisky/scotch-whisky) or product link; multi-URL supported; pagination walks forward automatically.
• specialsOnly / memberOffersOnly narrow results to current or member offers. They apply to BOTH modes: in URL mode every category scope gets the same facet filters.
• maxProducts (default 20) caps each run; 0 walks the whole department.
• fetchDetails adds the rich description + recommendations per product (per-product surcharge — see pricing). Listing tiles already carry prices, offers, ratings, stock and attributes without it.

Output fields (overview view)

stockcode, name, brand, department, url, price, wasPrice, isOnSpecial, isOnOffer, isMemberOffer, memberOfferLabel, casePrice, singlePrice, inAnySixPrice, rating, reviewCount, country, style, size, abv, standardDrinks, closure, foodMatch, award, sash, stockQty, isNew, deliveryOnly, imageUrl, imageLarge, description, richDescription, tastingNotes, recommendedStockcodes, packMessage, promotionType, unit, packageSize, purchasable, changeType, changedFields, firstSeenAt, lastSeenAt

Incremental mode (recurring monitoring)

Set incrementalMode on a scheduled task: the run remembers the previous run of the same search (keyed on mode + department + filters, or your own stateKey) and classifies every product NEW / UPDATED / UNCHANGED / REAPPEARED / EXPIRED, with changedFields naming what moved. emitUnchanged / emitExpired return — and bill — extra rows. resumeFromRunId instead continues ONE interrupted run by skipping products that run already collected; it cannot be combined with incremental mode.

Send results into your apps (MCP connectors)

Results can be pushed into any Apify MCP connector (Notion and compatible targets). Authorize a connector under Apify → Settings → Integrations, then set mcpConnectors (connector ids) in the input, notionParentPageUrl for Notion, and maxNotifyListings to cap the export (0, the default, exports everything pushed). The connector receives a condensed, human-readable summary per item (title + key fields flattened to text). The complete record always stays in the Apify dataset, which the connector does not mirror.

Pricing

Pay per event: $0.001 per product listing (base, every run) + $0.002 per detail-page enrichment (only when fetchDetails is on). Connection: works out of the box on the default Apify proxy; if you ever see blocks, switch the proxy group in the input (see the Connection section).

Notes

• Uses the site's internal API; departments are the site's verified slugs — wine alone is not one (it splits into red-wine / white-wine / champagne-sparkling / fortified-wine).
• 18+ — you must be of legal purchasing age in your jurisdiction to use this data source.

Verification note (2026-08-31)

Re-verified against the live site on 2026-08-31, and one defect found and fixed: keyword search terms the site treats as category routes (for example "whisky" or "beer") made the search endpoint answer with a redirect instruction instead of product data, which crashed the run. The walk now follows that redirect and browses the matching department instead, so specialsOnly/brand filters keep applying on the browse path. Verified live with the actor's own client: the beer department reported 739 products and the craft-beer sub-department 359, and the "whisky" keyword search that used to crash now browses the whisky department and returns real products. Version bumped with the fix.