BIG W Australia Product Scraper

Extract BIG W Australia product search results, categories, prices, availability, barcodes, images, variants, and detailed item data. Use the scraper for price monitoring, assortment research, competitor analysis, product research, and procurement workflows.

This is an unofficial scraper and is not affiliated with, endorsed by, or sponsored by BIG W or Woolworths Group.

What you can collect

Operation	Result
search	Products matching a keyword
category	Products associated with a BIG W category
categories	BIG W category tree
item	Detailed product data and national pricing
search_filters	Available category and sorting metadata
probe	Lightweight source health diagnostics

The Actor does not currently provide store-specific stock, postcode-specific prices, reviews, or a store locator.

Quick start

The default input returns a small, non-empty LEGO search:

{
  "operation": "search",
  "query": "lego",
  "limit": 5,
  "proxyMode": "apify"
}

Search

Required: query. Optional: page, limit, and max_scan_urls.

{
  "operation": "search",
  "query": "air fryer",
  "limit": 10
}

Product details

Provide one of item_id, slug, or a full BIG W product url.

{
  "operation": "item",
  "item_id": "9900053407"
}

Category products

Provide one of category_id, slug, or a full category url.

{
  "operation": "category",
  "slug": "baby",
  "limit": 10
}

Category tree

{
  "operation": "categories",
  "enabled_only": true
}

Ready-made Saved Tasks

The Actor includes bounded Saved Tasks for common buyer workflows:

• LEGO Price & Assortment Watch — collect a current LEGO product set for price-monitoring or catalog comparison.
• Exact Product Price & Details — retrieve one known product with price, availability, barcode, images, and specifications.
• Baby Category Assortment — collect a bounded sample from a high-value retail category.
• Top-Level Category Map — export the current top-level BIG W catalog structure for discovery and workflow setup.

Run a task as-is, duplicate it, and then replace the query, item ID, category, or limit with your own target.

Output

Results are written to the default Dataset. Depending on the operation, fields can include:

• identity: id, name, brand, slug, source_url
• merchandising: price, discount_price, currency, unit_price
• availability: stock_status, in_stock
• catalog: category, categories, breadcrumbs
• content: description, ingredients, usage_instructions, allergens
• product detail: barcode, size, color, specifications, attributes
• media and choices: image, images, variants, options

The OUTPUT record contains run status, counts, errors, charge-limit status, and the effective proxy route.

Proxy strategy

apify is recommended in Apify Cloud. It uses the standard datacenter pool, the cheapest cloud route verified for BIG W.

• apify: standard datacenter proxy by default
• auto: direct first with Apify datacenter fallback
• direct: no proxy; currently works locally but is blocked from current Apify cloud ranges
• custom: use proxy URLs supplied through Proxy Configuration

If the standard datacenter route becomes blocked, select an AU residential proxy through the Apify Proxy Configuration field. A browser is not required.

Use with n8n or Make

A practical workflow is:

BIG W Actor → Dataset → n8n/Make → Google Sheets, Telegram, email, or CRM

1. Start the Actor through the Apify API or the Apify integration.
2. Wait until the run reaches SUCCEEDED.
3. Read items from the run's default Dataset.
4. Filter price or availability changes.
5. Send the final rows to Sheets, Telegram, email, or your internal system.

API example

curl -X POST \
  "https://api.apify.com/v2/acts/dromb~big-w-au-product-scraper/runs?token=YOUR_APIFY_TOKEN&waitForFinish=120" \
  -H "Content-Type: application/json" \
  -d '{"operation":"search","query":"lego","limit":10,"proxyMode":"apify"}'

Use the returned defaultDatasetId to download results:

$curl "https://api.apify.com/v2/datasets/DATASET_ID/items?token=YOUR_APIFY_TOKEN&clean=true"

Reliability and limits

• Search uses BIG W sitemap product URLs because the public native search endpoint is not consistently available.
• Category product matching is based on category metadata and product URL signals.
• Item mode uses BIG W product and national price endpoints for richer data.
• Requests and sitemap scans are bounded by the input limits.
• Standard Apify datacenter, AU residential, and the tested special proxy groups currently work. BIG W can change its protection rules.
• Free/trial users may be limited to 10 runs per UTC day.

Current charges are shown in the Actor's Pricing tab and in the Apify Console before each run.