Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

Kmart.com.au Product Details Scraper: Extract Australian E-commerce Product Data for Price Monitoring & Market Analysis

Introduction

Kmart Australia (kmart.com.au) stands as one of Australia's largest and most popular discount department store chains, offering an extensive range of products across clothing, homewares, electronics, toys, and everyday essentials. With millions of products listed online and competitive pricing strategies, Kmart's e-commerce platform serves as a critical data source for retailers, market researchers, and businesses operating in the Australian retail market.

For businesses engaged in competitive pricing analysis, product trend research, inventory monitoring, or market intelligence in Australia, accessing structured product data from Kmart is invaluable. However, manually collecting product information across thousands of listings is extremely time-consuming and inefficient, especially when tracking price changes, stock levels, or product variations over time.

The Kmart.com.au Product Details Scraper solves this challenge by automating the extraction of comprehensive product data. Whether you're monitoring competitor pricing, analyzing product assortments, tracking inventory availability, or conducting market research on Australian retail trends, this scraper enables systematic data collection that would otherwise require countless hours of manual effort.

Scraper Overview

The Kmart.com.au Product Details Scraper is a specialized data extraction tool designed to systematically collect detailed product information from Kmart Australia's e-commerce platform. This scraper leverages advanced web automation techniques to navigate product pages and extract comprehensive product attributes, pricing data, inventory information, and multimedia content efficiently.

The tool offers key advantages including residential proxy support for reliable Australian data collection, configurable retry mechanisms for handling network issues, and extraction of complete product variations and attributes. It's particularly valuable for Australian e-commerce businesses conducting competitive analysis, pricing intelligence teams monitoring market dynamics, retail analysts tracking product trends, and procurement professionals evaluating supplier offerings.

The scraper is designed to extract rich product data including multiple variants, pricing tiers, seller information, inventory status, and multimedia assets. It maintains high data accuracy while respecting rate limits and implementing best practices for ethical web scraping, ensuring reliable access to Kmart's extensive product catalog.

Input and Output Details

Example url 1: https://www.kmart.com.au/product/maseur-shoe-horn-41785997/

Example url 2: https://www.kmart.com.au/product/lace-trim-waffle-shorts-s172806/

Example url 3: https://www.kmart.com.au/product/short-sleeve-linen-blend-drop-tier-mini-dress-s173136/?selectedSwatch=Urban+Grn

Example Screenshot of product information page:

Input Format

The scraper accepts a JSON configuration with parameters controlling the data extraction process from Kmart product pages.

{
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "AU"
  },
  "urls": [
    "https://www.kmart.com.au/product/maseur-shoe-horn-41785997/",
    "https://www.kmart.com.au/product/active-mens-running-shoes-43256812/",
    "https://www.kmart.com.au/product/round-dining-table-42891456/"
  ],
  "max_retries_per_url": 2
}

The urls parameter: Add URLs of specific Kmart product detail pages you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. Each URL should be a complete product page URL from kmart.com.au.

The max_retries_per_url parameter: Limit the number of retries for each URL if the scrape is detected as a bot or the page fails to load. The default value is 2, balancing thoroughness with efficiency.

The proxy parameter: Proxy configuration is essential for maintaining access and avoiding detection. For Kmart Australia, use Australian residential proxies (apifyProxyCountry: "AU") for optimal performance and reduced blocking risk.

Output Format

Example output

[
  {
  "id": "P_41785997",
  "uri": "/product/maseur-shoe-horn-41785997/",
  "url": "/product/maseur-shoe-horn-41785997/",
  "video": {},
  "badges": [],
  "image_url": "https://assets.kmart.com.au/transform/d879926e-ebcc-4508-bba3-d237a02efeb7/41785997-1?io=transform:extend,width:580,height:725",
  "alt_images": [
    "b9f8ba5d-bb9a-471f-8021-19eaaa0ec3d5/41785997-2",
    "841cc6c2-a813-4243-b019-fb625ef86d47/41785997-3"
  ],
  "free_shipping": true,
  "merch_department": 1,
  "assorted_products": false,
  "is_pre_order_active": false,
  "free_shipping_metro": true,
  "primary_category_id": "a648b4f7e136f68029fd7637ac17812d",
  "national_inventory": false,
  "fulfilment_channel": 3,
  "ratings": {
    "total_reviews": 50,
    "average_score": 4.9
  },
  "badges_marketplace": {
    "seller": [
      {
        "id": "1",
        "type": "seller",
        "order": 1,
        "display_text": "kmart"
      }
    ]
  },
  "group_ids": [
    "9f1c10bf24a66dd30a299588a5f4ae30",
    "567233c2ab2b1634edd57617530c1afa",
    "a648b4f7e136f68029fd7637ac17812d",
    "84908f4387dfe45daef9773d1fbbece4",
    "4b521b0212dd9473d653c066ee6cfdc3"
  ],
  "apn": 9311400624217,
  "size": "Miscellaneous",
  "price": 6,
  "colour": "Blue",
  "seller": [
    "Kmart"
  ],
  "prices": [
    {
      "type": "list",
      "amount": "6.00",
      "country": "AU",
      "end_date": "9999-12-31",
      "currency": "AUD",
      "start_date": "1899-12-30"
    }
  ],
  "clearance": false,
  "is_default": false,
  "variation_id": "41785997",
  "variant_video": {},
  "variant_badges": [],
  "secondary_colour": "Blue"
}
]

The scraper returns comprehensive product data with each field serving specific purposes for pricing intelligence and market analysis:

• ID: Unique product identifier within Kmart's system. Critical for tracking products over time, database management, and correlating data across multiple scraping sessions.

• URI: Product URI path. Used for constructing product links and tracking URL structure changes.

• URL: Complete product page URL. Essential for direct product access, verification, and creating clickable references in reports or databases.

• Video: Product demonstration or promotional video URLs. Valuable for understanding product features, analyzing marketing strategies, and enriching product databases with multimedia content.

• Badges: Product badges and labels (e.g., "New", "Exclusive", "Limited Edition"). Indicates promotional status, product positioning, and marketing emphasis, useful for identifying trending or featured products.

• Image URL: Primary product image URL. Essential for visual product identification, creating product catalogs, and enhancing user interfaces with product imagery.

• Alt Images: Alternative product images showing different angles or contexts. Provides comprehensive visual documentation, enables detailed product analysis, and supports rich product listings.

• Free Shipping: Boolean indicator of free shipping eligibility. Critical for pricing comparison including delivery costs, understanding competitive advantages, and calculating total customer cost.

• Merch Department: Merchandise department or category. Enables category-level analysis, market segmentation, and understanding Kmart's product organization structure.

• Assorted Products: Information about product assortments or bundles. Useful for identifying multi-pack offerings, bundle deals, and understanding product packaging strategies.

• Is Pre Order Active: Boolean indicating if product is available for pre-order. Signals upcoming product launches, helps track product lifecycle stages, and identifies new market entrants.

• Free Shipping Metro: Boolean for metropolitan area free shipping. Indicates location-based shipping policies, useful for understanding regional pricing strategies and delivery cost variations.

• Primary Category ID: Main product category identifier. Enables systematic category-level analysis, product classification, and integration with taxonomy systems.

• National Inventory: National inventory availability status. Critical for stock monitoring, identifying supply chain issues, and understanding product availability across Australia.

• Fulfilment Channel: Product fulfillment method (online, in-store, marketplace). Reveals distribution strategies, identifies marketplace sellers vs. direct Kmart inventory, and helps understand fulfillment capabilities.

• Ratings: Customer rating and review information. Provides product quality indicators, customer satisfaction metrics, and competitive positioning based on customer feedback.

• Badges Marketplace: Marketplace-specific badges for third-party sellers. Distinguishes marketplace products, identifies seller quality indicators, and helps assess product source reliability.

• Group IDs: Product grouping identifiers for related items. Enables identification of product families, related items, and cross-selling opportunities.

• APN: Australian Product Number (barcode). Standard product identifier for inventory management, price comparison across retailers, and product matching in databases.

• Size: Product size specifications. Essential for apparel, furniture, and size-variant products, enables filtering and comparison based on dimensions.

• Price: Current product price in AUD. Core data point for competitive pricing analysis, price tracking over time, and market positioning assessment.

• Colour: Product color options. Enables variant analysis, tracks color availability, and supports detailed product specification documentation.

• Seller: Seller information for marketplace products. Identifies third-party sellers, enables seller performance tracking, and distinguishes direct Kmart products from marketplace offerings.

• Prices: Complete pricing structure including original price, sale price, discounts. Provides comprehensive pricing intelligence, enables discount analysis, and tracks promotional strategies.

• Clearance: Boolean indicating clearance status. Identifies discontinued or end-of-season products, signals inventory liquidation, and highlights deep discount opportunities.

• Is Default: Indicates if this is the default product variant. Useful for understanding product hierarchy and primary variant selection.

• Variation ID: Unique identifier for product variations. Essential for tracking specific product variants (size/color combinations) and managing variant-level inventory and pricing.

• Variant Video: Videos specific to product variants. Provides variant-specific visual content, useful for detailed variant documentation.

• Variant Badges: Badges specific to product variants. Indicates variant-specific promotions or features, enables variant-level marketing analysis.

• Secondary Colour: Additional color specifications. Provides detailed color information for multi-color products, enables precise product specification.

Each field serves specific purposes in competitive intelligence workflows, pricing optimization, inventory monitoring, and e-commerce market analysis targeting the Australian retail sector.

Usage Guide

Setting Up Your Scraping Task

Step 1: Identify Target Products

Navigate to kmart.com.au and locate the specific products you want to scrape. You can:

• Browse product categories to find relevant items
• Use Kmart's search functionality to find products by keyword
• Copy product URLs from comparison shopping sites or price tracking tools
• Build URL lists from Kmart's sitemap or category pages

Copy the complete product page URLs (e.g., https://www.kmart.com.au/product/[product-name]-[product-id]/).

Step 2: Configure Input JSON

Add your product URLs to the urls array. For large-scale scraping:

• Test with 5-10 URLs first to validate configuration
• Batch URLs into manageable groups (50-100 per run)
• Maintain organized URL lists categorized by product type or department

Step 3: Configure Proxy Settings

For optimal results scraping Kmart Australia:

• Enable Apify proxy with residential proxy groups
• Set apifyProxyCountry to "AU" for Australian proxies
• Australian IPs reduce detection risk and improve access reliability
• Consider residential proxies essential for large-scale extraction

Step 4: Set Retry Parameters

Configure max_retries_per_url:

• Default of 2 retries works for most scenarios
• Increase to 3-4 for critical products if experiencing failures
• Monitor retry rates to identify problematic URLs

Best Practices

URL Management:

• Validate all URLs before large batch runs
• Remove duplicate URLs to avoid wasted resources
• Check that URLs are active product pages, not category pages
• Store URLs with timestamps for tracking when they were collected

Proxy Configuration:

• Always use Australian residential proxies for Kmart.com.au
• Residential proxies significantly reduce blocking risk
• Monitor proxy performance and switch if encountering issues
• Rotate proxy sessions for large-scale scraping

Data Collection Strategy:

• Schedule regular scraping for price monitoring (daily/weekly)
• Scrape during off-peak Australian hours for better performance
• Implement delays between large batches
• Store historical data to track price and inventory changes over time

Error Handling:

• Monitor failed URLs and investigate patterns
• Check if products have been delisted or URLs changed
• Verify proxy functionality if multiple failures occur
• Maintain backup URL lists for critical products

Common Troubleshooting

Access Issues:

• Switch to Australian residential proxies if blocked
• Verify URLs are correctly formatted and accessible
• Check if Kmart has implemented temporary restrictions
• Reduce scraping rate if encountering consistent blocks

Data Quality Problems:

• Validate that URLs point to product detail pages, not category pages
• Check for products with unusual structures (bundles, pre-orders)
• Verify variant data is complete for multi-variant products
• Cross-reference sample outputs with actual product pages

Performance Optimization:

• Adjust retry limits based on success rates
• Use appropriate batch sizes to balance speed and stability
• Monitor system resources during large extractions
• Consider splitting very large jobs into multiple smaller runs

Advanced Use Cases

Competitive Price Monitoring:

• Schedule daily scrapes of competitor product ranges
• Track price changes over time with historical data
• Identify pricing patterns and promotional cycles
• Compare prices across product variants and sizes

Inventory Tracking:

• Monitor stock availability for popular products
• Identify out-of-stock trends by category
• Track restocking patterns and lead times
• Alert on inventory changes for critical products

Product Assortment Analysis:

• Compare product offerings across categories
• Identify new product launches via pre-order status
• Track clearance products and discontinuation patterns
• Analyze product mix changes over time

Marketplace Intelligence:

• Identify third-party sellers on Kmart marketplace
• Compare marketplace vs. direct Kmart products
• Track seller performance via ratings and badges
• Analyze fulfillment channel distribution

Benefits and Applications

The Kmart.com.au Product Details Scraper delivers significant advantages for businesses operating in or analyzing the Australian retail market.

Primary Applications:

Competitive Pricing Intelligence: Retailers can monitor Kmart's pricing strategies across thousands of products, track promotional cycles and discount patterns, identify pricing opportunities and gaps, and optimize their own pricing based on market data.

Inventory Management: Track product availability across Kmart's catalog, identify supply chain trends and stock-outs, monitor restocking patterns for demand forecasting, and plan inventory based on competitor stock levels.

Market Research: Analyze Australian retail trends and product categories, identify emerging product types and new launches, understand consumer preferences via ratings and reviews, and track market share indicators through product assortment.

E-commerce Strategy: Study product presentation and multimedia usage, analyze variant structures and SKU organization, understand fulfillment and shipping strategies, and benchmark against Australia's leading discount retailer.

Price Optimization: Build dynamic pricing models using competitor data, identify optimal price points by category, track discount depth and frequency, and respond rapidly to market price changes.

Product Sourcing: Identify products by APN for supplier matching, compare specifications across multiple retailers, find arbitrage opportunities through price differentials, and discover trending products worth stocking.

The scraper provides competitive advantages through:

• Comprehensive product data including all variants and pricing tiers
• Real-time inventory status for stock monitoring
• Complete multimedia assets for product documentation
• Seller and fulfillment information for marketplace analysis
• Structured data format for easy integration with analytics tools
• Australian market focus with localized pricing and availability data

The structured output integrates seamlessly with pricing tools, inventory management systems, business intelligence platforms, and e-commerce analytics solutions, enabling immediate activation of collected data for strategic decision-making in the Australian retail market.

Conclusion

The Kmart.com.au Product Details Scraper transforms manual product research into efficient automated data collection. By providing structured access to comprehensive product information from Australia's leading discount retailer, it empowers businesses to make data-driven decisions about pricing, inventory, and market positioning.

Whether you're monitoring competitor prices, tracking inventory availability, analyzing product trends, or conducting comprehensive market research, this scraper provides the systematic data extraction capabilities needed to maintain competitive advantage in Australia's dynamic retail landscape.

Ready to streamline your Kmart product data collection? Start extracting valuable e-commerce intelligence today and transform your pricing and market analysis capabilities.

Related Actors

• Kmart.com.au Product Search Scraper: A specialized data extraction solution engineered to harvest comprehensive product information from Kmart.com.au's marketplace.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Kmart.com Product Details Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.