Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

Next.co.uk Product Details Scraper: Complete Product Data Extraction Tool

Introduction

Next.co.uk stands as one of the UK's leading fashion retailers, operating over 550 retail branches and serving more than 3 million active online customers. With its comprehensive catalog spanning women's, men's, and children's fashion plus homeware and beauty products, Next represents a goldmine of valuable retail data for businesses seeking competitive insights.

The challenge facing retailers, market researchers, and analysts is accessing this wealth of product information efficiently and at scale. Manual data collection from Next.co.uk is time-consuming, error-prone, and impractical when dealing with thousands of products across multiple categories. Our Next.co.uk Product Details Scraper addresses this critical need by automating the extraction of comprehensive product data, enabling businesses to make informed decisions based on real-time market intelligence.

Comprehensive Scraper Overview

The Next.co.uk Product Details Scraper is a sophisticated data extraction tool designed specifically for the unique structure and requirements of Next's e-commerce platform. Unlike generic scraping solutions, this specialized tool understands Next's product page architecture, handles dynamic content loading, and captures detailed product information that would be impossible to obtain manually.

Our scraper excels in extracting granular product details including pricing history, inventory status, product specifications, and rich metadata. The tool is optimized for reliability and accuracy, incorporating advanced features such as proxy rotation, retry mechanisms, and intelligent rate limiting to ensure consistent performance while respecting the website's terms of service.

This solution is ideal for competitive intelligence analysts, market researchers, e-commerce businesses, pricing strategists, and fashion industry professionals who require accurate, up-to-date product data from one of the UK's most prominent retailers.

Input and Output Format Details

Example url 1: https://www.next.co.uk/style/su053339/a00951#a00951

Example url 2: https://www.next.co.uk/style/st388140/c24482#c24482

Example url 3: https://www.next.co.uk/style/su053339/a00951#a00951

Example Screenshot of product information page:

Input Format

The scraper accepts a JSON configuration specifying the product URLs to extract data from, along with proxy settings and retry parameters:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "urls": [ // Links to product information pages.
    "https://www.next.co.uk/style/su053339/a00951#a00951",
    "https://www.next.co.uk/style/st388140/c24482#c24482",
    "https://www.next.co.uk/style/su053339/a00951#a00951"
  ]
}

Key Input Parameters:

• max_retries_per_url: Controls resilience by setting maximum retry attempts for failed requests, ensuring data collection completion even with temporary network issues
• proxy configuration: Essential for avoiding detection and maintaining consistent access, with residential proxies providing the most reliable results
• urls array: Product page URLs following Next's specific format with style numbers and item codes

Output Format

You get the output from the Stockx.com Product Details Page Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of product information
  {
  "style_number": "su624250",
  "item_number": "f30877",
  "item_description": {
    "links1": null,
    "links2": null,
    "links3": null,
    "tone_of_voice": null,
    "tone_of_voice_sanitised": null,
    "tone_of_voice_unformatted": null,
    "logos": [],
    "measurements": null,
    "product_information_list": [],
    "copy_text1": null,
    "copy_text2": null,
    "copy_text3": null,
    "copy_text4": null,
    "copy_text5": null,
    "copy_text6": null,
    "country_of_origin": null,
    "multibuy": null,
    "terms_and_conditions": null,
    "washing_instructions": "",
    "composition": "92% Polyester, 8% Elastane."
  },
  "chain": "A",
  "coords": [],
  "title": "Lipsy Chocolate Brown Slinky Hardware Top",
  "price": "£36",
  "price_history": null,
  "was_price": "",
  "price_data": {
    "was_price": null,
    "sale_price": null,
    "price": {
      "min_price": 36,
      "max_price": 36
    }
  },
  "product_code": "F30-877",
  "markdown_type_v2": null,
  "template_type": "fashion",
  "fulfilment_type": "",
  "brand": "Lipsy",
  "range": null,
  "product_name": "",
  "legal_warnings": [],
  "item_media": [
    {
      "id": "4",
      "name": "F30877s",
      "level": "item",
      "type": "image",
      "image_type": "M",
      "shot_type": "Location Worn",
      "web_type": "",
      "outlet": null,
      "page_no": null,
      "also_item_level": false,
      "is_hero_image": true,
      "image_url": "/common/items/default/default/itemimages/3_4Ratio/product/lge/F30877s.jpg"
    },
    {
      "id": "3",
      "name": "F30877s2",
      "level": "item",
      "type": "image",
      "image_type": "M",
      "shot_type": "Location Worn",
      "web_type": "",
      "outlet": null,
      "page_no": null,
      "also_item_level": false,
      "is_hero_image": false,
      "image_url": "/common/items/default/default/itemimages/3_4Ratio/product/lge/F30877s2.jpg"
    },
    {
      "id": "2",
      "name": "F30877s3",
      "level": "item",
      "type": "image",
      "image_type": "M",
      "shot_type": "Location Worn",
      "web_type": "",
      "outlet": null,
      "page_no": null,
      "also_item_level": false,
      "is_hero_image": false,
      "image_url": "/common/items/default/default/itemimages/3_4Ratio/product/lge/F30877s3.jpg"
    },
    {
      "id": "1",
      "name": "F30877s4",
      "level": "item",
      "type": "image",
      "image_type": "M",
      "shot_type": "Location Worn",
      "web_type": "",
      "outlet": null,
      "page_no": null,
      "also_item_level": false,
      "is_hero_image": false,
      "image_url": "/common/items/default/default/itemimages/3_4Ratio/product/lge/F30877s4.jpg"
    }
  ],
  "category": "T-Shirts",
  "collection": "Casual",
  "has_hazardous_materials": false,
  "designer_boutique": null,
  "material": null,
  "department": "Womenswear",
  "gender": "Women",
  "colour": "Chocolate Brown",
  "currency_code": "GBP",
  "options": {
    "options": [
      {
        "name": "6",
        "value": "07",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      },
      {
        "name": "8",
        "value": "08",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      },
      {
        "name": "10",
        "value": "09",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      },
      {
        "name": "12",
        "value": "10",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      },
      {
        "name": "14",
        "value": "11",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      },
      {
        "name": "16",
        "value": "12",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      },
      {
        "name": "18",
        "value": "13",
        "price": null,
        "price_unformatted": 36,
        "stock_status": "InStock"
      }
    ],
    "render_method": "chip",
    "split_sizing_config": {
      "split_size_available": false
    }
  },
  "fit": "Regular",
  "fits_and_colourways": {
    "fits": [
      {
        "display_text": "Regular",
        "default_item_number": "F30877",
        "has_matching_colour": true,
        "is_available": true
      }
    ],
    "fit_render_method": "chip",
    "colourways": {
      "colourways": [
        {
          "display_text": "Chocolate Brown",
          "item_number": "F30877",
          "is_available": true
        }
      ],
      "colourway_render_method": "chip"
    }
  },
  "fits_and_colourways_item_number_map": {
    "f30877": {
      "colour": "Chocolate Brown",
      "fit": null
    }
  },
  "fit_label": "",
  "available_for_collect_in_store": false,
  "banner_fragment_id": "calculation-service-banner",
  "seo_metadata": null,
  "personalised_gift_theme": 0,
  "offer_type": "none",
  "product_metadata": {
    "category_links": [
      {
        "text": "T-Shirts",
        "url": "/shop/gender-women-category-tshirts"
      },
      {
        "text": "New In",
        "url": "/shop/gender-women-category-tshirts/feat-newin"
      },
      {
        "text": "Next",
        "url": "/shop/gender-women-category-tshirts/brand-next"
      },
      {
        "text": "Blue",
        "url": "/shop/gender-women-category-cardigans/colour-blue"
      },
      {
        "text": "Black",
        "url": "/shop/gender-women-category-cardigans/colour-black"
      },
      {
        "text": "Stripe",
        "url": "/shop/gender-women-category-tshirts/pattern-stripe"
      }
    ]
  }
}, // ... Many other product details
]

The scraper extracts an extensive range of product information, providing unparalleled depth of retail intelligence:

Core Product Identification:

• Style Number: Unique product style identifier used across Next's inventory system
• Item Number: Specific variant identifier for different sizes, colors, and configurations
• Product Code: Internal reference code for inventory management and tracking

Product Information:

• Item Description: Detailed product description including features, materials, and specifications
• Product Name: Commercial product title as displayed to customers
• Title: SEO-optimized product title for search and marketing purposes
• Brand: Manufacturer or designer brand information, including house brands and collaborations
• Range: Product collection or seasonal range classification

Pricing and Financial Data:

• Price: Current selling price in the specified currency
• Was Price: Original price before any discounts or markdowns
• Price History: Historical pricing data showing price changes over time
• Currency Code: ISO currency code (typically GBP for UK market)
• Price Data: Comprehensive pricing structure including promotional pricing
• Markdown Type V2: Classification of discount type (seasonal, clearance, promotional)

Inventory and Availability:

• Available for Collect in Store: Stock availability for click-and-collect services
• Fulfilment Type: Shipping and delivery options (standard, next-day, store pickup)
• Options: Available product variants (sizes, colors, styles)
• Fits and Colourways: Detailed size and color combinations with availability status
• Fits and Colourways Item Number Map: Mapping between variants and specific item numbers

Product Classification:

• Category: Primary product category (dresses, shoes, accessories)
• Department: Store department classification (women's, men's, children's, home)
• Collection: Seasonal or thematic product grouping
• Gender: Target demographic classification
• Material: Fabric composition and material specifications
• Colour: Primary and secondary color descriptions

Technical and Metadata:

• Template Type: Page template classification for different product types
• SEO Metadata: Search engine optimization data including meta descriptions and keywords
• Banner Fragment ID: Marketing banner and promotional content identifiers
• Item Media: Product images, videos, and multimedia content URLs
• Legal Warnings: Safety information, care instructions, and regulatory compliance data

Specialized Features:

• Coordinates: Related product recommendations and styling suggestions
• Chain: Product relationship mapping for coordinated items
• Has Hazardous Materials: Safety classification for shipping and handling
• Designer Boutique: Premium or designer product classification
• Fit: Sizing information including fit type (slim, regular, loose)
• Fit Label: Detailed sizing guidance and measurement information
• Personalised Gift Theme: Customization options and gift wrapping availability
• Offer Type: Promotional campaign classification and discount categories
• Product Metadata: Additional structured data for enhanced product understanding

Implementation Guide

Step-by-Step Usage

1. Configuration Setup: Define your scraping parameters including target URLs, proxy settings, and retry policies based on your specific requirements and data volume needs.

2. URL Preparation: Ensure product URLs follow Next's standard format. The scraper works with individual product pages containing style and item number identifiers.

3. Execution Monitoring: The tool provides real-time progress updates and error reporting, allowing you to monitor extraction status and address any issues promptly.

4. Data Validation: Implement automated checks to verify data completeness and accuracy, particularly for critical fields like pricing and availability information.

Best Practices and Optimization

Performance Optimization: Use residential proxies from the target country (UK) to minimize detection risk and improve success rates. Configure appropriate delays between requests to maintain respectful crawling practices.

Error Handling: The built-in retry mechanism handles temporary failures, but monitor logs for persistent issues that may indicate changes to the website structure or access restrictions.

Data Quality Assurance: Regularly validate extracted data against manual spot checks, particularly for pricing information and product specifications that change frequently.

Business Value and Applications

Market Intelligence and Competitive Analysis

The comprehensive product data enables retailers to benchmark pricing strategies, analyze competitor product ranges, and identify market trends. Fashion retailers and brands can gain actionable market insights for competitive positioning and pricing optimization.

Inventory and Demand Forecasting

Historical pricing data combined with availability information provides valuable insights for demand forecasting and inventory management decisions. Retailers can optimize stock levels based on competitor performance and market dynamics.

Business Intelligence and Strategic Planning

The rich metadata and product classification data supports strategic decision-making in product development, market positioning, and category management. Fashion businesses can identify emerging trends and optimize their product mix accordingly.

Time Efficiency: Automated data extraction eliminates hundreds of hours of manual research, allowing teams to focus on analysis and strategic decision-making rather than data collection.

Conclusion

The Next.co.uk Product Details Scraper delivers unparalleled access to one of the UK's most comprehensive fashion retail datasets. With 30+ extracted data fields covering everything from basic product information to advanced pricing intelligence and inventory data, this tool provides the competitive edge necessary in today's fast-paced retail environment.

Whether you're conducting market research, optimizing pricing strategies, or analyzing competitive positioning, this scraper transforms complex data extraction into a streamlined, reliable process. Start leveraging Next.co.uk's extensive product catalog today to drive informed business decisions and maintain competitive advantage in the dynamic fashion retail market.

Related Actors

• Next.co.uk Product Search Scraper: A specialized data extraction solution engineered to harvest comprehensive product information from Next.co.uk's marketplace.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Next.co.uk Product Details Page Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.