Bike24 Product & Availability Scraper

This Apify Actor is a production-grade web scraping solution designed to extract detailed product data and real-time availability information from Bike24.com.

Unlike basic crawlers, this scraper combines static HTML parsing with internal API requests to retrieve complete product details, including size variants, stock levels, and delivery times.

---

🚀 What This Scraper Does

The scraper collects:

• Full product metadata
• Technical specifications
• Manufacturer details (including email and website)
• Real-time stock availability per size/variant
• Delivery time estimates
• Shippability status

It intelligently distinguishes between:

• 🛍 Single product pages
• 📂 Category/listing pages with pagination

---

🔑 Key Features

🧾 Structured Data Extraction (JSON-LD)

Parses embedded application/ld+json structured data to retrieve:

• Product name
• Brand
• Price
• Currency

🏷 Manufacturer Data Parsing

Extracts:

• Manufacturer name
• Manufacturer website (via regex detection)
• Manufacturer email

📊 Technical Data Sheet Extraction

Automatically parses product specification tables, including:

• Weight
• Material
• Dimensions
• Any additional technical attributes

Each row is dynamically added as a key-value pair in the final dataset.

---

📦 Real-Time Availability via Internal API

This allows retrieval of:

• Variant ID
• Size label
• Current stock count
• Stock status message
• Cleaned delivery time
• Shippability status

---

🔄 Smart Pagination Handling

For listing/category pages:

• Automatically injects or updates the page query parameter

🛠 How It Works

1️⃣ Input

Provide start_urls via Actor input:

{
  "start_urls": [
    { "url": "https://www.bike24.com/cycling/shoes" }
  ],
  "max_concurrency": 5
}

---

2️⃣ URL Type Detection

The scraper determines whether a URL is:

• A single product page (/pXXXXX.html)
• A category page

Then routes it accordingly.

---

📦 Output Data Structure

Each product produces a structured object similar to:

{
    "id": "979165",
    "url": "https://www.bike24.com/p2979165.html",
    "name": "Ridley FENIX SLiC Carbon Road Bike - Rival AXS - 2024 - D1150As",
    "brand": "Ridley Bikes",
    "price": "1621.01",
    "currency": "EUR",
    "manufacturerName": "Comfort seat stays - more comfort, maximum power",
    "manufacturerWebsite": "www.ridley-bikes.com",
    "manufacturerEmail": "info@cyclingfactory.be",
    "description": "Ridley FENIX SLiC Carbon Road Bike - Rival AXS - 2024 - D1150As\n\n\nRidley Fenix SLiC - Top-class endurance road bike\nThe Ridley Fenix SLiC is the result of the further development of three generations of endurance road bikes. The Fenix series was originally created in 2012 at the request of the Lotto-Soudal team, who were looking for a bike for racing on cobblestones that was both comfortable and had agile handling.\nThanks to fully integrated cable routing, the Fenix SLiC combines aerodynamics, comfort and efficient power transmission.\nThe rear and upper frame area is designed for long-distance comfort. A wide bottom bracket, diamond-shaped down tube, reinforced steerer and precise steering fork ensure maximum stiffness and precise handling.\nHighlights of the Ridley FENIX SLiC\n\nCarbon frame & fork\nSRAM Rival eTAP AXS 2x12-speed drivetrain\nForza Cirrus seatpost\nForza Norte db wheelset\nVittoria Rubino Pro G2.0 tires\nSelle Italia SLR Boost saddle\n\nDetails of the Ridley FENIX SLiC\nComfort seat stays - more comfort, maximum power\nLow-set seat stays filter vibrations and increase vertical flexibility for noticeably more comfort. The oval shape also ensures optimum power transmission - every watt is converted directly into speed.\nRidley Elite Carbon - high-end material mix for perfect performance\nToray carbon ensures the optimum balance of stiffness, weight and comfort. Each frame area is given the ideal mix, tailored to the riding purpose and load, for maximum efficiency and ride quality.\nFenix frame tubes - comfort & stiffness combined\nThe oversized steerer provides additional stiffness and stability, which is noticeable when accelerating and handling. The solid down tube increases stiffness and strength. The BB86 bottom bracket and the asymmetrical chain stay ensure maximum power transmission.\nThe slightly curved top tube becomes narrower and rounder towards the seat tube. It absorbs bumps like a leaf spring. The seatpost filters vibrations and, in combination with the narrow, oval seat stays, creates a perfect balance of stiffness and comfort. Find out more about the seat stays HERE.\nF-Steerer - Invisible cables for more speed\nThe cables on your bicycle have a major impact on its aerodynamic performance. If the cables disappear, this brings an aerodynamic advantage of an astonishing 10 to 14 %, depending on the bicycle.\nThat's why the Ridley research department spent so much time and effort developing the D-shaped steering tube, which integrates all the cables. The cables are completely hidden from the wind and from your view.",
    "Product Name": "Ridley FENIX SLiC Carbon Road Bike - Rival AXS - 2024 - D1150As",
    "Manufacturer": "Ridley Bikes",
    "Item Code": "RID747669",
    "activity": "Cycling",
    "gender": "men",
    "material": "Carbon",
    "usage bikesport": "Road Bike, Endurance",
    "hubs": "Forza 3 Beaufort db",
    "spokes": "Sapim Race",
    "rims": "AL | 20-622",
    "chain": "SRAM Rival",
    "cassette": "SRAM XG-1250",
    "shifter": "SRAM RIVAL ETAP AXS HDB",
    "rear derailleur": "SRAM Rival ETAP AXS",
    "front derailleur": "SRAM Rival ETAP AXS",
    "bottom bracket": "SRAM BB DUB",
    "chainring ratio": "48-35",
    "crankset": "SRAM FC RIVAL DUB",
    "brakes": "SRAM Rival eTAP AXS",
    "wheels": "Forza Norte",
    "seat post model": "4ZA Cir 7DE SP | 27.2x350mm",
    "saddle": "Selle San Marco Shortfit Open-fit 2.0",
    "bar tape": "4ZA Cirrus E.2",
    "handle bar": "Deda Zero2 RHM | 42cm",
    "stem": "Deda Super Box | 110mm",
    "fork": "Fenix | Carbon",
    "headset": "Deda HSE",
    "frame": "Fenix | Carbon",
    "Shifting System (Manufacturer)": "SRAM",
    "gear ratio": "10-36",
    "Shifting Type": "Chain - Electronical",
    "brake type": "Disc Brake",
    "wheel size": "28\" (622mm)",
    "seatpost": "Seatpost rigid",
    "Rear Triangle": "Unsuspended",
    "tires": "Vittoria Inner Tube Lite",
    "brake actuation": "Hydraulic",
    "Model year": "2024",
    "Color": "Black, Green",
    "fork construction": "Rigid Fork",
    "cable routing": "internal",
    "Product Series": "Ridley - Fenix",
    "Number of Gears": "2 x 12",
    "Frame Shape": "Diamond",
    "GTINs": "5400928741330, 5400928741347",
    "Manufacturer page": "https://www.ridley-bikes.com",
    "availability_details": [
      {
        "variant_id": "979165:opt_688192=3620653",
        "size_label": "Frame XL",
        "stock_count": 8,
        "stock_status": "",
        "delivery_time": "",
        "is_shippable": false
      }
    ]
  }

---

🏁 Summary

Ideal for:

• Price monitoring
• Stock tracking
• Variant availability analysis
• Product catalog building
• E-commerce intelligence workflows

---

Built for reliability, scalability, and clean structured data extraction.