Lyko.com Product Search Scraper: Extract Beauty Product Data at Scale

---

What Is Lyko.com?

Lyko.com is a major Scandinavian e-commerce platform specializing in beauty, hair care, skincare, and personal care products. It carries thousands of SKUs across hundreds of brands, making it a valuable source for product intelligence. The Lyko.com Product Search Scraper automates the extraction of product data directly from Lyko's search results pages, eliminating manual collection and enabling large-scale analysis.

---

Overview

This scraper targets Lyko.com search result URLs and collects structured product records for every item returned. It is built for:

• Retailers & brands monitoring pricing and product positioning
• Market researchers analyzing beauty category trends
• Data aggregators feeding product catalogs or comparison engines
• E-commerce analysts tracking sponsored placements and availability

Configurable item limits, pagination offset, and fault-tolerant URL handling make it suitable for both focused queries and large bulk runs.

---

Input Format

{
  "urls": [
    "https://lyko.com/sv/har?sortBy=popularity&count=1221&infinitescroll=1"
  ],
  "offset": 20,
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Field	Type	Description
urls	array	One or more Lyko.com search result URLs to scrape. Use the q= parameter to target specific keywords (e.g., lip, shampoo). Supports sortBy, count, and infinitescroll query parameters.
offset	integer	Number of items to skip before scraping begins. Useful for paginating across large result sets. Default: 0.
ignore_url_failures	boolean	If true, failed URLs are skipped and the run continues. Recommended true for bulk runs. Default: true.
max_items_per_url	integer	Maximum number of products to collect per URL. Default: 20. Set higher (e.g., 200) for comprehensive category coverage.

Tip: To collect a full category, construct the search URL increase max_items_per_url accordingly. Combine offset with multiple runs to paginate beyond Lyko's default page limits.

---

Output Format

Sample output

{
  "ticket": "eyJpaSI6InAtMzk4MC0xMjZQIiwidmkiOiIzOTgwLTEyNi0wMDAxIiwidGUiOiJsaXAiLCJycCI6MjEsInJpIjoiYmVlYzkxZTMtYjg1ZC00Mzc3LWE3ZjEtMDVkYjVjNmM2ZDQwIiwicCI6MzUuMCwidCI6IlNlYXJjaCJ9",
  "url": "/sv/gleeze/gleeze-twisted-lip-mask-paradise-pop",
  "should_cache": true,
  "meta": {
    "title": null,
    "elements": {}
  },
  "code": "3980-126-0001",
  "display_name": "Gleeze Twisted Lip Mask Paradise Pop",
  "entry_name": "Twisted Lip Mask",
  "color": "Paradise Pop",
  "price": {
    "current": 35.0,
    "comparison_prices": [],
    "currency": "SEK",
    "use_discount_styling": false,
    "discount_percent": null,
    "is_member_price": false,
    "is_combo_deal_price": false,
    "campaign_price_valid_until": null,
    "member_price": null,
    "member_price_valid_until": null,
    "cannot_be_combined_with_coupons": false,
    "vat_rate": 25.0,
    "unit_price": null
  },
  "images": [
    {
      "height": 2000,
      "width": 1621,
      "retouch_settings": null,
      "alt_text": "En tub märkt Gleezed Twisted Lip Mask bredvid en rosa hjärtformad kladd av läppmask.",
      "should_be_expanded": false,
      "url": "/globalassets/product-images/gleeze-twisted-lip-mask-paradise-pop-3980-126-0001_1.jpg?ref=437A377549"
    },
    {
      "height": 2000,
      "width": 2000,
      "retouch_settings": null,
      "alt_text": "En kvinna med hårklämmor, håller ett litet rör nära ansiktet, mot en färgstark abstrakt bakgrund.",
      "should_be_expanded": false,
      "url": "/globalassets/product-images/gleeze-twisted-lip-mask-paradise-pop-3980-126-0001_2.jpg?ref=BCDD01F991"
    },
    {
      "height": 2000,
      "width": 2000,
      "retouch_settings": null,
      "alt_text": "Två unga kvinnor med ljusa smink och hårspännen njuter av färgglada läppglans i en lekfull, pastellfärgad bakgrund.",
      "should_be_expanded": false,
      "url": "/globalassets/product-images/gleeze-twisted-lip-mask-paradise-pop-3980-126-0001_3.jpg?ref=C7AC89C44B"
    },
    {
      "height": 2000,
      "width": 2000,
      "retouch_settings": null,
      "alt_text": "Två tuber av läppglans märkta gleam med rosa och röda virvlar flyter bland färgglada sfärer.",
      "should_be_expanded": false,
      "url": "/globalassets/product-images/gleeze-twisted-lip-mask-paradise-pop-3980-126-0001_4.jpg?ref=C735C2DC51"
    }
  ],
  "brand_name": "Gleeze",
  "product_name": "Gleeze Twisted Lip Mask Paradise Pop",
  "product_serie": null,
  "product_collection": null,
  "size": 15.0,
  "unit": "ml",
  "deepest_category_url": "/sv/smink/lappar/lappglans",
  "badge_icon_image_url": null,
  "variation_type": "color",
  "variation_description": "Paradise Pop",
  "variant_selector_text_override": "",
  "is_sponsored": false,
  "rating": 4.9,
  "total_ratings": 8,
  "is_new": false,
  "circle_colors": [],
  "color_image_url": null,
  "delivery_information": "Fri frakt vid köp från 300 kr, kan skickas omgående",
  "is_digital": false,
  "is_charity": false,
  "allow_gift_wrap": true,
  "is_social_allowed": true,
  "fragrance_data": null,
  "is_ad": false,
  "lyko_tracking_data": null,
  "product_responsible_data": {
    "name": "Lyko Group AB ",
    "address": "Äppelbovägen 60",
    "postal_code": "786 91 Vansbro",
    "country": "Sverige",
    "contact": "https://lyko.com"
  },
  "hazard_codes": [],
  "warning_text": "",
  "offer_plate": null,
  "prescription_free_product": false,
  "nicotine_product": false,
  "online_status": {
    "interaction_type": "buy",
    "is_gwp_gift": false,
    "text": null,
    "text_styling": null,
    "next": null,
    "show_as_immediately_shippable": false,
    "show_as_slow_shippable": false
  },
  "modiface": null,
  "external_product_url": "",
  "cache": null,
  "component_name": "Avensia.Common.Features.Product.Commerce.ViewModels.VariantViewModel",
  "from_url": "https://lyko.com/sv/sok?q=lip&sortBy=popularity&count=220&infinitescroll=1&newSearch=0&skip=20"
}

Each product record contains up to 45 fields:

Core Identification

Field	Meaning
Ticket	Internal scraper ticket ID for the request
URL	Direct URL to the product page
Code	Lyko's internal product/SKU code
Entry Name	Raw system-level product entry name
Display Name	Human-readable product name shown on the listing
Slug (via URL)	URL-friendly product identifier
Component Name	UI component used to render the product card
Cache	Cached data snapshot reference
Should Cache	Whether the response is eligible for caching

Product Details

Field	Meaning
Product Name	Full product name
Brand Name	Brand (e.g., L'Oréal, Redken, Fenty Beauty)
Product Serie	Product line or series within a brand
Product Collection	Collection grouping (e.g., seasonal or themed sets)
Size	Product size or quantity (e.g., 50ml)
Unit	Unit of measurement (e.g., ml, g, pcs)
Color	Primary color name or code
Circle Colors	Array of swatch colors for color variant display
Color Image URL	URL of the color swatch image
Images	Array of product image URLs

Pricing & Offers

Field	Meaning
Price	Current price object (may include regular, sale, and member prices)
Offer Plate	Promotional offer badge data (e.g., "3 for 2", bundle deals)

Variants & Display

Field	Meaning
Variation Type	Type of variation (e.g., color, size, shade)
Variation Description	Descriptive label for the variant
Variant Selector Text Override	Custom label overriding default selector text

Ratings & Social

Field	Meaning
Rating	Average customer rating score
Total Ratings	Total number of ratings/reviews
Is Social Allowed	Whether social sharing features are enabled

Categorization & Navigation

Field	Meaning
Deepest Category URL	URL of the most specific category the product belongs to
Meta	SEO and metadata associated with the product

Status & Availability

Field	Meaning
Online Status	Whether the product is currently available online
Is New	Flags newly added products
Is Sponsored	Whether the listing is a paid/sponsored placement
Is Ad	Indicates advertisement status
Is Digital	Digital product flag (e.g., gift cards)
Is Charity	Flags charity-linked products
Badge Icon Image URL	URL of any promotional badge shown on the listing
Delivery Information	Shipping/delivery details associated with the product

Compliance & Safety

Field	Meaning
Hazard Codes	GHS/CLP hazard classification codes for regulated products
Warning Text	Safety warnings required for certain product types
Prescription Free Product	Flags over-the-counter pharmacy items
Nicotine Product	Flags nicotine-containing products
Fragrance Data	Fragrance ingredient or allergen data
Product Responsible Data	Responsible person/entity data (EU regulatory requirement)

Tracking & External

Field	Meaning
Lyko Tracking Data	Platform-specific analytics tracking payload
External Product URL	Link to product on an external retailer or brand site
Allow Gift Wrap	Whether gift wrapping is available for the product
Modiface	ModiFace AR try-on integration data (where available)

---

How to Use

1. Build your search URL — Go to Lyko.com, search for your keyword, and copy the URL. Append &infinitescroll=1 for broader results.
2. Set item limit — Use max_items_per_url to control how many products to collect (up to 200 recommended per run).
3. Use offset for pagination — For large queries, run sequentially with increasing offset values (e.g., 0, 200, 400).
4. Run and export — Start the scraper and download results as JSON or CSV.

Common issues:

• Ensure URLs include infinitescroll=1 — standard paginated URLs may not load all items.
• If results are unexpectedly low, check that your search URL is returning products when opened in a browser.

---

Use Cases & Business Value

• Price intelligence: Track price changes across beauty SKUs over time
• Assortment analysis: Understand which brands and product types dominate specific search queries
• Competitive benchmarking: Compare sponsored vs. organic product placement
• Compliance auditing: Collect hazard codes and warning text for regulatory datasets
• Catalog enrichment: Supplement internal product databases with images, ratings, and variant data

---

Conclusion

The Lyko.com Product Search Scraper provides deep, structured access to one of Scandinavia's largest beauty retail catalogs. With 45+ fields per product and flexible pagination controls, it is a practical tool for anyone requiring reliable beauty product data at scale. Configure your search query, set your limits, and start extracting.