Lookfantastic.com Product Scraper: Extract Beauty Search Results at Scale

---

What Is Lookfantastic.com?

Lookfantastic.com is one of Europe's largest online beauty retailers, offering thousands of products across skincare, makeup, haircare, and wellness categories. Its extensive catalog and frequent promotional activity make it a valuable source of competitive intelligence for brands, retailers, and analysts.

Manually tracking product listings, prices, and promotional data across hundreds of category pages is impractical. The Lookfantastic.com Product Search Scraper automates this entirely — extracting structured product data from any search or category URL in minutes.

---

Overview

The Lookfantastic Product Scraper collects product data directly from category and search result pages on Lookfantastic.com. It is built for:

• E-commerce analysts monitoring pricing and discount trends
• Brand managers auditing how their products appear in listings
• Retailers benchmarking competitor assortment and promotions
• Data scientists building beauty market datasets
• Developers feeding product data into aggregators or recommendation engines

The scraper supports bulk URL input, configurable item limits, and graceful error handling — making it suitable for both one-off exports and recurring data pipelines.

---

Input Format

The scraper accepts a simple JSON configuration:

{
  "urls": [
    "https://www.lookfantastic.com/c/health-beauty/make-up/view-all-make-up/?pageNumber=1"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Field Descriptions

Field	Type	Default	Description
urls	array	—	One or more Lookfantastic category or search result page URLs. Supports single entry or bulk list.
ignore_url_failures	boolean	true	When enabled, the scraper continues running if individual URLs fail, rather than stopping the entire run. Recommended for bulk jobs.
max_items_per_url	integer	20	Maximum number of products to collect per URL. Set higher (e.g., 200) to capture full category pages.

Tips for Building Good Input URLs

• Navigate to any category page (e.g., /c/health-beauty/make-up/) or search results page on Lookfantastic.com
• Use pagination parameters (?pageNumber=2, ?pageNumber=3) to scrape across multiple pages
• Avoid URLs that require login or session tokens to render products
• Affiliate tracking parameters (e.g., ?awc=...) in the URL do not affect scraper behavior and can be left in or removed

---

Output Format

Sample Output Record

{
  "item_id": 10785711,
  "item_name": "NARS Radiant Creamy Concealer",
  "item_list_id": "",
  "item_list_name": "Shop All Makeup",
  "url": "/p/nars-cosmetics-radiant-creamy-concealer-various-shades/10785711/",
  "brand": "NARS",
  "price": "29.5",
  "value": "28.0",
  "discount": "1.50",
  "index": 9,
  "variant": "Chantilly",
  "item_list": "Shop All Makeup",
  "promo": "Save 5% + Extra 5% off | Use Code: EXTRA",
  "total_variants": 27,
  "from_url": "https://www.lookfantastic.com/c/health-beauty/make-up/view-all-make-up/?awc=6712_1780290720_fa4c13a245d5b3af63b12e963e2ed76f&pageNumber=2"
}

Each scraped product returns a flat record with 14 fields covering identity, pricing, promotion, and variant data:

Product Identity

Field	Meaning
Item ID	Unique internal product identifier used by Lookfantastic (typically a numeric SKU)
Item Name	Full product name as displayed on the listing (e.g., Charlotte Tilbury Pillow Talk Lipstick)
URL	Direct link to the product detail page on Lookfantastic.com
Brand	Brand name associated with the product (e.g., The Ordinary, Fenty Beauty)
Variant	Specific variant shown in the listing (e.g., shade, size, or formula)
Total Variants	Total number of variants available for this product across the site

Pricing & Value

Field	Meaning
Price	Current selling price displayed to the user (may reflect sale or promotional pricing)
Value	Original or full retail value before any discount is applied
Discount	Discount amount or percentage applied to the product, if any

List & Category Context

Field	Meaning
Item List ID	Internal identifier for the product list or category page the item was found on
Item List Name	Human-readable name of the list or category (e.g., View All Make-Up)
Item List	Structured reference combining list ID and name for downstream data mapping
Index	Position of the product within the listing page (1-based), useful for ranking analysis

Promotional Data

Field	Meaning
Promo	Any active promotional label or campaign tag associated with the product (e.g., 3 for 2, 20% off)

Note: Field values above are illustrative examples only. Actual values depend on live site data at the time of scraping.

---

How to Use

1. Find your target URL — Browse Lookfantastic.com and navigate to the category or search results page you want to extract. Copy the full URL from your browser.
2. Paste into urls — Add one or multiple URLs to the urls array. Use the Bulk Edit option for large lists.
3. Set item limit — Adjust max_items_per_url based on how many products appear per page (typically 24–200).
4. Enable failure tolerance — Keep ignore_url_failures: true for multi-URL runs to avoid interruptions from isolated errors.
5. Run and export — Start the scraper and download results as JSON, CSV, or Excel when complete.

Common issues:

• If a URL returns fewer items than expected, verify the page loads product cards without requiring user interaction (e.g., no age gate or login wall)
• For paginated categories, create separate URL entries per page (e.g., ?pageNumber=1, ?pageNumber=2)
• Affiliate parameters in URLs (?awc=...) are harmless and do not need to be stripped

---

Use Cases & Business Value

• Price monitoring: Track how Lookfantastic prices and discounts evolve across categories over time
• Promotional intelligence: Identify which products are currently under promotion and what offer types are active
• Assortment analysis: Map a full category to understand brand distribution, variant depth, and listing position
• Ranking research: Use the Index field to analyze product placement and visibility within category pages
• Feed enrichment: Supplement internal product databases with live pricing and variant data from a major retailer

---

Conclusion

The Lookfantastic.com Product Search Scraper turns any category or search page into a clean, structured product dataset — with pricing, discounts, promotional tags, and variant details captured in a single run. Whether you are tracking competitors, auditing listings, or building a beauty market dataset, this scraper delivers reliable data without manual effort.