John Lewis Products Details Crawler/Scraper

Extract complete product details from any John Lewis listing or brand page — prices, specs, images, descriptions, size variants, and shipping cost estimates — delivered as JSON or CSV, ready to connect to Google Sheets or Make.

---

Who Is This For?

• Retailers & resellers who need full product data to build listings on other platforms
• Price monitoring tools tracking current and previous prices across John Lewis ranges
• E-commerce teams building product feeds with specs, images, and category data
• Dropshippers who need weight-based shipping cost estimates alongside product prices

No coding required. Paste your listing URLs, add your Apify token, and get a complete dataset back.

---

How It Works — Why Two Scrapers?

John Lewis listing pages load their product grids dynamically using JavaScript, which means a standard scraper cannot see the products without rendering the page in a real browser. To handle this efficiently, this Actor is split into two steps:

Step 1 — John Lewis Listings Crawler (Playwright)
  ↓  Renders listing pages in a real browser
  ↓  Collects every product and colour variant URL

Step 2 — John Lewis Products Details Crawler (CheerioCrawler) ← you are here
  ↓  Receives the variant URLs from Step 1
  ↓  Extracts full product details from each page at high speed
  ↓  Saves structured results to dataset

You only need to configure this Actor. It automatically calls the John Lewis Listings Crawler internally using your Apify token and Actor ID, collects all variant URLs, then scrapes each product detail page for you — all in a single run.

This split design means the detail extraction step uses the lightweight and fast CheerioCrawler (no browser overhead) while the dynamic listing discovery is handled correctly by Playwright where it's actually needed.

---

Input

{
  "actorID": "your-listings-actor-id",
  "apifyToken": "your-apify-token",
  "listingsUrls": [
    { "url": "https://www.johnlewis.com/brand/flexlux/_/N-pze9" }
  ],
  "lastPageNum": 5,
  "maxRequestsPerCrawl": 100,
  "pricePerKG": 9,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Field	Type	Required	Description
actorID	String	✅	The Apify Actor ID of the John Lewis Listings Crawler
apifyToken	String	✅	Your Apify API token — used to call the Listings Crawler internally
listingsUrls	Array	✅	One or more John Lewis category, brand, or search page URLs
lastPageNum	Number	✅	How many listing pages to crawl per URL
maxRequestsPerCrawl	Number	❌	Cap on total product detail pages to scrape
pricePerKG	Number	❌	Your shipping rate in £ per kg — used to calculate weightPrice and finalPrice
proxyConfiguration	Object	✅	Proxy settings — Apify Residential proxy strongly recommended

Tip: You can add multiple brand or category URLs to listingsUrls to pull data from several ranges in one run.

---

Output

Each row in the dataset is one fully detailed product variant:

{
  "type": "product",
  "brand": "Apple",
  "color": "Midnight",
  "size": null,
  "name": "2026 Apple MacBook Air 13.6\", M5 Processor, 16GB RAM, 512GB SSD",
  "stockStatus": "In Stock",
  "previousPrice": null,
  "currentPrice": "£999.00",
  "promotions": null,
  "reviewsCount": "2 Reviews",
  "reviewsStars": "5.00 out of 5",
  "breadcrumbs": ["Homepage", "Electricals", "Laptops & MacBooks"],
  "categoryPath": "Homepage > Electricals > Laptops & MacBooks",
  "mainCategory": "Electricals",
  "subCategory": "Laptops & MacBooks",
  "images": [
    { "mediaContentType": "IMAGE", "originalSource": "https://media.johnlewiscontent.com/..." }
  ],
  "mainImage": "https://media.johnlewiscontent.com/...",
  "url": "https://www.johnlewis.com/.../midnight/p115096196",
  "productId": "115096196",
  "productCode": "86014610",
  "description": "MacBook Air with the M5 chip...",
  "descriptionHtml": "<p>MacBook Air with the M5 chip...</p>",
  "specifications": {
    "processor_type": "Apple M5",
    "memory_ram": "16GB",
    "screen_size_measured_diagonally": "13.60\"",
    "weight": "1.23 kg",
    "operating_system": "macOS",
    "guarantee": "2 year guarantee included"
  },
  "weight": { "unit": "kg", "value": 1.23 },
  "weightPrice": "£11.07",
  "finalPrice": 1010.07,
  "scrapedAt": "2026-04-11T16:47:23.363Z"
}

Full list of extracted fields

Field	Description
name	Full product title
brand	Brand name
color	Colour variant
size	Size variant (if applicable)
currentPrice	Current selling price
previousPrice	Original price if on sale
promotions	Any active promotions
stockStatus	In Stock / Out of Stock
reviewsCount	Number of customer reviews
reviewsStars	Average star rating
breadcrumbs	Full category path as an array
categoryPath	Category path as a readable string
mainCategory	Top-level category
subCategory	Sub-category
images	All product images and video thumbnails
mainImage	Primary product image URL
description	Full description as plain text
descriptionHtml	Full description as HTML
specifications	All product specs as a key/value map
productId	John Lewis product ID
productCode	John Lewis product code
weight	Product weight with unit
weightPrice	Shipping cost estimate (weight × pricePerKG)
finalPrice	currentPrice + weightPrice combined
url	Full product variant URL
scrapedAt	Timestamp of when the record was scraped

Results can be downloaded as JSON or CSV from the Apify dataset viewer.

---

Integrations

• Google Sheets — send results automatically to a spreadsheet using the Apify Google Sheets integration
• Make (Integromat) — trigger workflows the moment a run completes to push data to any tool in your stack
• Zapier — connect to thousands of apps via the Apify Zapier integration
• Direct download — export as JSON or CSV from the Apify console at any time

---

Notes

• Residential proxies are strongly recommended — John Lewis actively blocks datacenter IPs
• weightPrice and finalPrice are only calculated when pricePerKG is provided and the product page includes weight data
• This Actor requires the John Lewis Listings Crawler to be published and accessible in your Apify account
• Product specification field names reflect John Lewis's own attribute keys and may vary across categories