Johnlewis Products Details Crawler

Extract structured product data from johnlewis.com at scale. Prices, stock, ratings, images, specs, breadcrumbs — 25+ fields per product, ready for JSON / CSV / Excel. No code required.

Built and maintained by alkausari_mujahid.

---

✦ Highlights

• ⚡ Fast at scale — concurrent crawling, ~60 products/min
• 📊 Any format — JSON, CSV, Excel, XML, or live via the Apify API
• 💰 Predictable cost — pay per result, not per try
• 🖱 Zero code — paste a URL, click Start
• 🛡 Anti-blocking built-in — residential proxies, rotation, smart retries
• ✓ Complete data — 25+ fields per product, nothing left behind

---

⚙ How it works

1. Paste a URL — single product, category page, or search results.
2. Click Start — the actor handles proxies, retries, and parsing for you.
3. Download or pipe — JSON, CSV, or Excel out of the box, or pull straight from the API.

// Example input
{
    "startUrls": [
        { "url":"https://www.johnlewis.com/browse/men/mens-shoes/_/N-7onz"}
    ],
    "lastPageNum": 1,
    "maxRequestsPerCrawl": 100,
    "proxyConfiguration": { "useApifyProxy": false, "apifyProxyGroups": ["RESIDENTIAL"] }
}

---

For category, brand, or search URLs, this Actor automatically calls the companion John Lewis Products Listings Crawler to collect all product URLs first, then scrapes each. Direct product URLs are scraped immediately — no companion needed.

[IMPORTANT] Billing: when both stages run, each is billed as a separate Actor run in your Apify Console. The listings stage runs first; this Actor shows zero compute until it begins processing detail pages.

📦 What you get back

Every product returns a single structured record: You can group variants by product id like p113951807

{
  "type": "product",
  "name": "Kickers Kick Hi Leather Boots",
  "brand": "Kickers",
  "colour": "Black",
  "size": "5",
  "stockStatus": "In Stock",
  "currentPrice": "£110.00",
  "previousPrice": null,
  "weightPrice": "£3.15",
  "finalPrice": 113.15,
  "promotions": ["Buy one, get one 50% off"],
  "reviewsCount": "124 Reviews",
  "reviewsStars": "4.5 out of 5 stars",
  "mainImage": "https://johnlewis.scene7.com/is/image/JohnLewis/...",
  "images": [
    { "mediaContentType": "IMAGE", "originalSource": "https://..." }
  ],
  "breadcrumbs": ["Home", "Women", "Shoes & Boots", "Ankle Boots"],
  "categoryPath": "Home > Women > Shoes & Boots > Ankle Boots",
  "mainCategory": "Women",
  "subCategory": "Shoes & Boots",
  "productId": "238795771",
  "productCode": "86064111",
  "specifications": {
    "material": "Leather upper",
    "sole": "Rubber",
    "weight": "350g"
  },
  "weight": { "unit": "kg", "value": 0.35 },
  "url": "https://www.johnlewis.com/kickers-kick-hi-leather-boots/p238795771",
  "scrapedAt": "2026-05-08T10:23:45.000Z"
}

Fields captured

Identity	Pricing	Availability	Media	Taxonomy	Reviews	Specs
name	currentPrice	stockStatus	mainImage	breadcrumbs[]	reviewsCount	specifications
brand	previousPrice	size	images[]	categoryPath	reviewsStars	weight
colour	weightPrice	promotions[]		mainCategory		productId
	finalPrice			subCategory		productCode

Plus url and scrapedAt on every record.

---

💡 Use cases

• Price monitoring — track price changes for specific products or whole categories over time. Spot drops and promos early.
• Stock alerts — check which sizes and colours are in or out of stock across a range. Drive restock workflows.
• Competitor research — benchmark John Lewis pricing and range to inform your own merchandising.
• Inventory analysis — export specs, weights, and categories to build a structured product catalogue.
• Data & BI pipelines — pipe straight into Google Sheets, BigQuery, Snowflake, or your own tools via the Apify API and webhooks.

---

🚀 Get started

From the Apify Console

1. Open the actor on Apify.
2. Paste one or more John Lewis URLs into Start URLs.
3. (Optional) Set maxRequestsPerCrawl, enable Apify Proxy.
4. Click Start — results appear in the Dataset tab as they arrive.

From the Apify API

curl -X POST https://api.apify.com/v2/acts/alkausari_mujahid~johnlewis-products-details-crawler/runs?token=YOUR_TOKEN \
  -H "Content-Type: application/json" \
  -d '{
    "startUrls": [{ "url": "https://www.johnlewis.com/browse/women/womens-shoes-boots/_/N-ebjt" }],
    "maxRequestsPerCrawl": 1000
  }'

Schedule it

Use Apify Schedules to run daily/hourly and push results to your warehouse, Google Sheets, shopify or webhook of choice.

---

📮 Support

Bugs, feature requests, custom scraping work — open an issue on Apify or reach out:

• Maintainer: Alkausari M
• Actor: alkausari_mujahid/johnlewis-products-details-crawler
• Need a different retailer scraped? Alkausari builds custom Apify actors on request.

---