# John lewis Categories Product Scraper (`getdataforme/john-lewis-categories-product-scraper`) Actor The John Lewis Categories Product Scraper extracts product details from JohnLewis.com by brand, including names, prices, descriptions, and ratings. Perfect for e-commerce monitoring, market research, and price comparison. - **URL**: https://apify.com/getdataforme/john-lewis-categories-product-scraper.md - **Developed by:** [GetDataForMe](https://apify.com/getdataforme) (community) - **Categories:** AI, Automation, E-commerce - **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $9.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## John Lewis Categories Product Scraper The **John Lewis Categories Product Scraper** is an Apify Actor that extracts product details from JohnLewis.com based on brand queries. It retrieves product names, prices, descriptions, ratings, and more, ideal for e-commerce data analysis and market research. ### Input Parameters The Actor requires a JSON input with the following parameters: | Parameter | Type | Description | Required | Default | |-----------|--------|--------------------------------------------------|----------|---------| | Brands | Array | List of brand names to scrape (e.g., ["momcozy"]) | Yes | [] | Example input: ```json { "Brands": [ "momcozy" ] } ```` ### Features - **Brand-Based Scraping**: Fetches product details for specified brands on JohnLewis.com. - **Comprehensive Data Extraction**: Includes product names, prices, descriptions, ratings, and images. - **Structured JSON Output**: Delivers clean, organized data for easy integration. - **Reliable and Efficient**: Optimized for scalable scraping on the Apify platform. - **Real-Time Availability**: Captures stock status and pricing information. ### Output The Actor returns a JSON array of product details with the following fields: ```json [ { "product_name": "Momcozy F-Shaped Maternity Body Pillow", "current_price": "ยฃ54.99", "original_price": null, "product_price_currency": "GBP", "product_image": "https://media.johnlewiscontent.com/i/JohnLewis/112122076", "brand": "momcozy", "description": "The F-Shaped Maternity Body Pillow by Momcozy is a versatile and comfortable maternity pillow that provides support to your back, belly, legs, and neck all in one. The pillow is designed to provide full body support, making it the perfect choice for mothers-to-be who need extra comfort and cushioning during pregnancy. The pillow cover is made with premium long silk cotton, which provides the perfect balance between comfort and support for your full body. It is durable enough to keep its shape after weight is placed on it night after night. Key Features: Original F-shape Design Maternity Pillow - The perfect mix of J-shaped pillow and W-shaped wedge pillow hugs your entire body and conforms to both sides, from back to belly, for ultimate comfort. Providing support for your back, belly, hips, knees, and legs, gives you a restful night's sleep without tossing and turning. Perfect For Everyone - It helps with the discomfort associated with pregnancy, sciatica, fibromyalgia, gastric reflux, back pain, and more. This causes you to breathe easier, promotes better circulation, and aids in muscle relaxation. Flexible Belly Wedge Pillow - Featured with an adjustable belly wedge pillow, you can freely adjust the Velcro to fit your belly size. It can fit all pregnancy trimesters and all body types, always right support to the growing belly and relieving pressure. Works With Your Own Pillow - Unlike other full-body maternity pillows that include a headrest, the F-shaped maternity body pillow allows you to use this pillow with your own custom head pillow. These pregnancy pillows for sleeping eliminate the need to adjust to a new pillow, allowing you to enjoy a comfortable and restful sleep right away. Space Saving and Multi-purpose - Momcozy pregnancy pillow doesnโ€™t invade too much of your partnerโ€™s personal space, you can still snuggle with your partner. Also, you can use it to give your back and legs extra support while reading or watching TV. Even after you give birth, our pillow will support your baby during bottle-feeding. Warning: Do not place any part of this product in a crib, baby bed, bassinet, cradle, enclosure, or playpen as it could be a suffocation hazard. Do not place this product anywhere a baby may sleep.", "sku": null, "Product code": "31310204", "availability": "OutOfStock", "product_url": "https://www.johnlewis.com/momcozy-f-shaped-maternity-body-pillow/p112262204", "review_count": 20, "rating": 4.4 } ] ``` ### Use Cases - **E-commerce Monitoring**: Track product prices, availability, and ratings for specific brands. - **Market Research**: Analyze product offerings and customer feedback for competitive insights. - **Price Comparison**: Monitor pricing trends across John Lewis' catalog. - **Product Data Aggregation**: Build datasets for retail analytics or maternity product research. ### Support For bug reports or custom needs, contact us at **support@getdataforme.com** or use our contact form: .\ Please include a clear subject line in your message to help us assist you faster. # Actor input Schema ## `Brands` (type: `array`): The brands for the spider. ## `proxyConfiguration` (type: `object`): Specifies proxy servers that will be used by the scraper in order to hide its origin. ## Actor input object example ```json { "Brands": [ "momcozy" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("getdataforme/john-lewis-categories-product-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], } } # Run the Actor and wait for it to finish run = client.actor("getdataforme/john-lewis-categories-product-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call getdataforme/john-lewis-categories-product-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=getdataforme/john-lewis-categories-product-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "John lewis Categories Product Scraper", "description": "The John Lewis Categories Product Scraper extracts product details from JohnLewis.com by brand, including names, prices, descriptions, and ratings. Perfect for e-commerce monitoring, market research, and price comparison.", "version": "0.0", "x-build-id": "JXgVX4yJ0ZTH8rEbG" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/getdataforme~john-lewis-categories-product-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-getdataforme-john-lewis-categories-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/getdataforme~john-lewis-categories-product-scraper/runs": { "post": { "operationId": "runs-sync-getdataforme-john-lewis-categories-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/getdataforme~john-lewis-categories-product-scraper/run-sync": { "post": { "operationId": "run-sync-getdataforme-john-lewis-categories-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "Brands": { "title": "Brands", "type": "array", "description": "The brands for the spider.", "default": [ "momcozy" ], "items": { "type": "string" } }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Specifies proxy servers that will be used by the scraper in order to hide its origin.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```