# Waitrose Product Search Scraper (`stealth_mode/waitrose-product-search-scraper`) Actor Scrape Waitrose grocery products instantly with 32+ fields per item—names, prices, promotions, reviews, images, and availability. Perfect for price monitoring, competitive analysis, and e-commerce research. - **URL**: https://apify.com/stealth\_mode/waitrose-product-search-scraper.md - **Developed by:** [Stealth mode](https://apify.com/stealth_mode) (community) - **Categories:** Automation, Developer tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Waitrose Product Search Scraper: Extract Grocery Data & Pricing --- ### What Is Waitrose? Waitrose is a premium British supermarket chain offering an extensive online grocery platform at waitrose.com. With thousands of products across fresh produce, bakery, dairy, and specialty items, Waitrose pricing and inventory data is valuable for price comparison, market analysis, and retail intelligence. Manually collecting product information from search results is tedious—the **Waitrose Product Search Scraper** automates this, delivering structured product data in seconds. --- ### Overview The **Waitrose Product Search Scraper** extracts product listings from Waitrose category and search pages, returning comprehensive product records with pricing, promotions, images, and metadata. It is ideal for: - **Price comparison platforms** monitoring UK grocery pricing - **Retail analysts** tracking competitor product assortment - **Researchers** studying food retail trends and HFSS (High Fat, Salt, Sugar) labeling - **E-commerce developers** building product aggregators - **Marketing teams** analyzing promotional strategies Key strengths include configurable item limits per URL, automatic error recovery, and rich output spanning 32+ product attributes. --- ### Input Format The scraper accepts a JSON configuration object: ```json { "urls": [ "https://www.waitrose.com/ecom/shop/browse/groceries/bakery" ], "ignore_url_failures": true, "max_items_per_url": 200 } ```` | Field | Description | Example | |---|---|---| | `urls` | Array of Waitrose product search or category page URLs | `["https://www.waitrose.com/ecom/shop/browse/groceries/bakery"]` | | `max_items_per_url` | Maximum products to extract per URL (1-200) | `200` | | `ignore_url_failures` | If `true`, scraper continues if a URL fails; if `false`, stops on error | `true` or `false` | **Tips:** - Use full category URLs (e.g., `/groceries/bakery`, `/groceries/dairy`) - Use search result URLs for keyword-based scraping (e.g., `/search?query=gluten-free`) - Max 200 items per URL prevents excessive runtime; paginated results require separate URL entries *** ### Output Format **Sample ouput** ```json { "result_type": "GENERAL", "id": "900132-1-2", "line_number": "900132", "product_type": "W", "name": "Wildfarmed Sourdough", "size": "640g", "thumbnail": "https://ecom-su-static-prod.wtrecom.com/images/products/9/LN_900132_BP_9.jpg", "reviews": { "average_rating": 5, "review_count": 2 }, "current_sale_unit_price": { "quantity": { "amount": 1, "uom": "C62" }, "price": { "amount": 2.5, "currency_code": "GBP" } }, "default_quantity": { "amount": 1, "uom": "C62" }, "promotions": [ { "promotion_unit_price": { "amount": 2.25, "currency_code": "GBP" }, "promotion_description": "Introductory Offer", "promotion_type_code": "INT", "promotion_expiry_date": "2026-07-21", "promotion_id": 540719, "promotional_price_per_unit": "(£3.52 per kg)", "pyo_promotion": false, "my_waitrose_promotion": false, "groups": [ { "threshold": 1, "name": "X" } ] } ], "persist_default": true, "display_price": "£2.25", "display_price_estimated": false, "display_price_qualifier": "£3.52/kg", "lead_time": 0, "max_personalised_message_length": 0, "product_image_urls": { "small": "https://ecom-su-static-prod.wtrecom.com/images/products/9/LN_900132_BP_9.jpg", "medium": "https://ecom-su-static-prod.wtrecom.com/images/products/3/LN_900132_BP_3.jpg", "large": "https://ecom-su-static-prod.wtrecom.com/images/products/11/LN_900132_BP_11.jpg", "extra_large": "https://ecom-su-static-prod.wtrecom.com/images/products/4/LN_900132_BP_4.jpg" }, "weights": { "uoms": [ "C62" ], "price_per_uom_qualifier": "£3.52/kg", "per_uom_qualifier": "(per kg)" }, "restriction": { "available_dates": [] }, "substitutions_prohibited": false, "ad_tech_sponsored_position": 1, "marked_for_delete": false, "minimum_life_to_customer": 0, "brand": "Wildfarmed", "sponsorship_id": "display_LwwZfZmG_mfMcQOe72cgobCIFoMKCAoGOTAwMTMyEgAaCwiQmcjSBhDKvf4rIgIIAQ==", "categories": [ { "id": "10051", "name": "Groceries" }, { "id": "300119", "name": "Bakery" }, { "id": "300121", "name": "Bread" }, { "id": "300164", "name": "Sourdough Bread" } ], "hfss": { "scope_category": { "code": 14 }, "status": false }, "sponsored": true, "marketing_badges": [ { "name": "New" } ], "promotion": null, "from_url": "https://www.waitrose.com/ecom/shop/browse/groceries/bakery" } ``` Each product record contains 32 fields capturing identity, pricing, availability, and marketing data: #### Product Identification | Field | Meaning | Example | |---|---|---| | `ID` | Unique Waitrose product identifier | `12345678` | | `Name` | Full product name as displayed | `Organic Free-Range Eggs, 6 Pack` | | `Product Type` | Item category classification | `Grocery`, `Fresh`, `Bakery` | | `Brand` | Manufacturer or own-label brand | `Waitrose Essentials`, `Tesco` | | `Line Number` | Sequential position in results | `1`, `2`, `3` | | `Result Type` | Classification of search result | `Product`, `Promotion`, `Sponsored` | #### Pricing & Availability | Field | Meaning | Example | |---|---|---| | `Current Sale Unit Price` | Active price per unit (in £) | `1.50`, `3.99` | | `Display Price` | Formatted price shown to customers | `£1.50`, `2 for £5.00` | | `Display Price Estimated` | Boolean: price is estimated or variable | `true`, `false` | | `Display Price Qualifier` | Additional pricing context | `per 100g`, `per unit`, `each` | | `Default Quantity` | Quantity included in standard purchase | `1`, `6`, `500g` | | `Lead Time` | Delivery or availability window | `Next day delivery`, `In stock` | #### Product Details | Field | Meaning | Example | |---|---|---| | `Size` | Package or portion size | `500g`, `6 Pack`, `1L` | | `Weights` | Nutritional or product weight data | `{"net": "500g", "drained": "350g"}` | | `Categories` | Product classification hierarchy | `["Groceries", "Bakery", "Bread"]` | | `HFSS` | High Fat, Salt, Sugar flag (UK health labeling) | `true`, `false` | | `Restriction` | Age or dietary restrictions | `Age 18+`, `Allergen warning` | | `Substitutions Prohibited` | Whether item cannot be replaced | `true`, `false` | | `Minimum Life To Customer` | Shelf life remaining at delivery | `5 days`, `7 days` | #### Media & Reviews | Field | Meaning | Example | |---|---|---| | `Thumbnail` | Small product image URL | `https://...waitrose.com/.../thumb.jpg` | | `Product Image URLs` | Array of all available product images | `["url1", "url2", "url3"]` | | `Reviews` | Customer rating and review count | `{"rating": 4.5, "count": 127}` | #### Promotions & Marketing | Field | Meaning | Example | |---|---|---| | `Promotions` | Active price reductions or offers | `[{"type": "Money Off", "value": "50p"}]` | | `Promotion` | Promotional banner or label | `"3 for 2 on selected items"` | | `Marketing Badges` | Visual badges (e.g., "Organic", "Vegan") | `["Organic", "Fairtrade"]` | | `Sponsored` | Boolean: product paid placement | `true`, `false` | | `Sponsorship ID` | ID of sponsoring brand (if sponsored) | `98765432` | | `Ad Tech Sponsored Position` | Whether item occupies ad placement | `true`, `false` | #### System & Admin | Field | Meaning | Example | |---|---|---| | `Persist Default` | Stores customer's preferred quantity | `true`, `false` | | `Marked For Delete` | Internal flag for item discontinuation | `true`, `false` | | `Max Personalised Message Length` | Character limit for notes | `500` | *** ### How to Use 1. **Identify URLs** — Navigate Waitrose.com and browse to product category (e.g., Bakery, Dairy) or search results. Copy the full URL. 2. **Configure settings** — Paste URLs into the `urls` array. Set `max_items_per_url` (default 20, max 200). 3. **Run the scraper** — Initiate the actor. It will fetch product pages and extract items. 4. **Handle failures** — If `ignore_url_failures: true`, scraper skips failed URLs; if `false`, execution halts. 5. **Export data** — Download results as JSON, CSV, or Excel. **Best practices:** - Start with smaller `max_items_per_url` (50-100) to test, then scale up. - For multi-page categories, add each page URL separately to the `urls` array. - Use pagination URL parameters if Waitrose supports them (e.g., `?page=2`). **Common scenarios:** - **Price monitoring:** Schedule weekly runs on competitor categories to track price changes. - **Promotion analysis:** Scrape the same category monthly to detect promotional cycles. - **Product assortment:** Compare product availability across regions using regional Waitrose URLs. *** ### Use Cases & Business Value - **Retail competitive intelligence:** Monitor Waitrose pricing vs. Tesco, Sainsbury's, Asda - **Price comparison websites:** Automate Waitrose data feeds for UK grocery aggregators - **Supply chain analytics:** Track product availability and stock levels over time - **Market research:** Analyze HFSS labeling, promotional frequency, and organic product adoption - **Procurement:** Extract supplier/brand data for B2B food sourcing The Waitrose Product Search Scraper transforms unstructured web content into machine-readable product records, enabling rapid market analysis, competitive benchmarking, and integration into retail analytics platforms. *** ### Conclusion The **Waitrose Product Search Scraper** is a powerful tool for anyone needing accurate, up-to-date UK grocery product data. With 32+ output fields covering pricing, promotions, imagery, and metadata, it cuts manual data collection time from hours to minutes. Whether you're running a price comparison platform, conducting retail research, or building a competitor intelligence dashboard, this scraper delivers reliable, actionable product intelligence. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## Actor input object example ```json { "urls": [ "https://www.waitrose.com/ecom/shop/browse/groceries/bakery" ], "ignore_url_failures": true, "max_items_per_url": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.waitrose.com/ecom/shop/browse/groceries/bakery" ], "ignore_url_failures": true, "max_items_per_url": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("stealth_mode/waitrose-product-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.waitrose.com/ecom/shop/browse/groceries/bakery"], "ignore_url_failures": True, "max_items_per_url": 20, } # Run the Actor and wait for it to finish run = client.actor("stealth_mode/waitrose-product-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.waitrose.com/ecom/shop/browse/groceries/bakery" ], "ignore_url_failures": true, "max_items_per_url": 20 }' | apify call stealth_mode/waitrose-product-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=stealth_mode/waitrose-product-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Waitrose Product Search Scraper", "description": "Scrape Waitrose grocery products instantly with 32+ fields per item—names, prices, promotions, reviews, images, and availability. Perfect for price monitoring, competitive analysis, and e-commerce research.", "version": "0.0", "x-build-id": "iBPXexbai6CAuHitR" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/stealth_mode~waitrose-product-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-stealth_mode-waitrose-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/stealth_mode~waitrose-product-search-scraper/runs": { "post": { "operationId": "runs-sync-stealth_mode-waitrose-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/stealth_mode~waitrose-product-search-scraper/run-sync": { "post": { "operationId": "run-sync-stealth_mode-waitrose-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the product search list urls to scrape", "type": "array", "description": "Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```