# Screwfix UK Product & Store Scraper (Unofficial) (`dromb/screwfix-uk-wave3`) Actor Scrape Screwfix UK products, categories, filters, and stores with normalized output for price monitoring, product research, and retail workflows. - **URL**: https://apify.com/dromb/screwfix-uk-wave3.md - **Developed by:** [Dmitriy Gyrbu](https://apify.com/dromb) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Screwfix UK Product & Store Scraper (Unofficial) Scrape Screwfix UK products, categories, filters, and stores with normalized output for price monitoring, product research, market research, availability, offers, and retail workflows. This is an unofficial actor and is not affiliated with Screwfix. ### Proxy behavior This actor uses the shared Apify proxy contract used across the workspace. `screwfix_uk` is expected to work in direct mode first, with proxy fallback if the site starts blocking cloud runs. ### Supported operations - `probe` - `categories` - `stores` - `store` - `search_filters` - `search` - `category` - `item` ### Operation guide The Apify Console form shows the union of all supported fields, so the visible inputs do not change when you switch `operation`. Use the guide below to know which fields are required. - `probe` Required: none Optional: `includeRaw` - `categories` Required: none Optional: `includeRaw` - `stores` Required: none Optional: `storeQuery`, `page`, `limit`, `includeRaw` - `store` Required: `storeCode` or `storeSlug` or `storeUrl` Optional: `includeRaw` - `search_filters` Required: none Optional: `query`, `categoryId`, `categorySlug`, `categoryUrl`, `includeRaw` - `search` Required: `query` Optional: `page`, `limit`, `sort`, `includeRaw` - `category` Required: `categoryId` or `categorySlug` or `categoryUrl` Optional: `page`, `limit`, `sort`, `includeRaw` - `item` Required: `productId` or `productSlug` or `productUrl` Optional: `includeRaw` ### Example inputs These starter examples were validated locally against the live site. ```json { "operation": "categories", "includeRaw": false } ```` ```json { "operation": "search", "query": "spanner", "page": 1, "limit": 24, "sort": "relevance_desc", "includeRaw": false } ``` ```json { "operation": "category", "categoryId": "cat830704", "categorySlug": "c/tools/cat830704", "categoryUrl": "https://www.screwfix.com/c/tools/cat830704", "page": 1, "limit": 24, "sort": "top_sellers_desc", "includeRaw": false } ``` ```json { "operation": "item", "productId": "979HF", "productSlug": "p/dewalt-drill/979hf", "productUrl": "https://www.screwfix.com/p/dewalt-drill/979hf", "includeRaw": false } ``` ```json { "operation": "stores", "storeQuery": "London", "page": 1, "limit": 24, "includeRaw": false } ``` ```json { "operation": "store", "storeCode": "TA4", "storeSlug": "stores/TA4/aberdare", "storeUrl": "https://www.screwfix.com/stores/TA4/aberdare", "includeRaw": false } ``` ```json { "operation": "search_filters", "query": "spanner", "categoryId": "cat830704", "categorySlug": "c/tools/cat830704", "categoryUrl": "https://www.screwfix.com/c/tools/cat830704", "includeRaw": false } ``` ```json { "operation": "probe", "includeRaw": false } ``` ### Output - **Dataset**: normalized products, categories, stores, or structured filter rows depending on the operation - **Key-value store `OUTPUT`**: run summary with `source`, `operation`, `success`, `total`, `errors`, `proxy`, and `monetization` ### Limitations - Store search is directory-based text matching (no geospatial nearest-store ranking) - Review summary available on product detail, but individual review rows not extracted - Category taxonomy is top-level from header navigation plus discovered filters (no full deep browse tree export) # Actor input Schema ## `operation` (type: `string`): Actor operation to execute. The Console form shows all possible fields at once, so use the README examples to see which fields are required for each operation. ## `query` (type: `string`): Required for search. Optional for search\_filters when you want live filters from a search page. ## `page` (type: `integer`): Optional for search, category, stores. One-based page index. ## `limit` (type: `integer`): Optional for search, category, stores. Requested page size (max 120). ## `sort` (type: `string`): Optional for search, category. Supported values: relevance\_desc, price\_desc, price\_asc, brand\_asc, brand\_desc, rating\_desc, top\_sellers\_desc. ## `categoryId` (type: `string`): Optional for category or search\_filters. Screwfix category id from categories or previous category/filter output. Example: cat830704 ## `categorySlug` (type: `string`): Optional for category or search\_filters. Relative Screwfix category path. Example: c/tools/cat830704 ## `categoryUrl` (type: `string`): Optional for category or search\_filters. Full category URL alternative to categoryId and categorySlug. ## `productId` (type: `string`): Optional for item. Screwfix SKU / product code. Example: 979HF ## `productSlug` (type: `string`): Optional for item. Relative product path. Example: p/dewalt-drill/979hf ## `productUrl` (type: `string`): Optional for item. Full Screwfix product URL. ## `storeCode` (type: `string`): Optional for store. Screwfix branch code. Example: TA4 ## `storeSlug` (type: `string`): Optional for store. Relative store path. Example: stores/TA4/aberdare ## `storeUrl` (type: `string`): Optional for store. Full Screwfix store URL. ## `storeQuery` (type: `string`): Optional for stores. Search text for store code, name, or slug. ## `includeRaw` (type: `boolean`): Optional for any operation. Include the unnormalized source payload in the OUTPUT summary. ## Actor input object example ```json { "operation": "categories" } ``` # Actor output Schema ## `results` (type: `string`): Normalized dataset items returned by the actor. ## `summary` (type: `string`): Run summary JSON stored under the OUTPUT key. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("dromb/screwfix-uk-wave3").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("dromb/screwfix-uk-wave3").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call dromb/screwfix-uk-wave3 --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=dromb/screwfix-uk-wave3", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Screwfix UK Product & Store Scraper (Unofficial)", "description": "Scrape Screwfix UK products, categories, filters, and stores with normalized output for price monitoring, product research, and retail workflows.", "version": "0.1", "x-build-id": "eoKfQaJHnJO3xLDYc" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/dromb~screwfix-uk-wave3/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-dromb-screwfix-uk-wave3", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/dromb~screwfix-uk-wave3/runs": { "post": { "operationId": "runs-sync-dromb-screwfix-uk-wave3", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/dromb~screwfix-uk-wave3/run-sync": { "post": { "operationId": "run-sync-dromb-screwfix-uk-wave3", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "operation" ], "properties": { "operation": { "title": "Operation", "enum": [ "probe", "categories", "stores", "store", "search_filters", "search", "category", "item" ], "type": "string", "description": "Actor operation to execute. The Console form shows all possible fields at once, so use the README examples to see which fields are required for each operation.", "default": "categories" }, "query": { "title": "Query", "type": "string", "description": "Required for search. Optional for search_filters when you want live filters from a search page." }, "page": { "title": "Page", "type": "integer", "description": "Optional for search, category, stores. One-based page index." }, "limit": { "title": "Limit", "type": "integer", "description": "Optional for search, category, stores. Requested page size (max 120)." }, "sort": { "title": "Sort", "type": "string", "description": "Optional for search, category. Supported values: relevance_desc, price_desc, price_asc, brand_asc, brand_desc, rating_desc, top_sellers_desc." }, "categoryId": { "title": "Category ID", "type": "string", "description": "Optional for category or search_filters. Screwfix category id from categories or previous category/filter output. Example: cat830704" }, "categorySlug": { "title": "Category Slug", "type": "string", "description": "Optional for category or search_filters. Relative Screwfix category path. Example: c/tools/cat830704" }, "categoryUrl": { "title": "Category URL", "type": "string", "description": "Optional for category or search_filters. Full category URL alternative to categoryId and categorySlug." }, "productId": { "title": "Product ID", "type": "string", "description": "Optional for item. Screwfix SKU / product code. Example: 979HF" }, "productSlug": { "title": "Product Slug", "type": "string", "description": "Optional for item. Relative product path. Example: p/dewalt-drill/979hf" }, "productUrl": { "title": "Product URL", "type": "string", "description": "Optional for item. Full Screwfix product URL." }, "storeCode": { "title": "Store Code", "type": "string", "description": "Optional for store. Screwfix branch code. Example: TA4" }, "storeSlug": { "title": "Store Slug", "type": "string", "description": "Optional for store. Relative store path. Example: stores/TA4/aberdare" }, "storeUrl": { "title": "Store URL", "type": "string", "description": "Optional for store. Full Screwfix store URL." }, "storeQuery": { "title": "Store Query", "type": "string", "description": "Optional for stores. Search text for store code, name, or slug." }, "includeRaw": { "title": "Include Raw Payload", "type": "boolean", "description": "Optional for any operation. Include the unnormalized source payload in the OUTPUT summary." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```