# John Pye Auctions Scraper (`rainminer/johnpyeauctions-co-uk-scraper`) Actor Extract auction lots from John Pye Auctions (johnpyeauctions.co.uk) — current bids, minimum bids, remaining time, images, event details, and locations from UK online auctions. - **URL**: https://apify.com/rainminer/johnpyeauctions-co-uk-scraper.md - **Developed by:** [rainminer](https://apify.com/rainminer) (community) - **Categories:** E-commerce, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.33 / 1,000 lots This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### What does John Pye Auctions Scraper do? **John Pye Auctions Scraper** extracts **online auction lots** from [John Pye Auctions](https://www.johnpyeauctions.co.uk/) — one of the UK's largest auction houses for furniture, home décor, white goods, vehicles, and surplus stock. Paste a **browse or home URL**, an **event catalogue URL**, or a **single lot URL** and export clean, structured lot data — current bids, minimum bids, remaining time, images, and saleroom locations — without writing any code. Run it on the **Apify platform** to schedule recurring scrapes, monitor live UK auctions, and export results via API to JSON, CSV, or Excel. ### What can this Actor do? - Scrape **active auction lots** from browse pages and the John Pye homepage - Scrape **all lots in an auction event** from a single event catalogue URL (with pagination) - Scrape **individual lot pages** for targeted monitoring - Extract **current price, minimum bid, remaining time, and buyer's premium** - Capture **event title, saleroom location, description, and lot images** - Limit results **per start URL** with `maxItems` for fast, cheap test runs - Handle **Cloudflare protection** using Camoufox with UK residential proxy (enabled by default) ### Why scrape John Pye Auctions? - **Price research & comps** — Track current and minimum bids across UK online auctions - **Deal sourcing** — Monitor furniture, bikes, white goods, and surplus lots as they go live - **Market intelligence** — Analyse bidding activity and inventory by event or saleroom - **Inventory alerts** — Watch events or categories for new lots - **Apify platform** — Schedule recurring runs and export to JSON, CSV, Excel, or webhooks ### What data can you extract from John Pye Auctions? | Field | Description | | --- | --- | | lotId | Unique lot identifier | | lotNumber | Catalogue lot number (e.g. `1`) | | title | Lot title | | url | Public lot URL | | currentBid | Current / last bid amount | | minimumBid | Minimum next bid | | currency | Currency code (`GBP`) | | remainingTime | Time left to bid (as shown on the site) | | description | Lot description | | eventId / eventTitle / eventUrl | Parent auction event | | location | Saleroom / collection address | | images | Lot image URLs | | buyersPremiumText | Buyer's premium note (e.g. `25% Buyers Premium`) | | searchUrl | Source start URL | ### How to use John Pye Auctions Scraper 1. Open the Actor in Apify Console. 2. Add one or more **John Pye Auctions URLs** under **Start URLs** (home/browse, event, or lot). 3. Set **Maximum items** (lots per start URL). 4. Keep **UK residential proxy** enabled — the site uses Cloudflare Turnstile. 5. Run the Actor and download results from the **Dataset** tab. ### Supported URL patterns - Home / browse: `https://www.johnpyeauctions.co.uk/`, `/?ViewFilter=Current`, `/Browse/C160536/FURNITURE-HOME-DECOR` - Event catalogue: `https://www.johnpyeauctions.co.uk/Event/Details/{eventId}/{slug}` - Lot detail: `https://www.johnpyeauctions.co.uk/Event/LotDetails/{lotId}/{slug}` ### Input John Pye Auctions Scraper accepts **Start URLs**, **maxItems** (per start URL), and **proxy configuration** (default: Apify residential proxy in the UK). ```json { "startUrls": [ { "url": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items" } ], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "GB" } } ```` ### Output example You can download the dataset in various formats such as JSON, HTML, CSV, or Excel. ```json { "lotId": "550009400", "lotNumber": "1", "title": "ALPKIT LOOKOUT ROOF TENT TAN24 SEALED ORIGINAL RRP 1299", "url": "https://www.johnpyeauctions.co.uk/Event/LotDetails/550009400/ALPKIT-LOOKOUT-ROOF-TENT-TAN24-SEALED-ORIGINAL-RRP-1299", "currentBid": 330, "minimumBid": 340, "currency": "GBP", "remainingTime": "7 Hours, 6 Minutes", "description": "Alpkit Lookout roof tent...", "eventId": "538754581", "eventTitle": "Nottingham SR4 540 Bicycle Parts White Goods Baby Items", "eventUrl": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items", "location": "Nottingham", "images": [ "https://lotimages.co.uk/538754581/1_1_fullsize.jpg" ], "buyersPremiumText": "25% Buyers Premium", "searchUrl": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items" } ``` ### How much does it cost to scrape John Pye Auctions? This Actor uses **pay-per-event + platform usage** pricing. You pay compute/proxy usage separately, plus a maintenance fee per lot: | Event | Free plan | Gold / Platinum / Diamond | | --- | --- | --- | | Actor start | $0.00005 | $0.00005 | | Lot scraped (maintenance) | **$0.49 / 1,000** | **$0.33 / 1,000** | UK **residential proxy** is required to pass Cloudflare Turnstile (Camoufox stealth Firefox). Keep `maxItems` at 3–5 for quick tests; full event catalogues cost more because of browser + proxy usage. ### Tips and advanced options - Start from an **event catalogue URL** when you want every lot in one auction. - Use **browse / category URLs** to discover live events, then follow lots automatically. - Keep **GB residential proxy** enabled — datacenter IPs are blocked by Cloudflare. - Set `maxItems` to `3`–`5` for quick verification runs under a few minutes. ### Is it legal to scrape John Pye Auctions? Web scraping public auction listings is generally legal when you respect the website's terms and applicable laws. Do not collect personal data unless you have a lawful basis. Use this Actor responsibly and review John Pye Auctions' terms of use. ### Need more help? - [Apify documentation](https://docs.apify.com/) - [Crawlee documentation](https://crawlee.dev/) ### Image Credit Image credit: [johnpyeauctions.co.uk](https://www.johnpyeauctions.co.uk/) # Actor input Schema ## `startUrls` (type: `array`): John Pye Auctions URLs to scrape. Supported: home/browse (https://www.johnpyeauctions.co.uk/, /?ViewFilter=Current, /Browse/...), event catalogues (/Event/Details/{id}/{slug}), and lot details (/Event/LotDetails/{id}/{slug}). ## `maxItems` (type: `integer`): Maximum number of lots to return per start URL. ## `proxyConfiguration` (type: `object`): John Pye Auctions is protected by Cloudflare Turnstile. UK residential proxy is required and enabled by default. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items" } ], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "GB" } } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items" } ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "GB" } }; // Run the Actor and wait for it to finish const run = await client.actor("rainminer/johnpyeauctions-co-uk-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items" }], "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "GB", }, } # Run the Actor and wait for it to finish run = client.actor("rainminer/johnpyeauctions-co-uk-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.johnpyeauctions.co.uk/Event/Details/538754581/Nottingham-SR4-540-Bicycle-Parts-White-Goods-Baby-Items" } ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "GB" } }' | apify call rainminer/johnpyeauctions-co-uk-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=rainminer/johnpyeauctions-co-uk-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "John Pye Auctions Scraper", "description": "Extract auction lots from John Pye Auctions (johnpyeauctions.co.uk) — current bids, minimum bids, remaining time, images, event details, and locations from UK online auctions.", "version": "1.0", "x-build-id": "uJmdy3DH184z44WmV" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/rainminer~johnpyeauctions-co-uk-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-rainminer-johnpyeauctions-co-uk-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/rainminer~johnpyeauctions-co-uk-scraper/runs": { "post": { "operationId": "runs-sync-rainminer-johnpyeauctions-co-uk-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/rainminer~johnpyeauctions-co-uk-scraper/run-sync": { "post": { "operationId": "run-sync-rainminer-johnpyeauctions-co-uk-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "John Pye Auctions URLs to scrape. Supported: home/browse (https://www.johnpyeauctions.co.uk/, /?ViewFilter=Current, /Browse/...), event catalogues (/Event/Details/{id}/{slug}), and lot details (/Event/LotDetails/{id}/{slug}).", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxItems": { "title": "Maximum items", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum number of lots to return per start URL.", "default": 5 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "John Pye Auctions is protected by Cloudflare Turnstile. UK residential proxy is required and enabled by default." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```