# Wayfair Deep Product Data Scraper (`jungle_synthesizer/wayfair-deep-product-data-scraper`) Actor Scrape Wayfair product listings with full detail data: pricing, dimensions, materials, seller brand, review distribution (1-5 star counts), shipping ETA, and variant counts. Accepts category URLs or product URLs. Bypasses PerimeterX bot protection via residential proxy. - **URL**: https://apify.com/jungle\_synthesizer/wayfair-deep-product-data-scraper.md - **Developed by:** [BowTiedRaccoon](https://apify.com/jungle_synthesizer) (community) - **Categories:** E-commerce - **Stats:** 2 total users, 1 monthly users, 66.7% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 record scrapeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Wayfair Deep Product Data Scraper Scrape product data from [Wayfair](https://www.wayfair.com). Returns pricing, dimensions, materials, seller brand, full review distribution, shipping estimates, and variant counts — the deep detail most product scrapers skip because getting it means clearing Wayfair's bot protection first. --- ### Wayfair Deep Product Data Scraper Features - **Full review distribution** — 1-5 star counts per product, not just the average. Sentiment analysis needs the shape, not the mean. - **Marketplace seller identification** — separates Wayfair's own brands from third-party marketplace listings. - **Complete product specs** — dimensions (width, depth, height), weight, materials, finish, and color. - **Pricing with sale detection** — list price, sale price, and a boolean so you don't have to infer discounts. - **Shipping estimates** — delivery days and free-shipping status pulled from structured data. - **Assembly and variant data** — whether assembly is required and how many option variants exist. - **Clears bot protection** — returns real product data on pages that block most automated tools. No proxy setup on your end. - **Mixed input** — feed category URLs, product URLs, or both in the same run. --- ### Who Uses Wayfair Product Data? - **Price intelligence teams** — track list and sale prices across categories to benchmark against your own catalog. - **E-commerce sellers** — study competitor specs, materials, and review distributions before listing a comparable product. - **Market researchers** — map the furniture and home-goods landscape by category, brand, and price band. - **Product managers** — pull dimensions and feature bullets into spec sheets without copying them out of a browser one tab at a time. - **Review analysts** — build sentiment models on real 1-5 star distributions, or at least the dataset that makes them possible. --- ### How Wayfair Deep Product Data Scraper Works 1. Add one or more Wayfair category or product URLs to **Start URLs**. 2. Set **Max Items** to cap how many product records you want. 3. The scraper walks category pages to find products, then visits each product page for the full detail set. It handles the bot protection and pagination for you. 4. Results stream to your dataset as clean JSON, one row per product. --- ### Input ```json { "startUrls": [ { "url": "https://www.wayfair.com/furniture/cat/sofas-c413892.html" } ], "maxItems": 15 } ```` | Field | Type | Default | Description | |-------|------|---------|-------------| | `startUrls` | array | (sofas category) | Wayfair category URLs or product URLs. Mix both types freely. | | `maxItems` | integer | 15 | Maximum number of product records to scrape. | | `resumeCursor` | string | — | Cursor from a previous run's Output. Leave empty for a fresh crawl. | You can pass product URLs directly to skip category traversal: ```json { "startUrls": [ { "url": "https://www.wayfair.com/furniture/pdp/example-sectional-sofa-W000123456.html" }, { "url": "https://www.wayfair.com/furniture/pdp/example-accent-chair-W000654321.html" } ], "maxItems": 2 } ``` *** ### Wayfair Deep Product Data Scraper Output Fields ```json { "product_id": "W000123456", "sku": "ABCD1234", "title": "Ashworth 96\" Reversible Sectional Sofa", "brand": "Latitude Run", "seller_marketplace_brand": "Wayfair", "category": "Sectional Sofas", "category_path": "Furniture | Sofas | Sectional Sofas", "price": 899.99, "sale_price": 749.99, "is_on_sale": true, "shipping_estimate_days": 7, "is_free_shipping": true, "currency": "USD", "description": "Reversible chaise sectional with stain-resistant polyester upholstery...", "features_bullets": "Reversible chaise | Stain-resistant fabric | Solid hardwood frame", "dimensions_width": 96.0, "dimensions_depth": 64.0, "dimensions_height": 35.0, "weight": 142.5, "materials": "Polyester | Solid Wood | Foam", "finish_color": "Charcoal Gray", "assembly_required": true, "num_variants": 6, "num_reviews": 188, "rating_average": 4.6, "rating_distribution": "{\"5\":120,\"4\":45,\"3\":12,\"2\":8,\"1\":3}", "top_review_excerpts": "Sturdy and comfortable | Easy to assemble | Bigger than expected", "has_video": true, "num_images": 12, "main_image_url": "https://assets.wfcdn.com/im/12345678/resize-h800-w800%5Ecompr-r85/example.jpg", "product_url": "https://www.wayfair.com/furniture/pdp/example-sectional-sofa-W000123456.html" } ``` | Field | Type | Description | |-------|------|-------------| | `product_id` | string | Wayfair internal product ID (SKU or productId). | | `sku` | string | Stock keeping unit identifier. | | `title` | string | Full product title. | | `brand` | string | Manufacturer or supplier brand name. | | `seller_marketplace_brand` | string | Marketplace seller or Wayfair brand label for third-party listings. | | `category` | string | Primary category name. | | `category_path` | string | Breadcrumb category path, pipe-separated. | | `price` | number | Current list price in USD. | | `sale_price` | number | Sale or discounted price in USD (null if not on sale). | | `is_on_sale` | boolean | True if the product is currently discounted. | | `shipping_estimate_days` | integer | Estimated shipping days from structured shipping data. | | `is_free_shipping` | boolean | True if free shipping is available. | | `currency` | string | Currency code (typically USD). | | `description` | string | Full product description text. | | `features_bullets` | string | Product feature bullets, pipe-separated. | | `dimensions_width` | number | Product width in inches. | | `dimensions_depth` | number | Product depth in inches. | | `dimensions_height` | number | Product height in inches. | | `weight` | number | Product weight in pounds. | | `materials` | string | Primary materials, pipe-separated. | | `finish_color` | string | Finish or color name. | | `assembly_required` | boolean | True if assembly is required. | | `num_variants` | integer | Number of product variants (options). | | `num_reviews` | integer | Total review count. | | `rating_average` | number | Average star rating (0.0-5.0). | | `rating_distribution` | string | Star rating distribution as a JSON string. | | `top_review_excerpts` | string | Top review texts, pipe-separated (max 3). | | `has_video` | boolean | True if the product page includes a video. | | `num_images` | integer | Number of product images. | | `main_image_url` | string | URL of the primary product image. | | `product_url` | string | Canonical Wayfair product page URL. | *** ### Resuming a large crawl Every run emits a `resumeCursor` in its Output. If a large crawl stops before it finishes — because it hit `maxItems`, your spend cap (`maxTotalChargeUsd`), or was aborted — start a new run with **the same input** plus that `resumeCursor` to continue from where it left off. The crawl resumes from the queued work the previous run didn't reach. - You are **not re-charged** for records the earlier run already delivered. - Resume within your account's run-retention window — on the free tier, roughly your 10 most recent runs. Once the source run is pruned, its `resumeCursor` is no longer valid. - `resumeCursor` is opaque — supply it unmodified. *** ### FAQ #### How do I scrape Wayfair product data? Wayfair Deep Product Data Scraper takes category or product URLs and returns structured JSON for each product. Paste a category URL to scrape everything on it, or paste product URLs to target specific items. Set `maxItems` and run. #### Does the Wayfair scraper need proxies? Wayfair Deep Product Data Scraper handles Wayfair's bot protection on its own. You don't configure proxies, solve challenges, or manage sessions — you get the product data. #### What data can I get from a Wayfair product page? Wayfair Deep Product Data Scraper returns 30+ fields per product, including pricing, sale status, dimensions, materials, weight, the full 1-5 star review distribution, shipping estimates, variant counts, and image URLs. #### How much does Wayfair Deep Product Data Scraper cost to run? Wayfair Deep Product Data Scraper charges $0.10 per run start plus $0.003 per product record. A 1,000-product run costs about $3.10. You pay for records you receive, and resuming a stopped run doesn't double-charge. #### Can I scrape a single Wayfair product instead of a whole category? Yes. Pass one or more product URLs directly in `startUrls` and the scraper skips category traversal, going straight to each product page. *** ### Need More Features? Need custom fields, category filters, or a different retailer? [File an issue](https://console.apify.com/actors/issues) or get in touch. ### Why Use Wayfair Deep Product Data Scraper? - **Deep, not shallow** — returns dimensions, materials, and full review distributions, not just a title and a price. - **Clears bot protection** — Wayfair blocks most automated tools before they see a product. This one returns real data with no proxy setup on your side, which is more than you can say for most scrapers pointed at Wayfair. - **Affordable** — $0.003 per record, and you only pay for what you receive. # Actor input Schema ## `sp_intended_usage` (type: `string`): What will this data feed? E.g. lead lists, KYB checks, price tracking. ## `sp_improvement_suggestions` (type: `string`): Provide any feedback or suggestions for improvements. ## `sp_contact` (type: `string`): We'll personally help with your use case. No spam. ## `resumeCursor` (type: `string`): Leave empty for a fresh crawl. To CONTINUE a previous run where it stopped — without paying again for records you already received — paste the `resumeCursor` value from that run's Output (the run's OUTPUT key). Resume promptly: the previous run's data expires with your account's retention window (free tier: your ~10 most recent runs). ## `startUrls` (type: `array`): Wayfair category URLs (e.g. https://www.wayfair.com/furniture/cat/sofas-c413892.html) or product URLs (e.g. https://www.wayfair.com/furniture/pdp/...). Mix both types freely. ## `maxItems` (type: `integer`): Maximum number of product records to scrape ## Actor input object example ```json { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "startUrls": [ { "url": "https://www.wayfair.com/furniture/cat/sofas-c413892.html" } ], "maxItems": 10 } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "startUrls": [ { "url": "https://www.wayfair.com/furniture/cat/sofas-c413892.html" } ], "maxItems": 10 }; // Run the Actor and wait for it to finish const run = await client.actor("jungle_synthesizer/wayfair-deep-product-data-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "startUrls": [{ "url": "https://www.wayfair.com/furniture/cat/sofas-c413892.html" }], "maxItems": 10, } # Run the Actor and wait for it to finish run = client.actor("jungle_synthesizer/wayfair-deep-product-data-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "startUrls": [ { "url": "https://www.wayfair.com/furniture/cat/sofas-c413892.html" } ], "maxItems": 10 }' | apify call jungle_synthesizer/wayfair-deep-product-data-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=jungle_synthesizer/wayfair-deep-product-data-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Wayfair Deep Product Data Scraper", "description": "Scrape Wayfair product listings with full detail data: pricing, dimensions, materials, seller brand, review distribution (1-5 star counts), shipping ETA, and variant counts. Accepts category URLs or product URLs. Bypasses PerimeterX bot protection via residential proxy.\n", "version": "0.1", "x-build-id": "kFESSgaEUqof5ksIe" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/jungle_synthesizer~wayfair-deep-product-data-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-jungle_synthesizer-wayfair-deep-product-data-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/jungle_synthesizer~wayfair-deep-product-data-scraper/runs": { "post": { "operationId": "runs-sync-jungle_synthesizer-wayfair-deep-product-data-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/jungle_synthesizer~wayfair-deep-product-data-scraper/run-sync": { "post": { "operationId": "run-sync-jungle_synthesizer-wayfair-deep-product-data-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls", "maxItems" ], "properties": { "sp_intended_usage": { "title": "What is the intended usage of this data?", "minLength": 1, "type": "string", "description": "What will this data feed? E.g. lead lists, KYB checks, price tracking." }, "sp_improvement_suggestions": { "title": "How can we improve this crawler for you?", "minLength": 1, "type": "string", "description": "Provide any feedback or suggestions for improvements." }, "sp_contact": { "title": "Contact email (optional)", "minLength": 1, "type": "string", "description": "We'll personally help with your use case. No spam." }, "resumeCursor": { "title": "Resume cursor (continue a previous run)", "type": "string", "description": "Leave empty for a fresh crawl. To CONTINUE a previous run where it stopped — without paying again for records you already received — paste the `resumeCursor` value from that run's Output (the run's OUTPUT key). Resume promptly: the previous run's data expires with your account's retention window (free tier: your ~10 most recent runs)." }, "startUrls": { "title": "Start URLs", "type": "array", "description": "Wayfair category URLs (e.g. https://www.wayfair.com/furniture/cat/sofas-c413892.html) or product URLs (e.g. https://www.wayfair.com/furniture/pdp/...). Mix both types freely.\n", "items": { "type": "string" } }, "maxItems": { "title": "Max Items", "type": "integer", "description": "Maximum number of product records to scrape", "default": 15 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```