Wayfair Product Scraper

Scrapes product listings from wayfair.com

Input

Field	Default	Description
search_query	"office chair"	Keyword searched on wayfair.com. Used only when start_urls is empty.
start_urls	[]	Wayfair category/browse/search URLs, e.g. https://www.wayfair.com/furniture/sb0/sofas-c413892.html. Paginated automatically.
max_items	48	Max products returned across all URLs (max 2000). One listing page = 48 products.
delay_seconds	6	Pause between page requests and starting backoff on HTTP 429. Below 5 is likely to get blocked.

Runs with completely empty input (defaults to a office chair search, first 48 results).

Output

{
  "sku": "W112266288",
  "variant_id": "W112266288_2140780284",
  "name": "Traditional Upholstered Standard Sofa with Square Armrests and 2 Throw Pillows",
  "url": "https://www.wayfair.com/furniture/pdp/ebern-designs-traditional-upholstered-standard-sofa-with-square-armrests-and-2-throw-pillows-w112266288.html",
  "url_with_variant": "https://www.wayfair.com/furniture/pdp/...-w112266288.html?piid=2140780284",
  "brand": "Ebern Designs",
  "price": 479.99,
  "price_label": "Sale",
  "previous_price": 1333.99,
  "percent_off": "64% Off",
  "currency": "USD",
  "rating": 4.25,
  "review_count": 681,
  "selected_options": "Cream",
  "available_choice_count": 4,
  "flag": "Summer Markdowns",
  "is_best_value": true,
  "is_sponsored": false,
  "stock_status": "IN_STOCK",
  "inventory_message": "898 Left in Stock",
  "delivery_message": "FREE 2-Day Delivery",
  "category_id": 413892,
  "category_name": "Sofas",
  "image_url": "https://assets.wfcdn.com/im/00000000/resize-h600-w600%5Ecompr-r85/3093/309329658/default_name.jpg",
  "description": "This modern sofa introduces clean lines and a tailored silhouette…",
  "source_url": "https://www.wayfair.com/keyword.php?keyword=office+chair",
  "raw": { "__typename": "RecommendedListingCollectionItem", "...": "full GraphQL listing node" }
}

Data source and auth

Public wayfair.com listing pages — no API key, token or login. Wayfair is behind PerimeterX: Chrome and Firefox TLS fingerprints are rejected with HTTP 429 plus a px-captcha interstitial, while Safari fingerprints pass, so every request goes out through curl_cffi with rotating Safari impersonation profiles (safari184, safari260, safari180, …) and escalating backoff. Product detail (PDP) pages are protected more aggressively than listing pages and are not scraped; every field above comes from the listing grid payload. From a datacenter IP the rate limit is roughly one page per several seconds — keep delay_seconds at 6 or higher, and use a residential proxy on Apify for large runs.

Caveats

Scraped data is public listing information; respect Wayfair's Terms of Service and robots.txt, keep request rates polite, and do not redistribute product copy or imagery in ways that infringe Wayfair's or its manufacturers' rights. Prices, stock and delivery promises are point-in-time and vary by locale/postcode.