Wayfair Scraper Actor

This Apify actor is designed to scrape product information from Wayfair by inputting product URLs. The actor performs the following actions:

1. Takes a list of URLs from Wayfair product pages as input.
2. Requests a snapshot from an internal scraper API.
3. If the snapshot is successful, fetches the results for the product pages.
4. Returns the scraped product data, including product details, images, price, reviews, and variations.

Input

The actor expects a JSON array of URLs that point to specific Wayfair product pages. Here is an example input:

1[ "https://www.wayfair.com/baby-kids/pdp/oxfordbaby-harper-4-in-1-convertible-baby-crib-greenguard-gold-certified-w004666617.html?piid=386556049&auctionId=f8312e98-1796-4811-a317-061bc1893930",
2  "https://www.wayfair.com/lighting/pdp/bayou-breeze-lafollette-25-outdoor-25-bulb-globe-string-light-end-to-end-connectable-w004268297.html"
3]

Input Schema

URLs: An array of objects. Each object should contain a single url key, which is the link to the Wayfair product page to scrape.

Output

The output is a JSON object containing a list of responses for each URL provided. Below is an example output:

1{
2  "ACK": "Success",
3  "response": [
4    {
5      "input": {
6        "url": "https://www.wayfair.com/lighting/pdp/bayou-breeze-lafollette-25-outdoor-25-bulb-globe-string-light-end-to-end-connectable-w004268297.html"
7      },
8      "warning": "The product page does not exist - redirect",
9      "warning_code": "dead_page"
10    },
11    {
12      "input": {
13        "url": "https://www.wayfair.com/baby-kids/pdp/oxfordbaby-harper-4-in-1-convertible-baby-crib-greenguard-gold-certified-w004666617.html?piid=386556049&auctionId=f8312e98-1796-4811-a317-061bc1893930"
14      },
15      "url": "https://www.wayfair.com/baby-kids/pdp/oxfordbaby-harper-4-in-1-convertible-baby-crib-greenguard-gold-certified-w004666617.html?piid=386556049&auctionId=f8312e98-1796-4811-a317-061bc1893930",
16      "product_id": "w004666617",
17      "title": "Harper 4 in 1 Convertible Baby Crib, Greenguard Gold Certified",
18      "rating": 4.6,
19      "reviews_count": 706,
20      "initial_price": "$132.07",
21      "final_price": "$132.07",
22      "currency": "USD",
23      "shipping": "FREE Delivery",
24      "breadcrumbs": [
25        {
26          "name": "Baby & Kids",
27          "url": "https://www.wayfair.com/baby-kids/cat/baby-kids-c45226.html"
28        },
29        {
30          "name": "Nursery Furniture",
31          "url": "https://www.wayfair.com/baby-kids/cat/nursery-furniture-c90450.html"
32        },
33        {
34          "name": "Cribs",
35          "url": "https://www.wayfair.com/baby-kids/sb0/cribs-c1838963.html"
36        }
37      ],
38      "images": [
39        "https://assets.wfcdn.com/im/05919897/resize-h800-w800%5Ecompr-r85/1198/119882768/Harper+4+in+1+Convertible+Baby+Crib%2C+Greenguard+Gold+Certified%2C+Snow+White.jpg",
40        "https://assets.wfcdn.com/im/77540044/resize-h800-w800%5Ecompr-r85/1198/119882774/Harper+4+in+1+Convertible+Baby+Crib%2C+Greenguard+Gold+Certified%2C+Snow+White.jpg"
41      ],
42      "product_details": [
43        {
44          "detail_name": "Crib Size / Shape",
45          "detail_value": "Standard"
46        },
47        {
48          "detail_name": "Material",
49          "detail_value": "Manufactured Wood, Solid Wood"
50        }
51      ],
52      "variations": [
53        {
54          "variation_value": "Cloud Gray",
55          "price": 138.08,
56          "currency": "USD",
57          "url": "https://www.wayfair.com/baby-kids/pdp/oxfordbaby-harper-4-in-1-convertible-baby-crib-greenguard-gold-certified-w004666617.html?piid=386556048"
58        }
59      ]
60    }
61  ]
62}

Explanation of Output

ACK: Status of the request. "Success" means the scraping process has successfully completed for all URLs. response: A list of scraped product data for each input URL. If the product is not found or there is a redirect, a warning is included. For valid products, detailed product information is returned, including: product_id, title, price, shipping, and images. breadcrumbs: Product category hierarchy. product_details: Specific details about the product (e.g., material, dimensions). variations: Different variations of the product (e.g., color, size, price). reviews: Most relevant product reviews.

How to Use

Run the Actor: Once the actor is deployed, input a list of URLs for Wayfair product pages. Wait for Snapshot Response: The actor will first request a snapshot from the internal scraper API. Get Scraped Data: After the snapshot is successful, it will fetch the actual data and return it to you in the specified output format.