Wix Product Scraper Actor

Overview

The Wix Product Scraper Actor is a powerful tool designed to extract and transform product data from Wix-based websites into a uniform format. This actor is ideal for e-commerce businesses, data analysts, and developers who need structured product information for inventory management, market analysis, or integration with other systems.

Features

• Uniform Data Output: The scraper provides a consistent data structure, making it easy to integrate with various applications. The data format includes product details such as ID, title, URL, description, vendor, product type, tags, variants, images, and options.
• Customizable Scraping: Easily modify the scraper to target specific product attributes or handle different data structures.
• Proxy Support: Utilize Apify's proxy settings to avoid IP bans and ensure reliable data extraction.
• Batch Processing: Scrape multiple product pages or entire categories efficiently with batch URL support.
• Duplicate and Sale Product Filtering: Options to remove duplicate entries and filter out products on sale or out of stock.

Input Schema

The actor supports the following input parameters:

• URL: The main website URL to scrape data from.
• Single URL: A specific product page URL to extract data from.
• Batch URL: An array of URLs for product categories or search results to be scraped.
• Delete Duplicate: A boolean option to remove duplicate entries in the dataset.
• Delete Sale Product: A boolean option to exclude products on sale from the dataset.
• Delete Out of Stock: A boolean option to exclude out-of-stock products from the dataset.
• Waiting Time: An integer specifying the delay between requests to avoid overloading the server.
• Proxy Settings: Configuration for using Apify's proxy services or custom proxies.

Data Format

The scraped data is structured as follows:

1{
2    "id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
3    "title": "Maison Hotel - Rita Pant - Paisley Dream",
4    "handle": "maison-hotel-rita-pant-paisley-dream",
5    "url": "https://en.miimoparis.com/product-page/maison-hotel-rita-pant-paisley-dream",
6    "body_html": "<p>Le pantalon Rita en cachemire de rêve.</p><p>&nbsp;</p><p>Pour les sauvages, les vagabonds et les rebelles qui refusent de jouer la carte de la sécurité. Notre pantalon Rita est un clin d'œil audacieux au rock'n'roll vintage avec un cœur bohème à l'esprit libre.</p><p>&nbsp;</p><p>Fabriqué en coton doux avec une touche d'élasthanne (parce que le confort ne doit jamais être compromis), ces beautés à jambe large présentent un imprimé cachemire délavé qui crie la fraîcheur sans effort. La taille haute flatte, tandis que la coupe décontractée les rend parfaites pour les promenades pieds nus sur la plage ou pour arpenter les champs de festival avec des bottes usées.</p><p>&nbsp;</p><p>Finition avec un style classique à cinq poches, un effet subtilement usé et juste la bonne quantité d'élasticité, car la liberté de mouvement n'est pas négociable.</p><p>&nbsp;</p><p>Associez-le à un chemisier vaporeux, superposez les bijoux et ne vous excusez jamais de prendre de la place.</p><p>- 98% Coton 2% Elasthanne.</p><p>- Taille normalement - choisissez votre taille habituelle.</p><p>- Si vous êtes entre deux tailles, choisissez la petite taille.</p><p>- Le mannequin mesure 1,81 cm et porte une taille S.</p><p>- La longueur totale du pantalon est de 108 cm en taille S.</p><p>- Nous recommandons un lavage à la main uniquement.</p><br><br>",
7    "vendor": null,
8    "product_type": "physical",
9    "tags": [
10      
11    ],
12    "variants": [
13      {
14        "id": "b38eee1f-2c17-d544-c12a-c7366f878c381",
15        "title": "Maison Hotel - Rita Pant - Paisley Dream - XS",
16        "sku": "1",
17        "requires_shipping": true,
18        "taxable": true,
19        "featured_image": null,
20        "available": true,
21        "price": 120,
22        "grams": 0,
23        "compare_at_price": null,
24        "position": 1,
25        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
26        "option1": "XS",
27        "option2": null,
28        "option3": null
29      },
30      {
31        "id": "b38eee1f-2c17-d544-c12a-c7366f878c382",
32        "title": "Maison Hotel - Rita Pant - Paisley Dream - S",
33        "sku": "1",
34        "requires_shipping": true,
35        "taxable": true,
36        "featured_image": null,
37        "available": true,
38        "price": 120,
39        "grams": 0,
40        "compare_at_price": null,
41        "position": 2,
42        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
43        "option1": "S",
44        "option2": null,
45        "option3": null
46      },
47      {
48        "id": "b38eee1f-2c17-d544-c12a-c7366f878c383",
49        "title": "Maison Hotel - Rita Pant - Paisley Dream - M",
50        "sku": "1",
51        "requires_shipping": true,
52        "taxable": true,
53        "featured_image": null,
54        "available": true,
55        "price": 120,
56        "grams": 0,
57        "compare_at_price": null,
58        "position": 3,
59        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
60        "option1": "M",
61        "option2": null,
62        "option3": null
63      },
64      {
65        "id": "b38eee1f-2c17-d544-c12a-c7366f878c384",
66        "title": "Maison Hotel - Rita Pant - Paisley Dream - L",
67        "sku": "1",
68        "requires_shipping": true,
69        "taxable": true,
70        "featured_image": null,
71        "available": true,
72        "price": 120,
73        "grams": 0,
74        "compare_at_price": null,
75        "position": 4,
76        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
77        "option1": "L",
78        "option2": null,
79        "option3": null
80      }
81    ],
82    "images": [
83      {
84        "id": "09bf3d_84fe385e4bf6437b8e7c2b8c4d67ebcc~mv2.webp",
85        "created_at": "",
86        "position": 1,
87        "updated_at": "",
88        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
89        "variant_ids": [
90          
91        ],
92        "src": "https://static.wixstatic.com/media/09bf3d_84fe385e4bf6437b8e7c2b8c4d67ebcc~mv2.webp/v1/fit/w_500,h_500,q_90/file.webp",
93        "width": 1080,
94        "height": 1440
95      },
96      {
97        "id": "09bf3d_a8d1b7de2e6849bd9e85a2a7ad38dcc5~mv2.webp",
98        "created_at": "",
99        "position": 2,
100        "updated_at": "",
101        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
102        "variant_ids": [
103          
104        ],
105        "src": "https://static.wixstatic.com/media/09bf3d_a8d1b7de2e6849bd9e85a2a7ad38dcc5~mv2.webp/v1/fit/w_500,h_500,q_90/file.webp",
106        "width": 1080,
107        "height": 1440
108      },
109      {
110        "id": "09bf3d_62fa16a32a9c47e798219fd0908c7404~mv2.webp",
111        "created_at": "",
112        "position": 3,
113        "updated_at": "",
114        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
115        "variant_ids": [
116          
117        ],
118        "src": "https://static.wixstatic.com/media/09bf3d_62fa16a32a9c47e798219fd0908c7404~mv2.webp/v1/fit/w_500,h_500,q_90/file.webp",
119        "width": 1080,
120        "height": 1440
121      },
122      {
123        "id": "09bf3d_c6ef8339ef6b4e22a2c9cf47a1bfff27~mv2.webp",
124        "created_at": "",
125        "position": 4,
126        "updated_at": "",
127        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
128        "variant_ids": [
129          
130        ],
131        "src": "https://static.wixstatic.com/media/09bf3d_c6ef8339ef6b4e22a2c9cf47a1bfff27~mv2.webp/v1/fit/w_500,h_500,q_90/file.webp",
132        "width": 1080,
133        "height": 1440
134      },
135      {
136        "id": "09bf3d_58a3769a0d1d432a8de10d66b4d65845~mv2.webp",
137        "created_at": "",
138        "position": 5,
139        "updated_at": "",
140        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
141        "variant_ids": [
142          
143        ],
144        "src": "https://static.wixstatic.com/media/09bf3d_58a3769a0d1d432a8de10d66b4d65845~mv2.webp/v1/fit/w_500,h_500,q_90/file.webp",
145        "width": 1080,
146        "height": 1440
147      },
148      {
149        "id": "09bf3d_433c0c1d6a01493d894fd72d8d297adf~mv2.webp",
150        "created_at": "",
151        "position": 6,
152        "updated_at": "",
153        "product_id": "b38eee1f-2c17-d544-c12a-c7366f878c38",
154        "variant_ids": [
155          
156        ],
157        "src": "https://static.wixstatic.com/media/09bf3d_433c0c1d6a01493d894fd72d8d297adf~mv2.webp/v1/fit/w_500,h_500,q_90/file.webp",
158        "width": 1080,
159        "height": 1440
160      }
161    ],
162    "options": [
163      {
164        "name": "Size",
165        "position": 1,
166        "values": [
167          "XS",
168          "S",
169          "M",
170          "L"
171        ]
172      }
173    ]
174  }

How It Works

1. Input Configuration: Define the URLs to scrape via the input schema, which supports single product URLs, batch URLs, and category URLs.
2. Data Extraction: The actor uses HTTPX for asynchronous HTTP requests and Beautiful Soup for parsing HTML content.
3. Data Transformation: Extracted data is transformed into a uniform JSON format, ready for further processing or storage.
4. Output: The structured data is stored in a dataset, accessible for download or integration with other systems.

Getting Started

1. Install Apify CLI: Use Homebrew or NPM to install the Apify CLI for local development.
2. Pull the Actor: Use the Apify CLI to pull the actor to your local environment for customization and testing.
3. Run the Actor: Execute the actor on the Apify platform or locally to start scraping data.

SEO Benefits

• Comprehensive Data: Gather detailed product information to enhance your e-commerce platform's SEO by providing rich content and metadata.
• Efficient Updates: Keep your product listings up-to-date with automated scraping, ensuring your site remains relevant and competitive.
• Scalable Solution: Handle large volumes of data with ease, supporting your SEO strategy as your business grows.

Resources