Shopify Products Scraper

This scraper will allow you to scrape all products of any Shopify website with reduced cost and efficiency! With this Shopify scraper, you will be able to :

• get all products of any Shopify website
• get all products details : name, price, price of variants, images, html content, type, tags..
• scrape your concurrent's products with a reduced cost

How much it will cost ?

After several tests, it will cost approximately 0.025$ for 1000 products.

We have worked on this scraper so that it is efficient, fast, consumes little memory and therefore inexpensive.

How to use it?

URL

Simply enter the URL of the Shopify website :

Proxy

The proxy configuration (proxyConfiguration) option enables you to set proxies that will be used by the scraper in order to prevent its detection by target websites. You can use both Apify Proxy and custom HTTP or SOCKS5 proxy servers.

The following table lists the available options of the proxy configuration setting:

Apify Proxy (automatic): The scraper will load all web pages using Apify Proxy in automatic mode. In this mode, the proxy uses all proxy groups that are available to the user, and for each new web page it automatically selects the proxy that hasn't been used in the longest time for the specific hostname, in order to reduce the chance of detection by the website. You can view the list of available proxy groups on the proxy page in the app.

Apify Proxy (selected groups): The scraper will load all web pages using Apify Proxy with specific groups of target proxy servers.

Custom proxies: The scraper will use a custom list of proxy servers. The proxies must be specified in the scheme://user:password@host:port format, multiple proxies should be separated by a space or new line. The URL scheme can be either HTTP or SOCKS5. User and password might be omitted, but the port must always be present.

Output

1[{
2  "min_price": 35,
3  "max_price": 35,
4  "avg_price": 35,
5  "title": "Gymshark Energy+ Seamless Sports Bra - Indigo",
6  "html": "<meta charset=\"utf-8\"><meta charset=\"utf-8\">\n<p class=\"p1\">Encore + d’Energy.</p>\n<p>- Bretelles ajustables et rembourrage amovible<br>- Œillets et coupe flatteuse<br>- Poitrine froncée<br>- Maintien moyen<br>- 94% Nylon, 6% Élasthanne<br>- Mannequin mesure 174cm et porte une taille S.</p>\n<p class=\"p1\">Le Energy+ Seamless Sports Bra a un maintien personnalisable avec des bretelles ajustables et un rembourrage amovible. Un design avec un motif à œillets et un détail froncé autour de la poitrine. Le Energy+ vous met en valeur et optimise vos performances.</p>",
7  "vendor": "Gymshark | Be a visionary.",
8  "handle": "gymshark-energy-seamless-sports-bra-indigo",
9  "product_type": "Womens Sports Bra",
10  "created_at": "2018-10-22T22:34:48+01:00",
11  "updated_at": "2022-10-11T18:46:25+01:00",
12  "published_at": "2018-10-25T19:00:11+01:00",
13  "template_suffix": "",
14  "published_scope": "global",
15  "tags": "25/10/18, all-products, collection: all-products, collection: energy-seamless, collection: seamless, ecom-video, energy-seamless, filter-colour: Blue, filter-size:extra small, filter-size:l, filter-size:m, filter-size:s, filter-size:xs, functional-fitness, main-colour: 5635a6 | Indigo, maintien léger, seamless, seamless-sync, size:l, size:m, size:s, size:xs, sizeguide:sportsbra, sizeguide:top, soldes-50, sports-bras, Womens",
16  "options": [
17    {
18      "name": "Size",
19      "position": 1,
20      "values": [
21        "Extra Small",
22        "Small",
23        "Medium",
24        "Large"
25      ]
26    }
27  ],
28  "variants": [
29    {
30      "id": 13589636907104,
31      "product_id": 1505854193760,
32      "title": "Extra Small",
33      "price": "35.00",
34      "sku": "GLSB1876-IND-XS",
35      "position": 1,
36      "compare_at_price": "",
37      "fulfillment_service": "manual",
38      "inventory_management": "shopify",
39      "option1": "Extra Small",
40      "option2": null,
41      "option3": null,
42      "created_at": "2018-10-22T22:34:48+01:00",
43      "updated_at": "2022-10-11T18:46:24+01:00",
44      "taxable": true,
45      "barcode": "5063167953409",
46      "grams": 0,
47      "image_id": null,
48      "weight": 0,
49      "weight_unit": "kg",
50      "tax_code": "",
51      "requires_shipping": true
52    },
53    {
54      "id": 13589636972640,
55      "product_id": 1505854193760,
56      "title": "Small",
57      "price": "35.00",
58      "sku": "GLSB1876-IND-S",
59      "position": 2,
60      "compare_at_price": "",
61      "fulfillment_service": "manual",
62      "inventory_management": "shopify",
63      "option1": "Small",
64      "option2": null,
65      "option3": null,
66      "created_at": "2018-10-22T22:34:48+01:00",
67      "updated_at": "2022-10-11T18:46:24+01:00",
68      "taxable": true,
69      "barcode": "5063167856908",
70      "grams": 0,
71      "image_id": null,
72      "weight": 0,
73      "weight_unit": "kg",
74      "tax_code": "",
75      "requires_shipping": true
76    },
77    {
78      "id": 13589637005408,
79      "product_id": 1505854193760,
80      "title": "Medium",
81      "price": "35.00",
82      "sku": "GLSB1876-IND-M",
83      "position": 3,
84      "compare_at_price": "",
85      "fulfillment_service": "manual",
86      "inventory_management": "shopify",
87      "option1": "Medium",
88      "option2": null,
89      "option3": null,
90      "created_at": "2018-10-22T22:34:49+01:00",
91      "updated_at": "2022-10-11T18:46:24+01:00",
92      "taxable": true,
93      "barcode": "5063167869571",
94      "grams": 0,
95      "image_id": null,
96      "weight": 0,
97      "weight_unit": "kg",
98      "tax_code": "",
99      "requires_shipping": true
100    },
101    {
102      "id": 13589637070944,
103      "product_id": 1505854193760,
104      "title": "Large",
105      "price": "35.00",
106      "sku": "GLSB1876-IND-L",
107      "position": 4,
108      "compare_at_price": "",
109      "fulfillment_service": "manual",
110      "inventory_management": "shopify",
111      "option1": "Large",
112      "option2": null,
113      "option3": null,
114      "created_at": "2018-10-22T22:34:49+01:00",
115      "updated_at": "2022-10-11T18:46:24+01:00",
116      "taxable": true,
117      "barcode": "5063167862114",
118      "grams": 0,
119      "image_id": null,
120      "weight": 0,
121      "weight_unit": "kg",
122      "tax_code": "",
123      "requires_shipping": true
124    }
125  ],
126  "images": [
127    {
128      "id": 4160819724384,
129      "product_id": 1505854193760,
130      "position": 1,
131      "created_at": "2018-10-22T22:34:48+01:00",
132      "updated_at": "2019-10-20T23:47:03+01:00",
133      "alt": null,
134      "width": 1692,
135      "height": 2018,
136      "src": "https://cdn.shopify.com/s/files/1/2216/7835/products/Energy_Seamless_Sports_Bra_-_Indigo_Marl_A.jpg?v=1571611623",
137      "variant_ids": []
138    },
139    {
140      "id": 4160819757152,
141      "product_id": 1505854193760,
142      "position": 2,
143      "created_at": "2018-10-22T22:34:48+01:00",
144      "updated_at": "2019-10-20T23:47:03+01:00",
145      "alt": null,
146      "width": 1692,
147      "height": 2018,
148      "src": "https://cdn.shopify.com/s/files/1/2216/7835/products/Energy_Seamless_Sports_Bra_-_Indigo_Marl_B.jpg?v=1571611623",
149      "variant_ids": []
150    },
151    {
152      "id": 4160819789920,
153      "product_id": 1505854193760,
154      "position": 3,
155      "created_at": "2018-10-22T22:34:48+01:00",
156      "updated_at": "2019-10-20T23:47:03+01:00",
157      "alt": null,
158      "width": 1692,
159      "height": 2018,
160      "src": "https://cdn.shopify.com/s/files/1/2216/7835/products/Energy_Seamless_Sports_Bra_-_Indigo_Marl_C.jpg?v=1571611623",
161      "variant_ids": []
162    },
163    {
164      "id": 4160819822688,
165      "product_id": 1505854193760,
166      "position": 4,
167      "created_at": "2018-10-22T22:34:48+01:00",
168      "updated_at": "2019-10-20T23:47:03+01:00",
169      "alt": null,
170      "width": 1692,
171      "height": 2018,
172      "src": "https://cdn.shopify.com/s/files/1/2216/7835/products/Energy_Seamless_Sports_Bra_-_Indigo_Marl_D1.jpg?v=1571611623",
173      "variant_ids": []
174    },
175    {
176      "id": 4160819855456,
177      "product_id": 1505854193760,
178      "position": 5,
179      "created_at": "2018-10-22T22:34:48+01:00",
180      "updated_at": "2019-10-20T23:47:03+01:00",
181      "alt": null,
182      "width": 1692,
183      "height": 2018,
184      "src": "https://cdn.shopify.com/s/files/1/2216/7835/products/Energy_Seamless_Sports_Bra_-_Indigo_Marl_D2.jpg?v=1571611623",
185      "variant_ids": []
186    },
187    {
188      "id": 4160819888224,
189      "product_id": 1505854193760,
190      "position": 6,
191      "created_at": "2018-10-22T22:34:48+01:00",
192      "updated_at": "2019-10-20T23:47:03+01:00",
193      "alt": null,
194      "width": 1692,
195      "height": 2018,
196      "src": "https://cdn.shopify.com/s/files/1/2216/7835/products/Energy_Seamless_Sports_Bra_-_Indigo_Marl_D3.jpg?v=1571611623",
197      "variant_ids": []
198    }
199  ]