Walmart Product Extractor

Walmart Product Extrator CA/US

This Apify Actor fetches detailed product information from Walmart using product IDs or URLs.

Changelog

v0.3 - 2024-09-03

• Performance improvement: Improved stability for long-term scrapes. Now it uses fewer resources.
• Benchmark:
  • Tested with DATACENTER proxies: 1 product/second
  • Using internal proxies: 1 product/1-3 seconds

Input Schema

• proxySettings (object, optional): Configuration for proxy usage, with a default setting to use Apify Proxy.
• internal_proxies (boolean, optional): Utilize internal proxies within the crawler; they are effective for minimal scraping but may experience latency issues during long-term scraping operations, default: false.
• product_ids (array, required): List of product IDs or URLs from Walmart. Examples:
  • https://www.walmart.ca/en/ip/Samsung-Galaxy-Watch6-Classic-GPS-Brand-New-47mm-Smartwatch-with-Heart-Rate-Monitor/6FQWL1GUQ4CP
  • https://www.walmart.com/ip/6-Boxes-of-24-Packets-Sunny-Royal-Supari-Sweet-Betel-Nuts/1379435767
• reg (string, optional): Walmart region to fetch data from. Options:
  • US: United States
  • CA: Canada
• lang (string, optional): Language for Walmart. Options:
  • en: English
  • fr: French
• retry (integer, optional): Number of retries if failed scraping, default: 3.

Why scrape Walmart products?

Using this scraper can help you:

• Analyze pricing trends for specific categories and subcategories.
• Gather competitive intelligence to understand how your products compare to others.
• Benchmark your products against others based on reviews, conversions, and popularity.

Is it legal to scrape Walmart?

Scraping publicly available data like product descriptions, prices, and reviews is generally legal. Always ensure that you respect Walmart's terms of service.

How do I use Walmart Product Scraper?

1. Input: Provide product URLs or IDs and other optional configuration settings.
2. Run the Scraper: Start the scraper to fetch the desired data.
3. Output: The scraper provides product details like title, price, availability, images, reviews, and more.

How many results can you scrape with Walmart Product Scraper?

The scraper's output varies and can range up to several thousand results, but this depends on various factors:

• Product availability: The product may not be available in the selected Walmart region.
• Proxies: The use of proxies can affect the scraper's ability to fetch data.

Example Output

For now, the Actor's output will be in JSON format. Here's an example of the output data:

1{
2    "item": {
3        "itemId": "735787857",
4        "productId": "383ORUDBGCJD",
5        "manufacturerProductId": "MG913LL/A",
6        "upc": "693634373994",
7        "canonicalUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-128GB-Graphite-Refurbished/735787857",
8        "title": "Restored Apple iPhone 12 Pro Max - Carrier Unlocked - 128GB Graphite (Refurbished)",
9        "conditionType": "Restored",
10        "currencyCode": "USD",
11        "currentPrice": "$413.95",
12        "wasPrice": "$749.00",
13        "unitPrice": null,
14        "priceRange": null,
15        "promoData": [
16            {
17                "name": null,
18                "subName": null,
19                "type": "Affirm",
20                "duration": null,
21                "frequencyLabel": null,
22                "hasFees": null,
23                "description": "as low as <b>$28/mo</b> with <img src=\"https://cdn-assets.affirm.com/images/black_logo-white_bg.jpg\" alt=\"Affirm\">",
24                "priceString": "$28/mo"
25            }
26        ],
27        "availabilityStatus": "IN_STOCK",
28        "totalAvailQuantity": 8,
29        "unitType": "EACH",
30        "category": [
31            {
32                "name": "Cell Phones",
33                "url": "/cp/cell-phones/1105910"
34            },
35            {
36                "name": "Unlocked Phones",
37                "url": "/cp/unlocked-phones/1073085"
38            },
39            {
40                "name": "Celulares Desbloqueados",
41                "url": "/cp/celulares-desbloqueados/7617805"
42            }
43        ],
44        "type": "Cell Phones",
45        "badges": {
46            "flags": ["Best seller"],
47            "labels": [],
48            "tags": [],
49            "groups": []
50        },
51        "brand": "Apple",
52        "brandUrl": "/c/brand/apple",
53        "tireSize": null,
54        "tireLoadingIndex": null,
55        "tireSpeedRating": null,
56        "viscosity": null,
57        "motorOilType": null,
58        "model": "MG913LL/A"
59    },
60    "sku": [
61        {
62            "id": "2LPWSNWCLZ8N",
63            "usItemId": "1042424700",
64            "availabilityStatus": "IN_STOCK",
65            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-512GB-Gold-Refurbished/1042424700",
66            "fulfillementBadge": null,
67            "allImages": [
68                "https://i5.walmartimages.com/seo/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-512GB-Gold-Refurbished_64dd8b32-38ca-429b-b31f-aa5fc753d710.905f33e803ed9a90aceea6c5caff466b.jpeg",
69                "https://i5.walmartimages.com/asr/741dad0a-9372-4931-99bd-30b7da27b666.e661ab22672e52720bc5d211e7aa6d83.jpeg",
70                "https://i5.walmartimages.com/asr/61dd0abb-5cec-4723-b61c-fb3706e07f06.9a0917286f58390e14c7ef94bfb8963c.jpeg",
71                "https://i5.walmartimages.com/asr/f4fd8502-42fa-4a81-baf7-b214dca14c8e.415f676ca4a30d75753e9f538dccd493.jpeg"
72            ],
73            "currentPrice": "$508.00",
74            "wasPrice": "$829.00",
75            "unitPrice": null
76        },
77        {
78            "id": "35MWNNVIKIOJ",
79            "usItemId": "610390317",
80            "availabilityStatus": "IN_STOCK",
81            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-128GB-Pacific-Blue-Refurbished/610390317",
82            "fulfillementBadge": null,
83            "allImages": [
84                "https://i5.walmartimages.com/seo/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-128GB-Pacific-Blue-Refurbished_f9d15379-5d53-43b4-bd39-59b0ecfd6c61.f4407fa1c9c14af6b65fa66824337168.jpeg",
85                "https://i5.walmartimages.com/asr/d55d52f1-938f-4657-b9c6-a2265d519d78.2fb31935e3fc8c70efa2360a7730ff74.jpeg"
86            ],
87            "currentPrice": "$415.00",
88            "wasPrice": "$749.00",
89            "unitPrice": null
90        },
91        {
92            "id": "57LS58BAB235",
93            "usItemId": "356724930",
94            "availabilityStatus": "IN_STOCK",
95            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-256GB-Pacific-Blue-Refurbished/356724930",
96            "fulfillementBadge": null,
97            "allImages": [],
98            "currentPrice": "$465.00",
99            "wasPrice": "$799.00",
100            "unitPrice": null
101        },
102        {
103            "id": "1GM1FIXHSNBP",
104            "usItemId": "1211402410",
105            "availabilityStatus": "IN_STOCK",
106            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-128GB-Silver-Refurbished/1211402410",
107            "fulfillementBadge": null,
108            "allImages": [
109                "https://i5.walmartimages.com/seo/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-128GB-Silver-Refurbished_e1585bc7-8f64-4488-9d6d-35176f99ba3c.731cd5653be4a89b9349aeecf6e800ff.jpeg",
110                "https://i5.walmartimages.com/asr/e1585bc7-8f64-4488-9d6d-35176f99ba3c.731cd5653be4a89b9349aeecf6e800ff.jpeg"
111            ],
112            "currentPrice": "$452.00",
113            "wasPrice": "$749.00",
114            "unitPrice": null
115        },
116        {
117            "id": "21AU494VVI7U",
118            "usItemId": "1641388905",
119            "availabilityStatus": "IN_STOCK",
120            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-128GB-Verizon-GSM-Unlocked-T-Mobile-AT-T-LTE-Gold-Refurbished/1641388905",
121            "fulfillementBadge": null,
122            "allImages": [],
123            "currentPrice": "$434.97",
124            "wasPrice": "$749.00",
125            "unitPrice": null
126        },
127        {
128            "id": "3U4OEG3C1BYA",
129            "usItemId": "1272365817",
130            "availabilityStatus": "IN_STOCK",
131            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-256GB-Gold-Refurbished/1272365817",
132            "fulfillementBadge": null,
133            "allImages": [],
134            "currentPrice": "$466.97",
135            "wasPrice": "$799.00",
136            "unitPrice": null
137        },
138        {
139            "id": "4GPRO0PWTBND",
140            "usItemId": "1116452957",
141            "availabilityStatus": "IN_STOCK",
142            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-512GB-Pacific-Blue-Refurbished/1116452957",
143            "fulfillementBadge": null,
144            "allImages": [],
145            "currentPrice": "$469.83",
146            "wasPrice": "$829.00",
147            "unitPrice": null
148        },
149        {
150            "id": "74CQFB8ERWJR",
151            "usItemId": "804238076",
152            "availabilityStatus": "IN_STOCK",
153            "productUrl": "/ip/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-256GB-Graphite-Refurbished/804238076",
154            "fulfillementBadge": null,
155            "allImages": [],
156            "currentPrice": "$439.95",
157            "wasPrice": "$799.00",
158            "unitPrice": null
159        }
160    ],
161    "description": {
162        "productHighlights": [
163            {
164                "name": "Service provider",
165                "value": "GSM and CDMA"
166            },
167            {
168                "name": "Screen size",
169                "value": "6.7 in"
170            },
171            {
172                "name": "HD capacity",
173                "value": "128 GB"
174            },
175            {
176                "name": "Ram memory",
177                "value": "6 GB"
178            },
179            {
180                "name": "Features",
181                "value": "Water-Resistant"
182            },
183            {
184                "name": "Rear cam mpx",
185                "value": "12 MP"
186            },
187            {
188                "name": "Front cam mpx",
189                "value": "12 MP"
190            },
191            {
192                "name": "Mobile OS",
193                "value": "iOS"
194            },
195            {
196                "name": "Brand",
197                "value": "Apple"
198            },
199            {
200                "name": "Model name",
201                "value": "iPhone 12 Pro Max"
202            }
203        ],
204        "specifications": [
205            {
206                "name": "Processor Brand",
207                "value": "Apple"
208            },
209            {
210                "name": "Display Technology",
211                "value": "OLED"
212            },
213            {
214                "name": "Phone Feature",
215                "value": "Water-Resistant"
216            },
217            {
218                "name": "Resolution",
219                "value": "1284 x 2778 pixels,"
220            },
221            {
222                "name": "Processor Speed",
223                "value": "3 GHz"
224            },
225            {
226                "name": "SIM Card Size",
227                "value": "Nano SIM"
228            },
229            {
230                "name": "Native Resolution",
231                "value": "1284 x 2778"
232            },
233            {
234                "name": "Battery Capacity",
235                "value": "3687 mAh"
236            },
237            {
238                "name": "Brand",
239                "value": "Apple"
240            },
241            {
242                "name": "Cell Phone Type",
243                "value": "Unlocked Cell Phones"
244            },
245            {
246                "name": "Cell Phone Service Provider",
247                "value": "GSM and CDMA"
248            },
249            {
250                "name": "Screen Size",
251                "value": "6.7 in"
252            },
253            {
254                "name": "Front-Facing Camera Megapixels",
255                "value": "12 MP"
256            },
257            {
258                "name": "Rear-Facing Camera Megapixels",
259                "value": "12 MP"
260            },
261            {
262                "name": "Model Name",
263                "value": "iPhone 12 Pro Max"
264            },
265            {
266                "name": "Model",
267                "value": "MG913LL/A"
268            },
269            {
270                "name": "Condition",
271                "value": "Restored"
272            },
273            {
274                "name": "Manufacturer",
275                "value": "Apple"
276            },
277            {
278                "name": "Color Category",
279                "value": "Black"
280            },
281            {
282                "name": "Cellular Network Technology",
283                "value": "CDMA-GSM Unlocked"
284            },
285            {
286                "name": "RAM Memory",
287                "value": "6 GB"
288            },
289            {
290                "name": "Virtual Assistant",
291                "value": "Siri"
292            },
293            {
294                "name": "Manufacturer Part Number",
295                "value": "MG913LL/A"
296            },
297            {
298                "name": "Color",
299                "value": "Graphite"
300            }
301        ],
302        "directions": null,
303        "indications": null,
304        "ingredients": null,
305        "drugGuide": null,
306        "warnings": [
307            {
308                "name": "WARNING - California Proposition 65",
309                "value": "This product contains a chemical known to the State of California to cause cancer and birth defects or other reproductive harm. For more information go to www.P65warnings.ca.gov"
310            }
311        ],
312        "longDescription": "<ul>   <li>This product may not have been manufacturer certified but has been professionally inspected, tested and cleaned by Walmart Restored Program Sellers and Suppliers</li>   <li>Fully functional product in Like New Condition. Item may have very light micro-scratches, invisible at a distance of 8-12 inches (arm’s length).</li>   <li>This product may include accessories which might not be original but will be compatible and fully functional.</li>   <li>This product may be returned within 90 days for free return or replacement if you are not satisfied.</li>   <li>Battery capacity exceeds 80% capacity relative to its new equivalent</li>  </ul>  <ul>   <li>Display Type Super Retina XDR OLED, HDR10, Dolby Vision, 800 nits (tip), 1200 nits (peak)</li>   <li>Size 6.7 inches, 109.8 cm2 (~87.4% screen-to-body ratio)</li>   <li>Resolution 1284 x 2778 pixels,</li>   <li>PLATFORM OS iOS 14.1, upgradable to iOS 14.7</li>   <li>Chipset Apple A14 Bionic (5 nm)</li>   <li>Internal 128GB 6GB RAM, NVMe</li>   <li>Camera: Quad 12 MP, f/1.6, 26mm (wide), 12 MP, f/2.2, 65mm (telephoto), 12 MP, f/2.4, 120, 13mm (ultrawide), TOF 3D LiDAR scanner (depth) + 12 MP, f/2.2, 23mm (wide)</li>   <li>1/3.6&quot;, SL 3D, (depth/biometrics sensor).</li>   <li>Wi-Fi 802.11 a/b/g/n/ac/6, dual-band, hotspot</li>   <li>Bluetooth 5.0, A2DP, LE</li>  </ul>",
313        "shortDescription": "<p>This Apple iPhone 12 Pro Max has been professionally restored to working order by an approved vendor. It is in Perfect Working Condition with 9/10 Cosmetic Rating. Fully Unlocked compatible with all carriers. All iPhone 12 Pro Max models have a haptic-touch capable 6.7&quot; (diagonal) &quot;Super Retina XDR&quot; display (2778 x 1284, 458 PPI, 800 Nits max brightness) that occupies nearly the entire front of the device. It has four cameras. On the front tucked in the &quot;notch&quot; is a &quot;True Depth&quot; camera that in addition to supporting &quot;Advanced Face ID&quot; identification functionality, takes 12-megapixel photos, shoots 4K video, and has software support for Portrait mode, Portrait lighting, and more. The rear packs a 4K video-capable &quot;pro-12-megapixel camera system&quot; with three cameras Ultra-Wide (f/2.4 aperture, 120-degree field of view), Wide (f/1.6 aperture, sensor-shift optical image stabilization), and Telephoto (f/2.2 aperture). Apple notes that the iPhone 12 Pro Max provides &quot;computational photography&quot; features that improve low-light performance and reduce noise compared to earlier iPhone models. The iPhone 12 Pro Max uses a partially &quot;surgical grade&quot; stainless steel case with flat polished stainless-steel sides and has a glass front and back. The front has a &quot;Ceramic Shield&quot; cover for improved durability and the back has an integrated &quot;MagSafe&quot; magnetic charging connection. It is splash, water, and dust-resistant to the IP68 standard (maximum depth of 6 meters up to 30 minutes). Internally, the iPhone 12 Pro Max is powered by a 64-bit 3.0 GHz &quot;Apple A14 Bionic&quot; processor with six cores two performance cores and four high-efficiency cores and a 16-core Neural Engine. It has 6 GB of RAM and 128 GB of flash storage. It also supports 802.11ax Wi-Fi 6 with 2x2 MIMO, 5G wireless, Bluetooth 5.0, Ultra-Wideband &quot;for spatial awareness,&quot; NFC for Apple Pay, &quot;Express Cards with power reserve&quot; for compatible transit systems, a LiDAR scanner, and dual SIMs (one hardware nano SIM and one software-based eSIM).</p>",
314        "allImages": [
315            "https://i5.walmartimages.com/seo/Restored-Apple-iPhone-12-Pro-Max-Carrier-Unlocked-128GB-Graphite-Refurbished_68788852-aa8c-4800-883e-6c81857ec608.0f6f988bbec50b5d34415cc2166c7d0b.jpeg",
316            "https://i5.walmartimages.com/asr/d30c3c9d-ca18-498f-87ee-a4d72f4ab461.e680666ee81a2dacd0446a8f03e9d9b0.jpeg",
317            "https://i5.walmartimages.com/asr/d55548b6-2dc4-46c2-940f-43baf421368f.bfc5e8cbcbc6f1e7b70f24235f27181e.jpeg"
318        ],
319        "videos": null
320    },
321    "reviews": {
322        "averageRating": 3.5433,
323        "totalReviewCount": 635,
324        "totalMediaCount": 61,
325        "reviewsWithTextCount": 310,
326        "customerReviews": [
327            {
328                "reviewId": "330948338",
329                "rating": 5,
330                "reviewTitle": "As described",
331                "reviewText": "I just received the phone and so far it's pretty good. Looks better then I thought just minimal scratches around the sides, some around the camera and battery life is at 83%. Came with a charger and pins for your SIM card."
332            },
333            {
334                "reviewId": "299114387",
335                "rating": 5,
336                "reviewTitle": "I am impressed",
337                "reviewText": "I was so skeptical in ordering due to some reviews left on their page but I took the risk but made sure to contact them! The phone came with 94% battery health. no scratches on the screen or the back at all. only scratch was the sides but so minimal. I definitely recommend this specific phone, camera is perfect, works like new and came on time. no regrets. Love it thanks!!"
338            },
339            {
340                "reviewId": "324374742",
341                "rating": 5,
342                "reviewTitle": "Acceptable minor scratches and 85% battery life",
343                "reviewText": "I dislike the phone has minor scratches as stated in item description. It is an acceptable because you will not noticed after the phone equipped with case. Also, the phone actually have remaining battery life of 85% as stated in item description more than 80%."
344            },
345            {
346                "reviewId": "334432946",
347                "rating": 4,
348                "reviewTitle": "Arrived fairly quickly and well packed.",
349                "reviewText": "Works so much better than my old one. It was refurbished except the battery. It only holds 87% charge but everything else is fantastic. The scene being a touch bigger is more than ideal. Overall I give it a big thumbs up!!"
350            },
351            {
352                "reviewId": "315467238",
353                "rating": 3,
354                "reviewTitle": null,
355                "reviewText": "Love the phone and refurbished. Decent Price. iPhone 12 Pro Max 512GB. Ocean Blue. The outer shell is great condition no wears or cracks. But the Screen Has Scratches Here And There. But Can Survive. And Shipping Needs To Be Secured Right With Bubble wrap. Was Just Raw Box’s. With No secure bubble wrap."
356            },
357            {
358                "reviewId": "323293034",
359                "rating": 1,
360                "reviewTitle": "Don't buy",
361                "reviewText": "Very disappointed, I have purchased refurbished iPhones here before and they always seem sharp, mint conditions, like description says: LIKE NEW CONDITION, lol. This time the phone had all the back of the phone with stains, the front screen scratched more than normal, and the worst thing was the screen, it was defective about a 1/3 of an inch stripe right in the bottom across the screen where you usually always use for keyboard didn't work, so, my question is: HOW IS IT POSSIBLE TO HAVE ALL DEVICES TESTED, INSPECTED and Certified as refurbished? This needed for a gift and now it has been sent out back, waiting for refund."
362            },
363            {
364                "reviewId": "336682934",
365                "rating": 1,
366                "reviewTitle": "They shouldn't let items like that be sold.",
367                "reviewText": "First of all, the representative told me that it was new and it wasn't... but in the same way... one thing is second hand, it came very damaged, scratched, peeled in all the corners, it looked like it had been used as a hammer"
368            },
369            {
370                "reviewId": "310087046",
371                "rating": 1,
372                "reviewTitle": "Terrible. Don’t buy.",
373                "reviewText": "Phone came broken. Won’t give refund."
374            },
375            {
376                "reviewId": "333431493",
377                "rating": 1,
378                "reviewTitle": "Horrible",
379                "reviewText": "The phone was in horrible condition not refurbished whatsoever. They didn’t even bother cleaning the phone it still had dirt and it was very grimy and the phone had tons of scratches and dents."
380            },
381            {
382                "reviewId": "331368603",
383                "rating": 1,
384                "reviewTitle": "don’t buy from them",
385                "reviewText": "I got my phone fast but I went to set it up and the screen was turning green and pixelating and also a crack on the back of the phone and scratches on the screen and not one time did it say any of that in the description of what was wrong with it very disappointed…"
386            }
387        ]
388    },
389    "questions": []
390}