Walmart Product Data Extractor

This Walmart Product Data Scraper actor meticulously extracts comprehensive product information directly from Walmart's website, gathering crucial details such as product name, brand, price, availability, detailed descriptions, high-resolution images, customer reviews, ratings, key product specifications, UPC/GTIN codes, variant details (size, color, etc.), seller information (when applicable), and category classifications. This data is invaluable for e-commerce businesses for competitive price monitoring, market research, product assortment optimization, identifying trending products, enriching product catalogs, improving SEO strategies, monitoring customer sentiment, and ultimately making data-driven decisions to enhance profitability and market share within the competitive retail landscape.

Features

• Comprehensive Data Extraction: Captures essential product details like name, price, images, description, availability, and ratings to inform business decisions.
• Category & Search Term Targeting: Allows focused data collection based on specific product categories or keywords, saving time and resources.
• Inventory Monitoring: Enables tracking of product stock levels to optimize purchasing and avoid missed sales opportunities.
• Competitor Price Tracking: Provides insights into competitor pricing strategies for making data-driven adjustments to pricing models.
• Product Trend Identification: Facilitates the spotting of popular or trending products on Walmart, informing product development and marketing.
• Automated Data Delivery: Streamlines data delivery to preferred platforms (e.g., spreadsheets, databases) for efficient analysis and utilization.

Output Fields

Field Name	Type	Description
tiktokProfileUrl	String	The URL of the TikTok profile being scraped.
walmartProducts	Array<Object>	An array of Walmart product objects extracted from the profile.
walmartProducts[].productId	String	The unique identifier for the product on Walmart.com.
walmartProducts[].productName	String	The name of the product.
walmartProducts[].productUrl	String	The URL of the product page on Walmart.com.
walmartProducts[].imageUrl	String	The URL of the product image.
walmartProducts[].price	Number	The current price of the product.
walmartProducts[].currency	String	The currency of the price (e.g., "USD").
walmartProducts[].rating	Number	The average customer rating for the product.
walmartProducts[].reviewCount	Number	The number of customer reviews for the product.
walmartProducts[].availability	String	Indicates whether the product is in stock or out of stock. Possible values might include "In Stock", "Out of Stock", etc.
walmartProducts[].sponsored	Boolean	Indicates whether the product mention/placement on TikTok was sponsored.
tiktokVideos	Array<Object>	Array of TikTok video metadata where the product appeared
tiktokVideos[].videoId	String	The unique identifier for the TikTok video.
tiktokVideos[].videoUrl	String	The URL of the TikTok video.
tiktokVideos[].views	Number	The number of views on the TikTok video.
tiktokVideos[].likes	Number	The number of likes on the TikTok video.
tiktokVideos[].comments	Number	The number of comments on the TikTok video.
tiktokVideos[].shares	Number	The number of shares on the TikTok video.
tiktokVideos[].description	String	The description/caption of the TikTok video.
tiktokVideos[].uploadDate	String	The date the TikTok video was uploaded (ISO 8601 format).
extractedAt	String	The date and time the data was extracted (ISO 8601 format).

Possible Usage of the Actor

• Optimizing Inventory Management: Predict demand for specific products in different regions to minimize stockouts and overstocking.
• Personalized Recommendations: Develop targeted product recommendations based on customer purchase history, browsing behavior, and demographic data to increase sales and customer loyalty.
• Competitive Pricing Analysis: Monitor competitor pricing for similar products in real-time to adjust Walmart's pricing strategies and maintain a competitive edge.
• Identifying Emerging Trends: Analyze sales data to identify emerging product trends and consumer preferences to inform product development and merchandising decisions.
• Supply Chain Optimization: Identify bottlenecks and inefficiencies in the supply chain by analyzing product sales and inventory data to improve delivery times and reduce costs.
• Store Placement and Optimization: Analyze sales data by location to determine the optimal placement of new stores and optimize product assortment within existing stores to meet local demand.

Example Output

1{
2  "timestamp": "2025-02-07",
3  "url": "https://www.walmart.com/ip/Maple-Leaf-Farms-All-Natural-Whole-Duck-with-Orange-Sauce-Vacuum-Packed-4-7-lbs-Frozen/10451096",
4  "final_price": 20.89,
5  "sku": "10451096",
6  "currency": "USD",
7  "gtin": "270935000004",
8  "specifications": [
9    {
10      "name": "Poultry Cut",
11      "value": "Whole Chicken"
12    },
13    {
14      "name": "Food Form",
15      "value": "Whole"
16    },
17    {
18      "name": "Food Condition",
19      "value": "Frozen"
20    },
21    {
22      "name": "Container Type",
23      "value": "Vacuum Pack"
24    },
25    {
26      "name": "Size",
27      "value": "4 - 7 lbs"
28    },
29    {
30      "name": "Assembled Product Dimensions (L x W x H)",
31      "value": "5.00 x 6.50 x 12.00 Inches"
32    }
33  ],
34  "image_urls": [
35    "https://i5.walmartimages.com/seo/Maple-Leaf-Farms-All-Natural-Whole-Duck-with-Orange-Sauce-Vacuum-Packed-4-7-lbs-Frozen_d955ab57-5a50-4139-9114-55c07e9a2c83.123957f02fe96015089f2ef99aad62d8.jpeg",
36    "https://i5.walmartimages.com/asr/ea7a8cf1-95b1-474b-8ec5-d4a76568c453.dd47f865c316a64673d5984759c4ed5f.jpeg",
37    "https://i5.walmartimages.com/asr/02eb89ed-6911-4442-9bbc-9cc50717e738.169076fcf138d6432a14ce5f3017d60f.jpeg",
38    "https://i5.walmartimages.com/asr/2a2ad7f2-bc85-4cf4-b02e-89dea42d8c53.66a2dc0f59a3ab7ba5d69e675aa38050.jpeg",
39    "https://i5.walmartimages.com/asr/c5ab94ce-d2f3-40f7-9f35-e6e3603fdaf9.6e77477ddb6b931b94d54ba3efe670b2.jpeg",
40    "https://i5.walmartimages.com/asr/5193d5b5-76e0-4075-a715-61fa9a0cd59a.32453cfa2a3e6e3e697377cb599118cb.jpeg",
41    "https://i5.walmartimages.com/asr/547f2e47-b2b1-43b7-99e3-c749df2fa4e1.fd1d544715d9785aae7ef886967585d3.jpeg"
42  ],
43  "top_reviews": {
44    "negative": {
45      "rating": 1,
46      "review": "Didn't get my duckling after ordering it after paid for it"
47    },
48    "positive": {
49      "rating": 4,
50      "review": "I'm a big fan of duck. There isn't much choice besides this brand locally and they are nice, but a bit on the small size. Nicely packaged, includes necks, giblets, and liver for stock.  It also includes a packet of orange sauce, which I suppose is nice, but I don't use it (like to make my own) so you are paying $3.50/lb for sugar water, flavoring and preservatives. Used to raise my own, probably will go back to that."
51    }
52  },
53  "rating_stars": {
54    "five_stars": 15,
55    "four_stars": 3,
56    "one_star": 11,
57    "three_stars": 1,
58    "two_stars": 1
59  },
60  "related_pages": [
61    "https://www.walmart.com/browse/food/beef-patties/976759_9569500_5667623_1405603",
62    "https://www.walmart.com/browse/food/ground-beef-patties/976759_9569500_1730435_7586253",
63    "https://www.walmart.com/c/kp/haitian-patties",
64    "https://www.walmart.com/browse/food/ribeye-rich-juicy-flavorful/976759_9569500_6677247_7958330",
65    "https://www.walmart.com/browse/food/ground-beef/976759_9569500_5667623_3481824",
66    "https://www.walmart.com/c/kp/ground-family",
67    "https://www.walmart.com/c/kp/whole-ducks",
68    "https://www.walmart.com/browse/food/beef-steaks/976759_9569500_1730435_3846672",
69    "https://www.walmart.com/c/kp/ground-beef-patties-halal",
70    "https://www.walmart.com/c/kp/frichik",
71    "https://www.walmart.com/c/kp/beef-eye"
72  ],
73  "available_for_delivery": false,
74  "available_for_pickup": true,
75  "brand": "Maple Leaf Farms",
76  "breadcrumbs": [
77    {
78      "name": "Food",
79      "url": "https://www.walmart.com/cp/food/976759"
80    },
81    {
82      "name": "Meat & Seafood",
83      "url": "https://www.walmart.com/cp/meat-seafood/9569500"
84    },
85    {
86      "name": "Chicken",
87      "url": "https://www.walmart.com/browse/food/chicken/976759_9569500_1001443"
88    },
89    {
90      "name": "Whole Chicken",
91      "url": "https://www.walmart.com/browse/food/whole-chicken/976759_9569500_1001443_4759356"
92    }
93  ],
94  "category_ids": "0:976759:9569500:1001443:4759356",
95  "review_count": 31,
96  "description": "Our All Natural Frozen Whole Duck with Orange Sauce is lightly marinated in water & sea salt to keep it moist for cooking. Easy to get creative with, you can roast whole, cut up, or save the carcass for duck stock. Use the convenient orange sauce as a glaze or on the side for dipping. Maple Leaf Farms duck is cared for in a free-to-roam environment on small family duck farms throughout Northern Indiana according to our Trident Stewardship program guidelines for duck well-being.",
97  "product_id": "10451096",
98  "product_name": "Maple Leaf Farms All Natural Whole Duck with Orange Sauce, Vacuum Packed Bag , 4-7 lbs (Frozen)",
99  "review_tags": [
100    "Taste (5)",
101    "Price (3)"
102  ],
103  "category_url": "https://www.walmart.com/browse/food/whole-chicken/976759_9569500_1001443_4759356",
104  "category_name": "Whole Chicken",
105  "category_path": "/cp/whole-chicken/4759356",
106  "root_category_url": "https://www.walmart.com/cp/food/976759",
107  "root_category_name": "Food",
108  "upc": "270935000004",
109  "tags": [
110    "Popular pick"
111  ],
112  "main_image": "https://i5.walmartimages.com/seo/Maple-Leaf-Farms-All-Natural-Whole-Duck-with-Orange-Sauce-Vacuum-Packed-4-7-lbs-Frozen_d955ab57-5a50-4139-9114-55c07e9a2c83.123957f02fe96015089f2ef99aad62d8.jpeg",
113  "rating": 3.3,
114  "unit_price": 3.47,
115  "unit": "lb",
116  "aisle": "A35",
117  "free_returns": "Free 90-day returns",
118  "sizes": [],
119  "colors": [],
120  "seller": "Wal***t.c***",
121  "other_attributes": [
122    {
123      "name": "Instructions",
124      "value": "Thaw duck in refrigerator 36-48 hours. Preheat oven to 375 degrees Fahrenheit. Strip bag off duck. Remove neck, giblets, and orange sauce packet form body cavity. Rinse duck under cool water. Season to taste. Roast uncovered breast up, on rack in roasting pan for 26 min per lb."
125    },
126    {
127      "name": "Safe Handling Instructions",
128      "value": "Keep refrigerated or frozen."
129    }
130  ],
131  "customer_reviews": [
132    {
133      "name": "******",
134      "rating": 5,
135      "review": "Super good my first time trying it and I love it so crispy."
136    },
137    {
138      "name": "******",
139      "rating": 5,
140      "review": "Love to cook but shy away from specialty dishes like duck, lamb, rabbit, etc; (fur friends I cuddle in my mind :), plus, too expensive to risk a flub! After seeing Walmart offer Maple Leaf Duck for a fair price, I decided it's now or never to check this one off my 'bucket list'. But before I could take the plunge, I researched Maple Leaf to see how they raise and process their ducks. I had to weigh this 'checking of the wish' off my bucket list, with knowing one of these beautiful feathery friends were harvested at the ripe ol' age of seven weeks - could I do it? I mean, I'm not a vegetarian, but gee-wiz, just\u00a0 thinking about the adorable AFLAC Duck quacking, was messing me all up, lol!! I never researched the harvesting of my burger buddies, pork pals or bass besties? So why all this comtemplating? Was it conviction, compassion... what for heavens sake?And then it came to me, like a light bulb moment! Heaven... yes! Whatever duck I cook has already met it's Maker and most likely enjoying a much greater life. I was satisfied my reasoning and the information provided by Maple Leaf Farms.  I knew I would do right by the little guy to honor its life, so I placed the order.  I followed a chef's recipe for Duck Ala' Orange after brining the bird in 4 cups of my homemade cajun chicken stock, and 1 cup each of pineapple and orange juice; then roasted accordingly. It was delicious! Perfectly cooked, moist, tender and full of flavor. Not gamey in the least, and actually tasted better than chicken to me (a lil' high-five to our feathered  friend ;) . I also made a savory duck stock from the juices and bits with a splash of merlot, yum! All in all, this was one of my favorite bucket list adventures and a great overall experience. So glad I did it! Now, we forge ahead to next on our list, lamb! Wait... lamb? As in, 'mary had a little lamb'... that snuggly wooley friend?? Oh deer!",
141      "title": "Roasting My First Duck"
142    },
143    {
144      "name": "******",
145      "rating": 5,
146      "review": "I always cook duck for Christmas. It comes out fantastic and flavorful marinade in advance and slow cook it and it will be the best duck you ever had.",
147      "title": "Quack quack"
148    },
149    {
150      "name": "******",
151      "rating": 4,
152      "review": "I'm a big fan of duck. There isn't much choice besides this brand locally and they are nice, but a bit on the small size. Nicely packaged, includes necks, giblets, and liver for stock.  It also includes a packet of orange sauce, which I suppose is nice, but I don't use it (like to make my own) so you are paying $3.50/lb for sugar water, flavoring and preservatives. Used to raise my own, probably will go back to that.",
153      "title": "Nice product for roast duck fans"
154    },
155    {
156      "name": "******",
157      "rating": 3,
158      "review": "I bought the whole duck with orange sauce and although the duck was great the orange sauce didn't go well with the duck at all"
159    },
160    {
161      "name": "Bea***ce",
162      "rating": 1,
163      "review": "Didn't get my duckling after ordering it after paid for it"
164    },
165    {
166      "name": "NaV***302***",
167      "rating": 1,
168      "review": "Duck is a special treat for Christmas dinner. This one was TERRIBLE. It was tough even though I cooked it exactly as the package directions. It was so tough that the only way to eat it was to pick up the bone and chew pieces off. And it had very little flavor. It was so terrible that we threw away half of the duck. Never EVER will I buy this product again.",
169      "title": "Awful duck, little flavor."
170    },
171    {
172      "name": "Ken***h",
173      "rating": 1,
174      "review": "i ordered duck not duck suace i want a refund",
175      "title": "i want a refund"
176    },
177    {
178      "name": "Sam***ha",
179      "rating": 1,
180      "review": "she delivered my duck to the wrong address",
181      "title": "Bad"
182    },
183    {
184      "name": "Ben***in",
185      "rating": 1,
186      "review": "Please do not send any Ducks."
187    }
188  ],
189  "ingredients": "Duck, Water, and Sea Salt. Orange Sauce Packet: Orange juice (water, concentrated orange juice), water, turbinado sugar, corn starch, citric acid, sea salt, canola oil, dried torula yeast, guar gum, natural flavor, spice, dehydrated onion.",
190  "initial_price": null,
191  "discount": null,
192  "ingredients_full": [
193    {
194      "type": "Ingredients",
195      "values": "Duck, Water, and Sea Salt. Orange Sauce Packet: Orange juice (water, concentrated orange juice), water, turbinado sugar, corn starch, citric acid, sea salt, canola oil, dried torula yeast, guar gum, natural flavor, spice, dehydrated onion."
196    }
197  ],
198  "categories": [
199    "Food",
200    "Meat & Seafood",
201    "Chicken",
202    "Whole Chicken"
203  ]
204}