Lowe's Product Scraper

The Lowe's Product Scraper is a tool designed to extract detailed product information from Lowe's listings. By providing product URLs, this scraper gathers comprehensive data about each product, including pricing, reviews, specifications, and related products. It is ideal for e-commerce analysis, competitor research, and cataloging purposes.

Features

1. Product Details

• Product Name: Full name of the product (product_name).
• Brand: Manufacturer's brand (brand).
• SKU: Stock Keeping Unit for the product (sku).
• Marketplace Product Number: Marketplace-specific product identifier (marketplace_pn).
• GTIN/EAN/PN: Global Trade Item Number or equivalent (gtin_ean_pn).
• Model Number: Model-specific number for the product (model_number).
• Description: Brief product description (description).
• Date First Available: When the product was first listed on Lowe's (date_first_available).

2. Pricing Information

• Initial Price: Original price of the product (initial_price).
• Final Price: Discounted price, if applicable (final_price).
• Discount: Discount percentage applied (discount).
• Currency: Currency of the pricing (currency).

3. Availability and Delivery

• In Stock: Boolean indicating stock status (in_stock).
• Availability Status: Array of availability indicators (availability).
• Delivery Options:
  • Descriptions and names of delivery options, such as "Pickup" or "Truck Delivery" (delivery_offers).

4. Media

• Main Image: URL of the primary product image (main_image).
• Image URLs: Array of additional product images (image_urls).
• Videos: Associated product videos (videos).

5. Category Information

• Root Category: Top-level category of the product (root_category).
• Breadcrumbs: Category hierarchy for the product (breadcrumbs).

6. Ratings and Reviews

• Rating: Average customer rating (rating).
• Review Count: Total number of reviews for the product (reviews_count).
• Top Reviews:
  • Detailed reviews, including:
    • Title: Summary of the review.
    • Description: Full text of the review.
    • Name: Anonymized reviewer name.
    • Rating: Rating provided by the reviewer.

7. Product Specifications

• Specifications: Detailed product specifications, such as dimensions, materials, and recommended pet size (features).

8. Related and Complementary Products

• Customers Also Viewed:
  • Related products frequently viewed by customers (customers_also_viewed).
• Better Together:
  • Complementary products often purchased together (better_together).

Input Format

The scraper accepts a JSON array of product URLs from Lowe's, structured as follows:

1["https://www.lowes.com/pd/QUIKRETE-50-lb-Fast-Setting-Concrete-Mix/3006121"
2        ,"https://www.lowes.com/pd/QUIKRETE-50-lb-Fast-Setting-Concrete-Mix/3006121"
3      ]

Output

The output is a JSON object containing a list of responses for each URL provided. Below is an example output:

1[
2  {
3    "url": "https://www.lowes.com/pd/PetSafe-10-1-2-in-x-15-in-White-Plastic-Medium-Dog-Cat-Door-for-Entry-Door/3166383",
4    "domain": "https://www.lowes.com",
5    "marketplace_pn": "3166383",
6    "sku": "3166383",
7    "other_pn": "729849109674",
8    "model_number": "HPA11-10967",
9    "gtin_ean_pn": "729849109674",
10    "product_name": "PetSafe 10-1/2-in x 15-in White Plastic Medium Dog/Cat Door for Entry Door",
11    "brand": "PetSafe",
12    "description": "10-1/2-in x 15-in White Plastic Medium Dog/Cat Door for Entry Door",
13    "date_first_available": "2023-07-07T17:45:01.222Z",
14    "badges": [
15      "item"
16    ],
17    "initial_price": 46,
18    "final_price": 46,
19    "discount": 0,
20    "currency": "USD",
21    "delivery_offers": [
22      {
23        "offer_description": "Store Pickup",
24        "offer_name": "Pickup"
25      },
26      {
27        "offer_description": "Truck Delivery",
28        "offer_name": "Delivery"
29      }
30    ],
31    "in_stock": true,
32    "availability": [
33      "Available"
34    ],
35    "delivery": [
36      "item"
37    ],
38    "seller_name": "PetSafe",
39    "seller_id": "6178",
40    "seller_url": null,
41    "root_category": "Animal & Pet Care",
42    "breadcrumbs ": [
43      {
44        "name": "Animal & Pet Care",
45        "url": "https://www.lowes.com/c/Animal-pet-care"
46      },
47      {
48        "name": "Pet Doors & Gates",
49        "url": "https://www.lowes.com/pl/Pet-doors-gates-Animal-pet-care/4294610550"
50      },
51      {
52        "name": "Pet Doors",
53        "url": "https://www.lowes.com/pl/Pet-doors-Pet-doors-gates-Animal-pet-care/4294610549"
54      }
55    ],
56    "main_image": "https://mobileimages.lowes.com/productimages/852460f9-2349-4601-8d78-f7fc2085b13f/00741528.jpg",
57    "image_urls": [
58      "https://mobileimages.lowes.com/productimages/af7147fe-871c-41c2-909f-8c9c152d885a/04946405.jpg",
59      "https://mobileimages.lowes.com/productimages/a9019575-8b1e-47a6-90ce-23f499a0f6d2/08870349.jpg",
60      "https://mobileimages.lowes.com/productimages/b39eccaf-7981-4f62-88f4-c1604722200e/49546683.jpg",
61      "https://mobileimages.lowes.com/productimages/983b6bba-ff73-4d7e-a2ee-52067cf222c0/49546684.jpg",
62      "https://mobileimages.lowes.com/productimages/71e208c8-6a09-42ac-9b6b-59ba22940d72/49546686.jpg",
63      "https://mobileimages.lowes.com/productimages/5adb79a7-d440-4e24-b890-0379f98e9050/49546685.jpg"
64    ],
65    "videos": [
66      "https://cdnapisec.kaltura.com/p/4215793/sp/421579300/playManifest/entryId/1_jl01wi43/format/applehttp/protocol/https"
67    ],
68    "rating": 4.1,
69    "reviews_count": 142,
70    "top_reviews": [
71      {
72        "description": "I wanted a doggie door that you could close by slipping the cover down through slots. This one is a plastic cover that isn't very easy to put on. Some people would have a hard time getting it on right. There are small plastic guides that hold it in place but I'm waiting for them to snap off.",
73        "name": "******",
74        "rating": 2,
75        "title": "Dog door cover is difficult"
76      },
77      {
78        "description": "If your walls are more than 6\" thick (and I believe the building code results in that happening (?) the mounting nuts & bolts are not long enough to go through your walls.  I had to return to Lowes' and purchase 6 NEW BOLTS in order to install the pet door.",
79        "name": "R B***ey ***mel***",
80        "rating": 1,
81        "title": "Tough job to mount..."
82      },
83      {
84        "description": "Pet safe makes a quality product. The head scratcher here is why would the flap be installed on the inside of the door? We were putting this on a storm door and installed the flap on the outside to better protect the door from the elements. We probably won’t use the snap on cover much but if we did, we would not choose this pet door because you would have to go outside to put it on. The nylon screws are genius, but the instructions to cut down the spacers seemed to be wrong. Our door was 7/8” thick but we had to cut about 1/16” off of the 1 3/4” for it to fit tight. Recommend cutting one and seeing if it fits right before you cut the rest.",
85        "name": "******",
86        "rating": 3,
87        "title": "nice but"
88      },
89      {
90        "description": "this used to be the top brand in pet doors for many years. They recently switched to using 2 1/2\"  nylon screws to attach both door sides to each other.  The screws are thin enough that the excess length can but cut flush with a knife, per Petsafe instructions.   I was really concerned that I might break a screw while tightening.  As a handyman I am abandoning the brand because the components are now so cheap its not worth risking a call back from a customer.",
91        "name": "Han***an ***n",
92        "rating": 2,
93        "title": "Nylon screws!!???"
94      },
95      {
96        "description": "There is no real 'body' or shaft of the doggie door. The interior and exterior frames can and will slide around independently. It's interior walls consist of these plastic cut-to-fit covers that are about as sturdy as Hot Wheels track. They snap in (sorta) to this shallow channel and you have to line it up with the exterior frame. One or all 4 of them fall out and you can repeat the fun over and over. Then screw the whole flimsy sandwich together with long bendable plastic bolts and tiny metal nuts. \nThe only reason I finished installing it is because I had just cut a hole in my door with their template!\nYou're gonna need caulking or silicone.",
97        "rating": 1,
98        "title": "Installation Nightmare!"
99      },
100      {
101        "description": "Very pleased with this PetSafe plastic door. I have 2 yorkies less than 10 lbs each. They say the small door is the correct size. I think they are nuts. I bought the medium, up to 40 lb dog, which is the perfect size. I don’t think my dogs would use the smaller door. The box has a picture of a collie using this medium door. There is no way a collie can fit through this door. Buy the next bigger size than they say. I installed this door into my very cheap, back yard, storm door. The cut-out I framed with 1x2 furring strip for added support (on the inside) due to my flimsy storm door. Otherwise, every time the dogs would use the doggie door, it would wobble in & out from them pushing their heads into the flap. This is working out great. I just open my exterior house door, then the dogs go through the pet door, in the storm door, & out into the fenced in yard. For the first 2 days I taped the flap up so the dogs would get used to going in and out of this little doorway. They caught on quick. Then I dropped the flap down. One dog understood what to do as soon as I bumped her head against the flap a few times. The other dog took several bumps and a couple days. I did switch the screws with the size I needed. I don’t trust the plastic screws that come with the pet-door.",
102        "name": "******",
103        "rating": 5,
104        "title": "My Yorkies Love It"
105      },
106      {
107        "description": "This is ABSOLUTE JUNK! First, the plastic inserts are a joke and they tell you to add 7/8s of an inch to your door thickness which is incorrect. It should be 3/4 of a inch.  Next, trying to assemble both sides, (the inner and outer pieces), is impossible with 1 person. Last, the PLASTIC, yes I said plastic screws you have to cut with wire cutters are a joke. If a small child or anyone else touches these it will cut them, this is  due to the angle your wire cutters cut them at. CHEAPLY MADE JUNK!!",
108        "name": "Cat***dy",
109        "rating": 1,
110        "title": "Cheap Made!!!!"
111      },
112      {
113        "description": "I replaced a cat door made by another company with this door. It's easy to install. However, the flap is not as draft free as the cat door. The cat door had a larger rim, the door part was a see through hard plastic with brush weather stripping on the sides which sealed completely - no draft when closed. This door has gaps on the sides because the flap is soft plastic. The dogs like the flap better because it doesn't snap back and hit them in the butt. The flap also doesn't make any noise as it closes. That is a big plus. But, the flap doesn't appear to be as durable as the hard plastic. I will have to see how long it lasts. Had the cat door in for 3 years and it cleaned up to look new. I reused it in my cat's apartment out in the backyard. This soft flap is just screwed into the plastic at the top of the rim. The cat door actually had a metal axle the door swung on. I can see where this door's design may not be durable, but it's only been in for a week. For $59 plus tax, I say it was over priced. It would be worth about $35 when you consider the materials and design. Cat door was $27. I'd have paid $59 for a bigger cat door but I couldn't find that same brand.",
114        "name": "******",
115        "rating": 4,
116        "title": "It's an okay door. The seal isn't the best."
117      },
118      {
119        "description": "This has one flimsy piece of plastic that swings to let the dog in, and the cold air.  Doesn’t do a very good job of keeping the elements out.  I would get one with the double swing plastic that has better magnets",
120        "name": "******",
121        "rating": 2,
122        "title": "Not very good with keeping out the cold"
123      },
124      {
125        "description": "Yay! Now I goes in and out as I please!\nMom installed my doggie door on an aluminum storm door. I'm glad she read Sadie's review; she said she used metal screws so Mom bought metal screws and didn't get mad when I chewed on the plastic screws that came in the box ( I chewed that too, hahaha)\nThe only downside is that Mom used to give me treats every time I goes through this new door but now she stopped???",
126        "name": "Cha***zeT***ava******",
127        "rating": 4,
128        "title": "Glad there was a tip about metal screws"
129      }
130    ],
131    "color": "White",
132    "other_attribute": "Let your dog take a potty break on their own schedule. Paintable white pet door frame to match your home decor. Snap-on panel to close the door. DIY installation into interior walls and doors or exterior doors. Use with wood, PVC, metal and paneled doors from 1/16 in - 2 in thick. 4 size options: small, medium, large and extra large",
133    "features": [
134      "Color/Finish Family: White",
135      "Manufacturer Color/Finish: White",
136      "Series Name: Plastic Pet Door",
137      "Overall Door Weight (lbs.): 2.5",
138      "Pet Door Thickness (Inches): 1.875",
139      "Recommended Pet Size: Medium",
140      "Application: Entry door",
141      "Lowe's Exclusive: No",
142      "Material: Plastic",
143      "Passage Opening (W x H): 8-1/8-in x 12-1/4-in",
144      "Pet Door Size (W x H): 10-1/2-in x 15-in",
145      "Pet Type: Dog/Cat",
146      "Rough Opening: 9.25x14",
147      "Use Location: Exterior",
148      "Warranty: 1-year limited",
149      "CA Residents: Prop 65 Warning(s): No"
150    ],
151    "dimensions": {
152      "depth": "13.19 Inches",
153      "height": "17.75 Inches",
154      "width": "2.375 Inches"
155    },
156    "weight": "2.55 lbs.",
157    "category_tree": [
158      "Animal & Pet Care",
159      "Pet Doors & Gates",
160      "Pet Doors"
161    ],
162    "variations": [],
163    "related_searches": [
164      "PetSafe Pet Doors",
165      "Dog Pet Doors",
166      "Entry door Pet Doors",
167      "Sliding door Pet Doors",
168      "Cat Pet Doors",
169      "Glass Pet Doors",
170      "Dog/Cat Pet Doors",
171      "Large Pet Doors",
172      "White Pet Doors",
173      "Ideal Pet Products Pet Doors",
174      "Small Pet Doors",
175      "French door Pet Doors",
176      "Steel Pet Doors",
177      "Plastic Pet Doors",
178      "Brown Pet Doors"
179    ],
180    "Specifications": [
181      {
182        "Specifications_root name": [
183          {
184            "specification_name": "Color/Finish Family",
185            "specification_value": "White"
186          },
187          {
188            "specification_name": "Manufacturer Color/Finish",
189            "specification_value": "White"
190          },
191          {
192            "specification_name": "Series Name",
193            "specification_value": "Plastic Pet Door"
194          },
195          {
196            "specification_name": "Overall Door Weight (lbs.)",
197            "specification_value": "2.5"
198          },
199          {
200            "specification_name": "Pet Door Thickness (Inches)",
201            "specification_value": "1.875"
202          },
203          {
204            "specification_name": "Recommended Pet Size",
205            "specification_value": "Medium"
206          },
207          {
208            "specification_name": "Application",
209            "specification_value": "Entry door"
210          },
211          {
212            "specification_name": "Lowe's Exclusive",
213            "specification_value": "No"
214          },
215          {
216            "specification_name": "Material",
217            "specification_value": "Plastic"
218          },
219          {
220            "specification_name": "Passage Opening (W x H)",
221            "specification_value": "8-1/8-in x 12-1/4-in"
222          },
223          {
224            "specification_name": "Pet Door Size (W x H)",
225            "specification_value": "10-1/2-in x 15-in"
226          },
227          {
228            "specification_name": "Pet Type",
229            "specification_value": "Dog/Cat"
230          },
231          {
232            "specification_name": "Rough Opening",
233            "specification_value": "9.25x14"
234          },
235          {
236            "specification_name": "Use Location",
237            "specification_value": "Exterior"
238          },
239          {
240            "specification_name": "Warranty",
241            "specification_value": "1-year limited"
242          },
243          {
244            "specification_name": "CA Residents: Prop 65 Warning(s)",
245            "specification_value": "No"
246          }
247        ]
248      }
249    ],
250    "customers_also_viewed": [
251      {
252        "price": 79.95,
253        "title": "10-1/2-in x 15-in White Aluminum Medium Dog/Cat Door for Entry Door",
254        "url": "https://www.lowes.com/pd/PetSafe-Aluminum-Medium-White-Aluminum-Pet-Door-Actual-12-25-in-x-8-25-in/3166387"
255      },
256      {
257        "price": 61.98,
258        "title": "12-1/2-in x 19-3/4-in White Plastic Large Dog/Cat Door for Entry Door",
259        "url": "https://www.lowes.com/pd/PetSafe-12-1-2-in-x-19-3-4-in-White-Plastic-Large-Dog-Cat-Door-for-Entry-Door/3166385"
260      },
261      {
262        "price": 36,
263        "title": "11-1/2-in x 11-1/2-in White Plastic Small Dog/Cat Door for Entry Door",
264        "url": "https://www.lowes.com/pd/PetSafe-Cat-Flap-Large-71-90-Lbs-White-Plastic-Pet-Actual-7-125-in/3166245"
265      },
266      {
267        "price": 17,
268        "title": "7-1/2-in x 8-in White Plastic Extra Small Dog/Cat Door for Entry Door",
269        "url": "https://www.lowes.com/pd/PetSafe-Cat-Flap-Small-White-Plastic-Pet-Door-Actual-5-75-in-x-5-75-in/3166271"
270      },
271      {
272        "price": 139.95,
273        "title": "14-1/4-in x 21-1/16-in White Plastic Large Dog/Cat Door for Wall",
274        "url": "https://www.lowes.com/pd/PetSafe-Wall-Entry-Pet-Door-Large/1001460434"
275      },
276      {
277        "price": 34,
278        "title": "8-15/16-in x 14-7/8-in Light Gray Plastic Medium Dog Door for Entry Door",
279        "url": "https://www.lowes.com/pd/Ideal-Pet-Products-Original-Designer-Medium-Light-Gray-Plastic-Pet-Actual-11-25-in-x-7-in/1002777670"
280      },
281      {
282        "price": 170.98,
283        "title": "15-7/16-in x 23-4/5-in Cream Plastic Large Dog Door for Wall",
284        "url": "https://www.lowes.com/pd/Ideal-Pet-Products-Large-71-90-lb-Dog-Cat-Cream-Plastic-Pet-Door/5014424745"
285      },
286      {
287        "price": 129.95,
288        "title": "12-1/4-in x 17-1/8-in White Plastic Medium Dog/Cat Door for Wall",
289        "url": "https://www.lowes.com/pd/PetSafe-Plastic-Pet-Actual-x-10-375-in/1001421228"
290      },
291      {
292        "price": 20.1,
293        "title": "8-13/16-in x 7-15/16-in White Plastic Extra Small Cat Door for Entry Door",
294        "url": "https://www.lowes.com/pd/Ideal-Pet-Products-Small-White-Plastic-Pet-Cat-Flap-Actual-6-25-in-x-6-25-in/1002682358"
295      },
296      {
297        "price": 25.65,
298        "title": "9-1/2-in x 15-in White Plastic Small Cat Door for Entry Door",
299        "url": "https://www.lowes.com/pd/Ideal-Pet-Products-Small-25-lb-or-Less-Cat-White-Plastic-Pet-Door/5014410647"
300      },
301      {
302        "price": 87.98,
303        "title": "13-3/4-in x 18-5/8-in White Plastic Large Dog Door for Entry Door",
304        "url": "https://www.lowes.com/pd/Ideal-Pet-Products-AirSeal-X-large-White-Plastic-Pet-Door-Actual-15-75-in-x-10-25-in/50040408"
305      },
306      {
307        "price": 56.48,
308        "title": "12-2/5-in x 18-5/8-in Light Gray Plastic Large Dog Door for Entry Door",
309        "url": "https://www.lowes.com/pd/Ideal-Pet-Products-Original-Designer-X-Large-Light-Gray-Plastic-Pet-Actual-15-in-x-10-5-in/1002777718"
310      },
311      {
312        "price": 134.95,
313        "title": "16-1/8-in x 27-1/2-in White Aluminum Extra Large Dog/Cat Door for Entry Door",
314        "url": "https://www.lowes.com/pd/PetSafe-Aluminum-X-Large-White-Aluminum-Pet-Door-Actual-23-75-in-x-13-75-in/3166391"
315      },
316      {
317        "price": 120.06,
318        "title": "12-1/2-in x 19-3/4-in White Plastic Large Dog/Cat Door for Entry Door",
319        "url": "https://www.lowes.com/pd/PetSafe-White-Plastic-Large-Dog-Door/1002941920"
320      },
321      {
322        "price": 104.95,
323        "title": "12-3/4-in x 19-13/20-in White Aluminum Large Dog/Cat Door for Entry Door",
324        "url": "https://www.lowes.com/pd/PetSafe-12-3-4-in-x-19-13-20-in-White-Aluminum-Large-Dog-Cat-Door-for-Entry-Door/3166389"
325      }
326    ],
327    "better_together": [
328      {
329        "price": 46,
330        "title": "PetSafe 10-1/2-in x 15-in White Plastic Medium Dog/Cat Door for Entry Door",
331        "url": "https://www.lowes.com/pd/PetSafe-10-1-2-in-x-15-in-White-Plastic-Medium-Dog-Cat-Door-for-Entry-Door/3166383"
332      },
333      {
334        "price": 18,
335        "title": "M-D 13-ft x 1-in Expand N' Seal Foam Window Weatherstrip",
336        "url": "https://www.lowes.com/pd/M-D-13-ft-Expand-N-Seal-Foam-Window-Weatherstrip/3434324"
337      },
338      {
339        "price": 30,
340        "title": "BLACK+DECKER 4.5-Amp Variable Speed Keyless Corded Jigsaw",
341        "url": "https://www.lowes.com/pd/BLACK-DECKER-4-5-Amp-Keyless-T-or-U-Shank-Variable-Speed-Corded-Jigsaw/1000601429"
342      },
343      {
344        "price": 10,
345        "title": "Bosch Set T-shank High-carbon Steel Blade Set (10-Pack)",
346        "url": "https://www.lowes.com/pd/Bosch-10-Pack-T-shank-High-carbon-Steel-Jigsaw-Blade-Set/50222741"
347      }
348    ]
349  }
350]

Use Cases

E-commerce Analysis: Analyze competitor pricing, reviews, and product details.

Market Research:

Study related products, availability, and customer preferences.

Product Cataloging:

Extract detailed specifications for inventory management.

Why Use This Scraper?

Comprehensive Data: Extracts detailed product specifications, reviews, and media. Accurate and Efficient: Designed for large-scale product scraping with minimal errors. Versatile Applications: Useful for e-commerce, inventory management, and competitive analysis.