⚡ Shopify Product Scraper – Ultra-Fast Full-Catalog Extractor

This Apify actor scrapes complete product catalogs from any Shopify-powered store at lightning speed.

It accesses Shopify’s public products.json API, bypassing slow HTML parsing and browser overhead. It supports bulk store URLs, auto-handles pagination (250 products/page), maps variants to images, extracts gendered size lists, and outputs a clean, structured dataset.

---

Get 10k Products For Just 0.09$ and in 7-8 Mins

---

🚀 What It Does

For every product in a Shopify store, the actor extracts:

• 🆔 Product ID & Handle

• 📦 Title & Clean Description

• 💰 Price Range (min/max & currency)

• 🏷️ Vendor, Type & Tags

• 🎨 Options (Color, Size, Material, etc.)

• 🖼️ High-resolution images

• 📅 Created / Updated / Published dates

• 🔢 Variant Summary

  • total variants
  • available count
  • percent available

• 👟 Smart Size Lists

  • Men’s Available Sizes
  • Women’s Available Sizes
  • Unisex sizes

• 📋 Full Variant Breakdown

  • SKU
  • Title
  • Size / Color
  • Price & Compare-at Price
  • Stock availability
  • Variant image

---

⚡ It Handles

• ✅ Bulk Shopify store URLs
• 🔄 Automatic pagination (250 products per page)
• 🧹 Smart data cleaning (gender detection, size grouping)
• 🎨 Variant → Image mapping
• ⚡ 10x–50x faster than browser scrapers
• 🌐 Automatic Apify Proxy (no config needed)
• 🛡️ Retry & error handling
• 📦 Dataset is cleaned and structured before saving

---

🧠 How It Works

1. Loads your Shopify store URLs

2. Appends /products.json with pagination parameters

3. Fetches products in batches of 250

4. Continues until all pages are completed

5. Normalizes the data:

   • maps variants
   • extracts gender
   • builds readable size lists
   • generates min/max price range

6. Saves all product data in a consistent, structured format

7. (Optional) Stops early if maxItems limit is reached

---

⚙️ Input Configuration

Field	Type	Description	Example Value
startUrls	Array	Shopify store URLs to scrape	["https://allbirds.com", "https://gymshark.com"]
maxItems	Integer	Optional product limit per store (0 = unlimited)	1000
proxyConfiguration	Object	Proxy settings (Apify Proxy recommended / default)	{ "useApifyProxy": true }

---

🧩 Example Input

{
  "startUrls": [{ "url": "https://www.allbirds.com" }],
  "maxItems": 500,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

---

📊 Example Output

{
  "sourceUrl": "https://www.allbirds.com",
  "productId": 7193764298832,
  "title": "Women's Tree Dasher 2 - Rugged Beige (Stony Cream Sole)",
  "handle": "womens-tree-dashers-rugged-beige-stony-cream",
  "url": "https://www.allbirds.com/products/womens-tree-dashers-rugged-beige-stony-cream",
  "description": "The Tree Dasher 2 is the next evolution of our everyday active shoe with more responsive foam, extra grip, and an improved fit to keep you moving, and nature winning.",
  "gender": "Women's",
  "vendor": "Allbirds",
  "type": "Shoes",
  "tags": [
    "allbirds::carbon-score => 5.48",
    "allbirds::cfId => color-3aed57948cd5460f448555993790ea71",
    "allbirds::complete => true",
    "allbirds::edition => limited",
    "allbirds::gender => womens",
    "allbirds::hue => beige",
    "allbirds::master => womens-tree-dashers",
    "allbirds::material => tree",
    "allbirds::price-tier => tier-2",
    "allbirds::silhouette => dasher",
    "allbirdskit::kit-discount-20whQOueHm7zwKfR8Csr2c => 23",
    "allbirdskit::kit-id => 20whQOueHm7zwKfR8Csr2c",
    "allbirdskit::kit-size-20whQOueHm7zwKfR8Csr2c => 2",
    "loop::returnable => true",
    "shoprunner",
    "YCRF_womens-perform-shoes",
    "YGroup_ygroup_womens-tree-dashers"
  ],
  "Women's Available Sizes": ["5"],
  "color": "Rugged Beige",
  "options": [
    {
      "name": "Color",
      "values": ["Rugged Beige"]
    },
    {
      "name": "Size",
      "values": [
        "5",
        "5.5",
        "6",
        "6.5",
        "7",
        "7.5",
        "8",
        "8.5",
        "9",
        "9.5",
        "10",
        "10.5",
        "11"
      ]
    }
  ],
  "images": [
    {
      "id": 34335036670032,
      "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474",
      "alt": null,
      "width": 2000,
      "height": 2000
    },
    {
      "id": 34335036637264,
      "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_BACK-2000x2000_e77818fa-1038-4cca-8b96-a564cdcf8960.png?v=1751563474",
      "alt": null,
      "width": 2000,
      "height": 2000
    },
    {
      "id": 34335036440656,
      "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_TD-2000x2000_fd13bfa7-dcd1-4dac-a939-9860862c97fc.png?v=1751563474",
      "alt": null,
      "width": 2000,
      "height": 2000
    },
    {
      "id": 34335036506192,
      "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_SOLE-2000x2000_582b853d-df2d-499c-93d2-64bb69938a10.png?v=1751563474",
      "alt": null,
      "width": 2000,
      "height": 2000
    },
    {
      "id": 34335036538960,
      "src": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_PAIR_3Q-2000x2000_2c410820-4cd1-4c7e-ac65-5d2af3352c7b.png?v=1751563474",
      "alt": null,
      "width": 2000,
      "height": 2000
    }
  ],
  "publishedAt": "2025-12-02T10:16:17-08:00",
  "createdAt": "2025-07-03T10:24:31-07:00",
  "updatedAt": "2025-12-07T01:58:27-08:00",
  "priceRange": {
    "min": 94,
    "max": 94,
    "currency": "USD"
  },
  "variantsSummary": {
    "total": 13,
    "available": 1,
    "percentAvailable": "7.69%"
  },
  "variants": [
    {
      "id": 41222412238928,
      "sku": "A11850W050",
      "title": "Rugged Beige / 5",
      "size": "5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": true,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412271696,
      "sku": "A11850W055",
      "title": "Rugged Beige / 5.5",
      "size": "5.5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412304464,
      "sku": "A11850W060",
      "title": "Rugged Beige / 6",
      "size": "6",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412337232,
      "sku": "A11850W065",
      "title": "Rugged Beige / 6.5",
      "size": "6.5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412370000,
      "sku": "A11850W070",
      "title": "Rugged Beige / 7",
      "size": "7",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412402768,
      "sku": "A11850W075",
      "title": "Rugged Beige / 7.5",
      "size": "7.5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412435536,
      "sku": "A11850W080",
      "title": "Rugged Beige / 8",
      "size": "8",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412468304,
      "sku": "A11850W085",
      "title": "Rugged Beige / 8.5",
      "size": "8.5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412501072,
      "sku": "A11850W090",
      "title": "Rugged Beige / 9",
      "size": "9",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412533840,
      "sku": "A11850W095",
      "title": "Rugged Beige / 9.5",
      "size": "9.5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412566608,
      "sku": "A11850W100",
      "title": "Rugged Beige / 10",
      "size": "10",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412599376,
      "sku": "A11850W105",
      "title": "Rugged Beige / 10.5",
      "size": "10.5",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    },
    {
      "id": 41222412632144,
      "sku": "A11850W110",
      "title": "Rugged Beige / 11",
      "size": "11",
      "color": "Rugged Beige",
      "price": "94.00",
      "compareAtPrice": "135.00",
      "available": false,
      "inventoryQuantity": "HIDDEN",
      "image": "https://cdn.shopify.com/s/files/1/1104/4168/files/A11849_25Q3_Tree_Dasher_2_Rugged_Beige_Stony_Cream_Sole_PDP_LEFT-2000x2000_8531eba4-0608-48f3-9504-bb5838c6cca6.png?v=1751563474"
    }
  ]
}

If a store blocks product access:

{
  "sourceUrl": "https://blocked-store.com",
  "error": "Shopify API disabled or store not accessible."
}

---

🧠 Features

• ⚡ Zero-browser scraping (API-only)
• 📦 Complete catalog extraction
• 👟 Smart size detection (men/women/unisex)
• 🔄 Correct variant → image pairing
• 🚀 Extremely fast & resource-efficient
• 🌐 Automatic Apify Proxy rotation
• 🛡️ Anti-block retry logic
• 📦 Clean, normalized output schema

---

💡 Use Cases

• Competitor price tracking
• Inventory monitoring (in/out-of-stock)
• Product trend analysis
• Dropshipping research
• SEO audits for ecommerce stores
• Bulk catalog downloading

---

❓ FAQs

1. Does this work on all Shopify stores?

Yes — it works on any public Shopify store that has not disabled /products.json (almost all stores).

2. Can I scrape password-protected stores?

No — only public stores are supported.

3. How fast is it?

Extremely fast. A 5,000 product store can often be scraped in under one minute.

4. Why is inventoryQuantity always “HIDDEN”?

Shopify stopped exposing exact inventory counts in 2018. However, available: true/false is 100% accurate.

5. Do I need to configure a proxy?

No — Apify Proxy is used automatically.

---

🧑‍💻 Developer Info

Author: codescraper Email: codescraper011@gmail.com

---

🏷️ Tags

shopify · shopify-product-scraper · shopify-scraper · e-commerce · product-scraper fast-shopify-product-scraper · inventory-tracker · price-monitor