🛍️ Shopify Product & Catalog Scraper (Fast HTTP API)

Extract complete product catalogs, collections, single products, variant matrices, pricing, stock levels, options, barcodes, and high-resolution images from any public Shopify e-commerce store worldwide.

Built with pure HTTP requests and TLS fingerprint impersonation (curl_cffi) — 100x faster and 95% cheaper than headless browser scrapers (Puppeteer/Playwright).

---

⚡ Key Features

• 🚀 Ultra-Fast HTTP Engine: Extracts up to 250 products per HTTP request with zero browser overhead.
• 🛡️ WAF & Cloudflare Bypass: Emulates modern Chrome TLS and HTTP/2 fingerprints to prevent 403 / 429 blocks.
• 🎯 Universal Shopify Support: Works seamlessly on standard .myshopify.com stores as well as custom domains.
• 🔄 Flexible Target Inputs:
  • Full Store Catalogs: e.g. https://gymshark.com or colourpop.com
  • Specific Collections: e.g. https://colourpop.com/collections/eyes
  • Single Product URLs: e.g. https://allbirds.com/products/mens-tree-runners
  • Search Queries: Search across any store using predictive keywords.
• 📊 Nested or Flattened Output:
  • Nested Format: 1 record per product with complete variants array and image galleries.
  • Flattened Format (flattenVariants): 1 record per SKU/variant with parent product data attached (ideal for Excel / Google Sheets / SQL databases).
• 🔍 Precision Filters:
  • Filter by minimum/maximum price.
  • In-stock only filter (inStockOnly).
  • Plain text and raw HTML descriptions.
• 🤖 AI & MCP Ready: Defined output schema compatible with Apify Model Context Protocol (MCP) agents.

---

📥 Input Parameters

Parameter	Type	Default	Description
startUrls	Array	[]	List of Shopify URLs (store roots, collection pages, or single product pages).
domains	Array	[]	List of store domains (e.g. ["colourpop.com", "allbirds.com"]).
collections	Array	[]	Specific collection handles to scrape (e.g. ["eyes", "mens-shoes"]).
searchQueries	Array	[]	Keywords to search across target stores.
maxItems	Integer	100	Maximum items to scrape per target.
maxPages	Integer	10	Maximum pagination pages to fetch (250 products/page).
flattenVariants	Boolean	false	If true, outputs 1 row per variant/SKU for tabular analysis.
inStockOnly	Boolean	false	Filter out items that are out of stock.
minPrice	Number	null	Filter products with price $\ge$ minPrice.
maxPrice	Number	null	Filter products with price $\le$ maxPrice.
includeRawHtml	Boolean	false	Include raw HTML description alongside clean text.
proxyConfiguration	Object	{}	Apify Proxy settings (Datacenter / Residential).

---

📤 Sample Output Data

Standard Product (Nested Variants):

{
  "id": 6806925705418,
  "title": "Conditioning Club Tank - Heavy Blue",
  "handle": "gymshark-conditioning-club-tank-blue",
  "url": "https://gymshark.com/products/gymshark-conditioning-club-tank-blue",
  "vendor": "Gymshark",
  "product_type": "Mens > Sleeveless Tops",
  "tags": ["conditioning", "sleeveless", "blue", "summer-2026"],
  "description": "THE HYBRID ATHLETE'S UNIFORM\nLightweight & sweat-wicking to keep you cool under pressure.\nOversized fit.\n100% Recycled Polyester.",
  "min_price": 28.00,
  "max_price": 28.00,
  "compare_at_price": 35.00,
  "is_on_sale": true,
  "discount_percentage": 20.0,
  "is_available": true,
  "variants_count": 5,
  "options": [
    {
      "name": "Size",
      "position": 1,
      "values": ["S", "M", "L", "XL", "XXL"]
    }
  ],
  "variants": [
    {
      "id": 40182391823,
      "title": "M",
      "sku": "A2B4U-UFLJ-M",
      "barcode": "5059523091823",
      "price": 28.00,
      "compare_at_price": 35.00,
      "discount_percentage": 20.0,
      "available": true,
      "weight_grams": 180.0,
      "option1": "M",
      "image_url": "https://cdn.shopify.com/s/files/1/0156/6146/products/tank_blue.jpg"
    }
  ],
  "images": [
    {
      "id": 289381928,
      "src": "https://cdn.shopify.com/s/files/1/0156/6146/products/tank_blue.jpg",
      "width": 1200,
      "height": 1600,
      "alt": "Front view of model wearing blue tank"
    }
  ],
  "featured_image": "https://cdn.shopify.com/s/files/1/0156/6146/products/tank_blue.jpg",
  "published_at": "2026-08-20T10:50:00-07:00",
  "domain": "gymshark.com",
  "store_url": "https://gymshark.com",
  "scraped_at": "2026-08-23T01:20:00.000000+00:00"
}

---

💡 Practical Use Cases

1. Competitor Price & Assortment Monitoring: Track competitors' pricing drops, sales discounts, and new arrivals automatically.
2. Catalog Aggregation & Dropshipping: Sync entire supplier catalogs with SKUs, barcodes, and inventory states.
3. Market Research & Trend Analysis: Discover top-selling product types, color palettes, and pricing distributions.
4. AI & RAG Enrichment: Feed clean product catalogs directly into LLM embeddings and AI shopping advisors.