Shopify Store Scraper — Full Product Catalog Exporter

Extract complete product catalogs from any Shopify store without API keys. Uses Shopify's built-in JSON API with Playwright HTML fallback. Extracts titles, prices, variants, images, tags, vendors, and availability for competitive research.

How It Works

The actor first tries Shopify's public products.json API, paginating through 250-product batches until it reaches your limit or hits three empty pages in a row. For each product it parses the title, handle, product URL, price, compare-at price, vendor, product type, tags, sanitized HTML description, full variant list (title, price, SKU, stock status), and image URLs. If the JSON API returns nothing, it falls back to a Playwright crawler that walks the /collections/all page and extracts product cards from the rendered HTML. The complete catalog is pushed to the dataset along with a price summary for downstream analysis.

Features

• No API keys needed: Works with any Shopify store domain
• Dual extraction method: Shopify JSON API (fast) with Playwright HTML fallback
• Full variant support: Size, color, and other variant data
• Complete catalog: All products, not just the first page
• Availability tracking: In-stock and out-of-stock status
• Image extraction: Product image URLs for visual analysis

Input Parameters

Parameter	Type	Default	Description
storeDomain	string	example.myshopify.com	Shopify store URL
maxProducts	integer	100	Max products (1-5000)
includeVariants	boolean	true	Include product variants
includeImages	boolean	false	Include image URLs
outputFormat	string	json	Export format
proxyConfiguration	object	Apify Proxy	Proxy for reliable scraping

Output Example

{
  "title": "Organic Cotton Hoodie",
  "handle": "organic-cotton-hoodie",
  "productUrl": "https://example.myshopify.com/products/organic-cotton-hoodie",
  "price": 68.00,
  "compareAtPrice": 89.00,
  "currency": "USD",
  "availability": "In Stock",
  "vendor": "EcoThreads",
  "productType": "Hoodie",
  "tags": ["organic", "cotton", "unisex", "sale"],
  "description": "Soft 100% organic cotton hoodie with brushed interior and metal-tipped drawcords.",
  "variants": [
    { "title": "Small / Black", "price": 68.00, "sku": "HOD-BLK-S", "available": true },
    { "title": "Medium / Black", "price": 68.00, "sku": "HOD-BLK-M", "available": true },
    { "title": "Large / Black", "price": 68.00, "sku": "HOD-BLK-L", "available": false }
  ],
  "images": ["https://cdn.shopify.com/s/files/1/0500/0001/products/hoodie-front.jpg"],
  "scrapedAt": "2026-07-27T11:42:00.000Z"
}

Use Cases

• Competitive research: Download competitor product catalogs for analysis
• Dropshipping research: Find winning products across Shopify stores
• Price monitoring: Track competitor pricing strategies
• Product research: Identify trending products and best-sellers

Cost Estimate

• 100 products: ~$1.00
• 1000 products: ~$5.00
• 5000 products: ~$20.00