Shopify Products Scraper: Full Catalogue from Any Store Domain

Shopify Products Scraper extracts the full public catalogue from one or more Shopify store domains. It calls Shopify's native /products.json storefront endpoint, paginates automatically, and returns one structured row per product with prices, sale status, stock flags, images, variants, tags, and timestamps.

Use it for competitor price monitoring, catalogue tracking, product research, or multi-store comparison; it needs no collection URLs and no browser.

Why use the Shopify Products Scraper?

Most Shopify scrapers need collection URLs or product-page URLs. This actor starts from the store domain, reads Shopify's public product feed, and returns a normalized dataset ready for CSV, Excel, BigQuery, dashboards, or downstream Apify actors.

Capability	Collection scrapers	Browser scrapers	Shopify Products Scraper
Input needed	One URL per collection	Product page URLs	Store domain only
Catalogue coverage	Depends on collections	Page by page	Automatic /products.json pagination
Multi-store runs	Separate runs	Separate runs	Multiple domains in one run
Speed and cost	Medium	Slower and costlier	Direct HTTP requests
Compare-at prices	Often missing	Unreliable	Native Shopify field
API key	Sometimes required	Not required	Not required

store domain -> Shopify /products.json pages -> normalized product rows -> Apify dataset/API

What data does the Shopify Products Scraper extract?

Each row is one product. Nullable fields return null; list fields return arrays.

Fields	What they mean
store, title, vendor, url	Source domain, product title, merchant brand, and product page URL
featuredImage, imageCount, imageAltTexts	First image URL, image count, and non-empty alt texts
currency, priceMin, priceMax, compareAtPrice, onSale	ISO 4217 currency, lowest and highest variant price, highest compare-at price (or null), and whether any variant is discounted
available, fullyOutOfStock, requiresShipping	Whether any variant is in stock, every variant is out of stock, or shipping is required
variantCount, options, weightAndUnit	Variant count, option names (Size, Color), and first-variant weight in grams
productType, tags, description	Merchant product type, Shopify tags, and plain-text description with HTML stripped
publishedAt, updatedAt, runId	Publish and update timestamps, plus optional parent run ID from input

What can you do with Shopify product data?

• Competitor price monitoring: schedule daily or weekly runs and compare priceMin, priceMax, compareAtPrice, and onSale to detect discounts and promotion patterns.
• Inventory and stock tracking: monitor available and fullyOutOfStock to spot stockouts, restocks, and products that sell out often.
• Product research and assortment analysis: audit product counts, brands, types, tags, variant counts, and price bands for category and supplier research.
• Multi-store comparison: add several domains in one run; the store field on every row removes the need for extra joins.
• New product detection: run on a schedule and filter by publishedAt, or diff consecutive datasets, to find new and changed listings.

How do I scrape all products from a Shopify store?

1. Enter one or more store domains, such as gymshark.com or deathwishcoffee.com.
2. Set Max Products per store: 50 to test, 500 for a sample, or 0 for the full catalogue.
3. Leave proxy disabled unless a store returns HTTP 403.
4. Start the actor and export the dataset as JSON, CSV, Excel, or through the Apify API.

What input does the Shopify Products Scraper need?

{
  "domains": ["gymshark.com", "deathwishcoffee.com"],
  "maxProducts": 500,
  "proxyConfiguration": { "useApifyProxy": false }
}

Field	Type	Default	Description
domains	Array	required	Shopify store domains. Accepts bare hostnames, full URLs, and .myshopify.com subdomains.
maxProducts	Number	0	Maximum products per store. 0 means no limit. Pages are fetched in batches of 250.
proxyConfiguration	Object	disabled	Proxy settings. Enable Apify Proxy Residential only when a domain returns HTTP 403.
datasetId	String	optional	Existing Apify dataset ID to append rows to alongside the default dataset.
runId	String	optional	Parent run ID copied into each output row for pipeline traceability.

What does the output look like?

The actor returns one dataset item per product.

{
  "store": "gymshark.com",
  "vendor": "Gymshark",
  "title": "Vital Seamless 2.0 Shorts",
  "url": "https://gymshark.com/products/vital-seamless-2-0-shorts",
  "featuredImage": "https://cdn.shopify.com/vital-seamless-shorts.jpg",
  "currency": "GBP",
  "priceMin": 45,
  "priceMax": 45,
  "compareAtPrice": null,
  "onSale": false,
  "available": true,
  "fullyOutOfStock": false,
  "variantCount": 8,
  "options": ["Size"],
  "productType": "Shorts",
  "tags": ["bottoms", "seamless", "training"],
  "publishedAt": "2023-06-14T09:00:00Z"
}

How do I run the Shopify Products Scraper via API?

Trigger a run with curl:

curl -X POST "https://api.apify.com/v2/acts/trovevault~shopify-products-scraper/runs" \
  -H "Authorization: Bearer YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains":["gymshark.com"],"maxProducts":500}'

Run with the JavaScript client and read the dataset:

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });

const run = await client.actor('trovevault~shopify-products-scraper').call({
    domains: ['gymshark.com'],
    maxProducts: 500,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items.slice(0, 3));

You can also call the actor from any MCP-compatible AI assistant through the Apify MCP server.

How do I fix common Shopify scraping errors?

Issue	Solution
HTTP 403 or IP blocked	Enable Apify Proxy with the Residential group in proxyConfiguration. Large brands block datacenter IP ranges.
HTTP 404 on /products.json	The actor tries three fallbacks: scan the homepage for a .myshopify.com domain, try the parent domain, and guess the Shopify subdomain. If all fail, the site may not be Shopify.
Fewer products than expected	Only the public storefront catalogue is exposed. Draft, hidden, password-protected, and wholesale-only products never appear.
Currency is null	Currency is read from /cart.js. If a store blocks that endpoint, rows still return but the currency is unconfirmed.
Network errors or timeouts	Retry with a lower maxProducts, then enable the Residential proxy and check the run log.

Need help? Open the Issues tab with the run ID, input domain, and log error.

FAQ

Does it return variant-level rows? No. It returns one row per product. Variant data is summarized with variantCount, options, prices, availability, shipping, and weight.

Can I scrape several stores at once? Yes. Add multiple domains to domains; each row includes the store field.

Can I append output to an existing dataset? Yes. Pass datasetId to append rows to an existing dataset, and runId to link rows to a parent pipeline run.

Can I use this through an AI assistant or the API? Yes. Use the Apify API, the JavaScript client, or the Apify MCP server from any MCP-compatible assistant.

Is scraping Shopify product data legal? The actor requests public storefront endpoints. Accessing public data is generally lawful, but review the target site's terms and your use case.

What are the limitations of the Shopify Products Scraper?

• One row per product, not per variant or SKU.
• Only public Shopify catalogue data is returned; headless, password-protected, wholesale, or restricted stores may not expose /products.json.
• compareAtPrice appears only when the merchant sets compare-at pricing, and currency may be null when /cart.js is unavailable.
• The actor does not crawl non-Shopify platforms such as WooCommerce, Magento, BigCommerce, or Amazon.

Related actors

• WooCommerce Products Scraper for WooCommerce product catalogues.
• E-Commerce Tech Stack Detector to identify a store platform before scraping.

Changelog

v0.1

• Full catalogue scraping from Shopify /products.json
• Automatic pagination and multi-store input
• Domain fallback for custom, regional, and .myshopify.com domains
• Structured output with prices, stock flags, images, variants, tags, and timestamps