# Shopify Products Scraper (`fetch_cat/shopify-products-scraper`) Actor Scrape public Shopify product catalogs with variants, prices, images, vendors, tags, and availability from one or more storefronts. - **URL**: https://apify.com/fetch\_cat/shopify-products-scraper.md - **Developed by:** [Hanna Nosova](https://apify.com/fetch_cat) (community) - **Categories:** E-commerce, Automation, Integrations - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.02 / 1,000 product scrapeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shopify Products Scraper Extract public product catalogs from Shopify storefronts. Use this actor to collect product titles, handles, prices, compare-at prices, variants, images, vendors, product types, tags, availability, and source URLs from one or more Shopify stores. ### What does Shopify Products Scraper do? Shopify Products Scraper turns public storefront catalogs into clean datasets. It accepts Shopify store homepages and returns one row per product. You can run a quick sample for a single brand or collect larger catalogs across multiple stores. The output is designed for spreadsheets, dashboards, price monitoring, product intelligence, and catalog QA. ### Who is it for? ๐Ÿ›’ Ecommerce analysts use it to compare product catalogs across brands. ๐Ÿ“ˆ Agencies use it to build market and assortment reports for clients. ๐Ÿท๏ธ Brand operators use it to audit pricing, variants, images, and availability. ๐Ÿค– Automation teams use it to feed product data into workflows, alerts, and databases. ๐Ÿงพ Researchers use it to create structured product datasets without manual copying. ### Why use this actor? It is simple: enter storefront domains and get product rows. It supports multi-store runs. It saves variant-level prices and availability when requested. It includes image URLs for merchandising review. It returns clear error rows when a store does not expose a public catalog. It can be scheduled from Apify, called from an API, or connected to integrations. ### Typical use cases Price monitoring across competing Shopify stores. Assortment tracking for categories, tags, product types, or vendors. Variant and SKU exports for catalog review. Image URL extraction for merchandising audits. Availability checks for products and variants. New product discovery from public storefront catalogs. ### Input overview The main input is `storeUrls`. You can enter URLs such as `https://www.deathwishcoffee.com`. The actor normalizes each value to a storefront origin before scraping. ### Input fields | Field | Type | Description | | --- | --- | --- | | `storeUrls` | array | Shopify storefront URLs or domains to scrape. | | `maxProductsPerStore` | integer | Maximum products to save from each store. | | `includeVariants` | boolean | Include variant details such as SKU, price, and availability. | | `includeImages` | boolean | Include product image URLs and dimensions. | | `includeRawProduct` | boolean | Include the raw product payload for advanced processing. | | `proxyConfiguration` | object | Optional proxy settings for stores that block direct requests. | ### Example input ```json { "storeUrls": [ { "url": "https://www.deathwishcoffee.com" }, { "url": "https://www.brooklinen.com" } ], "maxProductsPerStore": 25, "includeVariants": true, "includeImages": true, "includeRawProduct": false } ```` ### Output overview The default dataset contains one row per product. If a store cannot be read, the dataset includes an error row for that store. Successful product rows have `status` set to `success`. Store failure rows have `status` set to `error` and include `errorMessage`. ### Output fields | Field | Description | | --- | --- | | `status` | `success` or `error`. | | `storeUrl` | Normalized store origin. | | `storeDomain` | Store hostname. | | `productId` | Shopify product ID. | | `title` | Product title. | | `handle` | Product handle. | | `url` | Product page URL. | | `vendor` | Product vendor. | | `productType` | Product type. | | `tags` | Product tags. | | `publishedAt` | Product publish timestamp when available. | | `updatedAt` | Product update timestamp when available. | | `priceMin` | Lowest variant price. | | `priceMax` | Highest variant price. | | `compareAtPriceMin` | Lowest compare-at price. | | `compareAtPriceMax` | Highest compare-at price. | | `currency` | Currency when inferable. | | `available` | True if at least one variant is available. | | `variantCount` | Number of variants. | | `imageCount` | Number of images. | | `variants` | Optional variant detail array. | | `images` | Optional image detail array. | | `sourceUrl` | Catalog page used for this product. | | `scrapedAt` | Timestamp of extraction. | | `errorMessage` | Error text for failed stores. | | `rawProduct` | Optional original product object. | ### Variant fields Variant objects can include ID, title, SKU, price, compare-at price, availability, and selected options. This is useful when a product has sizes, colors, bundles, or subscriptions. Variant fields can be disabled to keep datasets smaller. ### Image fields Image objects can include ID, URL, alt text, width, height, and position. Image fields can be disabled when you only need pricing and catalog metadata. ### How much does it cost to scrape Shopify products? This actor uses pay-per-event pricing. There is a small start charge for each run. Each successfully saved product is charged as a product result. Keep the first run small by using the default prefill or a low `maxProductsPerStore` value. Large catalogs cost more because they produce more product rows. ### How to run in Apify Console Open the actor page. Click **Try for free** or **Start**. Paste one or more Shopify store URLs. Choose the maximum products per store. Select whether to include variants and images. Start the run. Download results from the Dataset tab as JSON, CSV, Excel, XML, or RSS. ### Tips for best results Start with one store and a small product limit. Increase `maxProductsPerStore` after confirming the store returns the expected data. Use full storefront domains instead of product URLs. Disable raw product output unless you need original source payloads. Disable images or variants if you want smaller exports. Check `status` and `errorMessage` for stores that do not expose a public catalog. ### Handling stores that fail Some Shopify stores disable public catalog access. Some stores use security rules that block automated catalog requests. This actor reports those stores as error rows instead of hiding failures. For failed stores, try a smaller run first and verify the domain is the storefront homepage. If a store still fails, it may not support public catalog extraction. ### Scheduling workflows You can schedule the actor daily, weekly, or monthly in Apify. Scheduled runs are useful for price monitoring. They are also useful for detecting catalog changes, new products, or availability updates. Export each run to your warehouse or compare datasets between runs. ### Integrations Send product rows to Google Sheets for category review. Send price and availability changes to Slack alerts. Load datasets into BigQuery, Snowflake, or PostgreSQL. Trigger Make or Zapier workflows after each run. Use webhooks to notify your own backend when a catalog scrape finishes. ### API usage with Node.js ```js import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('fetch_cat/shopify-products-scraper').call({ storeUrls: [{ url: 'https://www.deathwishcoffee.com' }], maxProductsPerStore: 25, includeVariants: true, includeImages: true }); console.log(run.defaultDatasetId); ``` ### API usage with Python ```python from apify_client import ApifyClient import os client = ApifyClient(os.environ['APIFY_TOKEN']) run = client.actor('fetch_cat/shopify-products-scraper').call(run_input={ 'storeUrls': [{'url': 'https://www.deathwishcoffee.com'}], 'maxProductsPerStore': 25, 'includeVariants': True, 'includeImages': True, }) print(run['defaultDatasetId']) ``` ### API usage with cURL ```bash curl -X POST "https://api.apify.com/v2/acts/fetch_cat~shopify-products-scraper/runs?token=$APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"storeUrls":[{"url":"https://www.deathwishcoffee.com"}],"maxProductsPerStore":25}' ``` ### MCP usage Use Apify MCP with Claude Code, Claude Desktop, or compatible tools. MCP URL format: ```text https://mcp.apify.com/?tools=fetch_cat/shopify-products-scraper ``` Add it in Claude Code: ```bash claude mcp add apify-shopify-products "https://mcp.apify.com/?tools=fetch_cat/shopify-products-scraper" ``` Claude Desktop JSON configuration: ```json { "mcpServers": { "apify-shopify-products": { "url": "https://mcp.apify.com/?tools=fetch_cat/shopify-products-scraper" } } } ``` Example prompts: - "Scrape 25 products from deathwishcoffee.com and summarize price ranges." - "Compare vendors and product types from these three Shopify stores." - "Find products with compare-at prices and list discount candidates." ### Data quality notes Prices are returned as numbers when present. Currency is only filled when it can be inferred. Availability is summarized from variant availability. Product tags are normalized into an array. Product URLs are built from the storefront domain and product handle. ### Limits The actor targets public Shopify storefront data. It does not log in to stores. It does not bypass hard security walls. It does not guarantee that every Shopify store exposes a public catalog. Very large catalogs may require higher `maxProductsPerStore` values and longer run time. ### Legality Only scrape public storefront data that you are allowed to process. Respect applicable laws, website terms, and privacy obligations. Do not use exported data for spam, deceptive practices, or prohibited profiling. If you are unsure about your use case, consult your legal advisor. ### Troubleshooting #### Why did a store return an error row? The store may not expose a public catalog, may block automated requests, or may not be a Shopify storefront. Verify the domain in a browser and try a small run first. #### Why are there fewer products than expected? The store may have fewer public products than expected, hidden products, regional catalog differences, or storefront rules that limit catalog access. Increase `maxProductsPerStore` only after confirming the store has more public products. #### Why is currency empty? Some public catalog responses provide prices without a currency code. When currency cannot be inferred safely, the actor leaves it empty rather than guessing. ### FAQ #### Can I scrape multiple stores in one run? Yes. Add multiple store URLs to `storeUrls`. #### Can I export to CSV or Excel? Yes. Use the Dataset tab in Apify Console to export results in common formats. #### Does it include variants? Yes, when `includeVariants` is enabled. #### Does it include images? Yes, when `includeImages` is enabled. #### Does it need my Shopify API key? No. The actor is designed for public storefront catalogs. ### Related scrapers Explore other ecommerce and product intelligence actors from `fetch_cat` on Apify: - `https://apify.com/fetch_cat/amazon-product-scraper` - `https://apify.com/fetch_cat/etsy-scraper` - `https://apify.com/fetch_cat/ebay-scraper` ### Support If a public Shopify store fails unexpectedly, include the store URL and run ID when requesting support. Small reproducible inputs are easiest to investigate. # Actor input Schema ## `storeUrls` (type: `array`): Shopify storefront homepages to scrape, such as https://www.deathwishcoffee.com or https://kith.com. ## `maxProductsPerStore` (type: `integer`): Maximum number of products to save from each storefront. ## `includeVariants` (type: `boolean`): Include variant-level SKU, price, compare-at price, availability, and options. ## `includeImages` (type: `boolean`): Include product image URLs and dimensions. ## `includeRawProduct` (type: `boolean`): Attach the original Shopify product payload for advanced debugging or custom processing. This increases dataset size. ## `proxyConfiguration` (type: `object`): Optional proxy settings. Leave disabled for public Shopify stores; enable only if a specific store blocks direct requests. ## Actor input object example ```json { "storeUrls": [ { "url": "https://www.deathwishcoffee.com" }, { "url": "https://www.brooklinen.com" } ], "maxProductsPerStore": 20, "includeVariants": true, "includeImages": true, "includeRawProduct": false, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `products` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "storeUrls": [ { "url": "https://www.deathwishcoffee.com" }, { "url": "https://www.brooklinen.com" } ], "maxProductsPerStore": 20, "includeVariants": true, "includeImages": true, "includeRawProduct": false, "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("fetch_cat/shopify-products-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "storeUrls": [ { "url": "https://www.deathwishcoffee.com" }, { "url": "https://www.brooklinen.com" }, ], "maxProductsPerStore": 20, "includeVariants": True, "includeImages": True, "includeRawProduct": False, "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("fetch_cat/shopify-products-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "storeUrls": [ { "url": "https://www.deathwishcoffee.com" }, { "url": "https://www.brooklinen.com" } ], "maxProductsPerStore": 20, "includeVariants": true, "includeImages": true, "includeRawProduct": false, "proxyConfiguration": { "useApifyProxy": false } }' | apify call fetch_cat/shopify-products-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=fetch_cat/shopify-products-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shopify Products Scraper", "description": "Scrape public Shopify product catalogs with variants, prices, images, vendors, tags, and availability from one or more storefronts.", "version": "0.1", "x-build-id": "z3dcbaK1ZGOZU8Tor" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/fetch_cat~shopify-products-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-fetch_cat-shopify-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/fetch_cat~shopify-products-scraper/runs": { "post": { "operationId": "runs-sync-fetch_cat-shopify-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/fetch_cat~shopify-products-scraper/run-sync": { "post": { "operationId": "run-sync-fetch_cat-shopify-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "storeUrls" ], "properties": { "storeUrls": { "title": "Store URLs", "type": "array", "description": "Shopify storefront homepages to scrape, such as https://www.deathwishcoffee.com or https://kith.com.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxProductsPerStore": { "title": "Maximum products per store", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum number of products to save from each storefront.", "default": 20 }, "includeVariants": { "title": "Include variants", "type": "boolean", "description": "Include variant-level SKU, price, compare-at price, availability, and options.", "default": true }, "includeImages": { "title": "Include images", "type": "boolean", "description": "Include product image URLs and dimensions.", "default": true }, "includeRawProduct": { "title": "Include raw product JSON", "type": "boolean", "description": "Attach the original Shopify product payload for advanced debugging or custom processing. This increases dataset size.", "default": false }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Optional proxy settings. Leave disabled for public Shopify stores; enable only if a specific store blocks direct requests.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```