# Shopify Store Scraper (`scrape_flux/shopify-scraper`) Actor Extract full product catalogs from any Shopify store — prices, variants, inventory, reviews & collections. Auto-detects Judge.me, Yotpo, Okendo & more. Filter by availability, discount %, or date. No browser or credentials needed. - **URL**: https://apify.com/scrape\_flux/shopify-scraper.md - **Developed by:** [ScrapeFlux](https://apify.com/scrape_flux) (community) - **Categories:** E-commerce - **Stats:** 2 total users, 1 monthly users, 75.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shopify Store Scraper Extract complete product data from any Shopify store — prices, variants, inventory, reviews, collections, currency, and more. Works on any store powered by Shopify including custom domains. No browser required. Fast, cheap, and reliable. ### Features - Scrapes **any Shopify store** by URL — no template or configuration needed - Extracts full product catalog with descriptions, variants, images, and tags - **Store metadata** — store name, currency, country auto-detected per store - **Price range** — `min_price` and `max_price` across all variants - **Discount percentage** calculated automatically from compare-at price - **Product timestamps** — `created_at`, `updated_at`, `published_at` - **Reviews** — auto-detects and scrapes from Judge.me, Yotpo, Stamped.io, Okendo, and Loox - **Average rating** computed from fetched reviews - **Collections/categories** — scrapes store collection hierarchy - **Filters** — only available products, minimum discount %, created after date - Option to output each **variant as a separate row** (great for price sheets) - Handles pagination — scrapes the full catalog regardless of size - No browser, no credentials required - Pay Per Event pricing — you only pay per product scraped ### Use cases - **Price monitoring** — track competitor prices and sale discounts across Shopify stores - **Dropshipping research** — products, reviews, and availability in one run - **Market research** — analyze catalogs, categories, pricing trends, and review sentiment - **Inventory tracking** — monitor stock and availability changes over time - **Discount hunting** — filter to only products on sale above a threshold ### Input | Field | Type | Required | Description | |---|---|---|---| | `storeUrls` | Array of strings | Yes | Shopify store URLs (e.g. `https://allbirds.com`) | | `maxProductsPerStore` | Integer | No | Max products per store (default: unlimited) | | `includeVariants` | Boolean | No | Output each variant as a separate row (default: false) | | `scrapeReviews` | Boolean | No | Fetch product reviews (default: false) | | `maxReviewsPerProduct` | Integer | No | Max reviews per product (default: 50, max: 1000) | | `scrapeCollections` | Boolean | No | Scrape store collections/categories (default: false) | | `onlyAvailable` | Boolean | No | Skip products where all variants are out of stock (default: false) | | `minDiscount` | Integer | No | Only return products discounted by at least this % (1–99) | | `createdAfter` | String | No | Only return products created after this date (YYYY-MM-DD) | | `proxyConfig` | Object | No | Proxy settings (datacenter proxies work fine) | ### Output — Products ```json { "record_type": "product", "store_url": "https://allbirds.com", "store_name": "Allbirds", "currency": "USD", "product_id": 1234567890, "title": "Tree Runner", "handle": "tree-runner", "vendor": "Allbirds", "product_type": "Footwear", "description": "Made from eucalyptus tree fiber...", "tags": ["sustainable", "running"], "price": "98.00", "compare_at_price": "135.00", "discount_percentage": 27, "min_price": "78.00", "max_price": "118.00", "available": true, "variants_count": 8, "images": ["https://cdn.shopify.com/..."], "product_url": "https://allbirds.com/products/tree-runner", "created_at": "2023-01-15T08:00:00-05:00", "updated_at": "2026-06-01T12:00:00-05:00", "published_at": "2023-01-15T10:00:00-05:00", "reviews": [ { "platform": "judgeme", "author": "Jane D.", "rating": 5, "title": "Best shoes I've ever owned", "body": "Super comfortable right out of the box...", "date": "2026-05-01T00:00:00Z", "verified": true, "helpful_votes": 12, "photos": [] } ], "review_count": 1, "average_rating": 4.8, "scraped_at": "2026-06-26T10:00:00.000Z" } ```` #### With `includeVariants: true` Each variant becomes its own row with all product fields plus: ```json { "variant_id": 9876543210, "variant_title": "US 10 / Gray", "sku": "TR-US10-GRY", "price": "98.00", "compare_at_price": "135.00", "discount_percentage": 27, "available": true, "inventory_quantity": 14 } ``` ### Output — Collections (when `scrapeCollections: true`) ```json { "record_type": "collection", "store_url": "https://allbirds.com", "collection_id": 987654321, "title": "Men's Shoes", "handle": "mens-shoes", "description": "Shop all men's shoes...", "image_url": "https://cdn.shopify.com/...", "products_count": 24, "collection_url": "https://allbirds.com/collections/mens-shoes" } ``` ### Supported review platforms | Platform | Detection | |---|---| | Judge.me | Auto-detected from page source | | Yotpo | Auto-detected, extracts public app key | | Stamped.io | Auto-detected, extracts public API key | | Okendo | Auto-detected, extracts subscriber ID | | Loox | Auto-detected from page source | ### How it works Uses Shopify's public `/products.json` and `/collections.json` endpoints — available on every Shopify store without credentials. Paginates with `limit=250` until the full catalog is retrieved. Store currency and name are auto-detected via `/shop.json` (with an HTML fallback for stores that block it). Reviews are fetched from the platform's public CDN API after detecting which review app the store uses. # Actor input Schema ## `storeUrls` (type: `array`): One or more Shopify store URLs to scrape (e.g. https://allbirds.com). Works with any Shopify store — custom domains included. ## `maxProductsPerStore` (type: `integer`): Maximum number of products to scrape per store. Leave empty to scrape all products. ## `includeVariants` (type: `boolean`): When enabled, each product variant (size, color, etc.) is output as a separate row. When disabled, only one row per product with variant summary. ## `scrapeReviews` (type: `boolean`): Fetch product reviews. Auto-detects the review platform used by each store (supports Judge.me, Yotpo, Stamped.io, Okendo, Loox). ## `maxReviewsPerProduct` (type: `integer`): Maximum number of reviews to fetch per product. Only used when Scrape reviews is enabled. ## `scrapeCollections` (type: `boolean`): Also scrape the store's collections (categories). Collection records are added to the dataset with record\_type: 'collection'. ## `onlyAvailable` (type: `boolean`): When enabled, skips products where all variants are out of stock. ## `minDiscount` (type: `integer`): Only return products discounted by at least this percentage (compare-at price vs current price). Leave empty to return all products. ## `createdAfter` (type: `string`): Only return products created after this date. Use ISO 8601 format: YYYY-MM-DD (e.g. 2026-01-01). ## `proxyConfig` (type: `object`): Proxy settings. Datacenter proxies are sufficient for Shopify. ## Actor input object example ```json { "storeUrls": [ "https://allbirds.com" ], "includeVariants": false, "scrapeReviews": false, "maxReviewsPerProduct": 50, "scrapeCollections": false, "onlyAvailable": false, "proxyConfig": { "useApifyProxy": true } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "storeUrls": [ "https://allbirds.com" ], "proxyConfig": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("scrape_flux/shopify-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "storeUrls": ["https://allbirds.com"], "proxyConfig": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("scrape_flux/shopify-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "storeUrls": [ "https://allbirds.com" ], "proxyConfig": { "useApifyProxy": true } }' | apify call scrape_flux/shopify-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scrape_flux/shopify-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shopify Store Scraper", "description": "Extract full product catalogs from any Shopify store — prices, variants, inventory, reviews & collections. Auto-detects Judge.me, Yotpo, Okendo & more. Filter by availability, discount %, or date. No browser or credentials needed.", "version": "1.0", "x-build-id": "qJuySFii4HkoHWSdm" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scrape_flux~shopify-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scrape_flux-shopify-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scrape_flux~shopify-scraper/runs": { "post": { "operationId": "runs-sync-scrape_flux-shopify-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scrape_flux~shopify-scraper/run-sync": { "post": { "operationId": "run-sync-scrape_flux-shopify-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "storeUrls" ], "properties": { "storeUrls": { "title": "Shopify store URLs", "type": "array", "description": "One or more Shopify store URLs to scrape (e.g. https://allbirds.com). Works with any Shopify store — custom domains included.", "items": { "type": "string" } }, "maxProductsPerStore": { "title": "Max products per store", "minimum": 1, "type": "integer", "description": "Maximum number of products to scrape per store. Leave empty to scrape all products." }, "includeVariants": { "title": "Include variants", "type": "boolean", "description": "When enabled, each product variant (size, color, etc.) is output as a separate row. When disabled, only one row per product with variant summary.", "default": false }, "scrapeReviews": { "title": "Scrape reviews", "type": "boolean", "description": "Fetch product reviews. Auto-detects the review platform used by each store (supports Judge.me, Yotpo, Stamped.io, Okendo, Loox).", "default": false }, "maxReviewsPerProduct": { "title": "Max reviews per product", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of reviews to fetch per product. Only used when Scrape reviews is enabled.", "default": 50 }, "scrapeCollections": { "title": "Scrape collections", "type": "boolean", "description": "Also scrape the store's collections (categories). Collection records are added to the dataset with record_type: 'collection'.", "default": false }, "onlyAvailable": { "title": "Only available products", "type": "boolean", "description": "When enabled, skips products where all variants are out of stock.", "default": false }, "minDiscount": { "title": "Minimum discount %", "minimum": 1, "maximum": 99, "type": "integer", "description": "Only return products discounted by at least this percentage (compare-at price vs current price). Leave empty to return all products." }, "createdAfter": { "title": "Created after", "type": "string", "description": "Only return products created after this date. Use ISO 8601 format: YYYY-MM-DD (e.g. 2026-01-01)." }, "proxyConfig": { "title": "Proxy configuration", "type": "object", "description": "Proxy settings. Datacenter proxies are sufficient for Shopify." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```