# Shopify Product Scraper & Inventory Tracker (`aiscraperdev/shopify-product-inventory-scraper`) Actor Scrape complete product catalogs from any Shopify or headless Next.js store. Extract real-time prices, precise backend stock/inventory counts, variant details, discounts, categories, and SEO metadata. Perfect for dropshippers, price monitoring, and deep competitor research. - **URL**: https://apify.com/aiscraperdev/shopify-product-inventory-scraper.md - **Developed by:** [Randeep Dhillon](https://apify.com/aiscraperdev) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 3 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $4.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shopify Product Scraper & Inventory Tracker Extract complete product catalogs, real-time prices, exact backend stock levels, variants, and discounts from any standard Shopify or headless Next.js store. Search by store domain, specific collection, or paste individual product URLs directly. Bypasses advanced Cloudflare bot protection natively. No login or authentication required. > ⚡ **The ultimate Shopify intelligence tool on Apify** — Unlike basic scrapers, this actor uses a hybrid-extraction engine (SEO Meta + dataLayer + Next.js state) to bypass anti-bot walls and capture **exact hidden inventory counts**, discount percentages, and category tags. Ready to drop into Google Sheets, Airtable, or your competitive pricing dashboard. --- ### What you can do with this scraper - **Inventory monitoring** — track exact stock quantities (`inventory_quantity`) across competitor variants to estimate their sales volume and revenue. - **Dropshipping research** — find discounted, in-stock products with high margins. - **Price monitoring** — track competitor pricing strategies, sales, and discounts (`is_on_sale`, `compare_at_price`) in real-time. - **Competitor research** — map out an entire brand's product catalog, including their internal categories (`product_type`) and organizational tags. - **SEO analysis** — extract canonical `seo_title` and `seo_description` tags to see how competitors are ranking on Google. --- ### How to use #### Step 1 — Add your target URLs The `Shopify Store URLs` field accepts multiple input formats (you can mix them in one run): | Input type | Example | Behavior | | ------------------ | -------------------------------------------------- | --------------------------------------------------------------- | | **Store domain** | `gymshark.com` | Automatically finds the sitemap and scrapes the entire catalog. | | **Collection URL** | `https://www.gymshark.com/collections/mens` | Scrapes all products belonging to that specific collection. | | **Product URL** | `https://www.gymshark.com/products/arrive-t-shirt` | Scrapes just that individual product. | You can add multiple URLs at once — the actor queues and scrapes all of them in a single run. #### Step 2 — Set your filters | Filter | Options | Default | | ------------------------ | ------------------------------------ | ---------- | | **Max Products** | Any integer (`-1` for unlimited) | `10` | | **Target Collections** | e.g. `["sale", "mens"]` | `[]` (All) | | **Include Out of Stock** | `true` / `false` | `true` | | **Include Variants** | `true` / `false` (size, color, SKUs) | `true` | | **Only On Sale** | `true` / `false` | `false` | | **Min / Max Price** | Any numeric value | `none` | #### Step 3 — Run and export Click **Start** and wait for the run to complete. Download your results as **JSON, CSV, or Excel** — ready to use in your favorite data tools or automated workflows. --- ### Sample output ```json { "store_domain": "[www.gymshark.com](https://www.gymshark.com)", "store_name": "GYMSHARK", "product_id": "6535207289034", "product_handle": "gymshark-vital-seamless-shorts-black-marl-logo", "product_url": "[https://www.gymshark.com/products/gymshark-vital-seamless-shorts-black-marl-logo](https://www.gymshark.com/products/gymshark-vital-seamless-shorts-black-marl-logo)", "title": "vital seamless shorts", "vendor": "Gymshark", "product_type": "womens>apparel>shorts>tight", "tags": ["womens", "apparel", "shorts", "tight"], "collections": [], "description_text": "Shop the Vital Seamless Shorts in black marl. With next day delivery and free returns, shop online today.", "price": 40, "compare_at_price": null, "discount_percentage": null, "is_on_sale": false, "available": true, "total_inventory": 28006, "featured_image_url": "[https://cdn.shopify.com/s/files/1/0156/6146/files/images-VitalSeamless2_0ShortsBlackMarlB1A4J.jpg](https://cdn.shopify.com/s/files/1/0156/6146/files/images-VitalSeamless2_0ShortsBlackMarlB1A4J.jpg)", "variants": [ { "variant_id": "39245957562570", "title": "xs", "price": 40, "compare_at_price": null, "discount_percentage": null, "available": true, "inventory_quantity": 7079, "sku": "B1A4J-BBF3-XS", "is_on_sale": false }, { "variant_id": "39245957660874", "title": "l", "price": 40, "compare_at_price": null, "discount_percentage": null, "available": false, "inventory_quantity": 0, "sku": "B1A4J-BBF3-L", "is_on_sale": false } ], "total_variants": 6, "seo_title": "Gymshark Vital Seamless Shorts - Black Marl | Gymshark", "seo_description": "Shop the Vital Seamless Shorts in black marl. With next day delivery and free returns, shop online today.", "published_at": "2023-08-15T10:30:00Z", "scraped_at": "2026-05-12T08:51:25.178Z" } ```` *** ### Output fields reference #### Product Identity & SEO | Field | Description | | ----------------- | -------------------------------------------------------------------- | | `store_domain` | The source website e.g. [www.gymshark.com](https://www.gymshark.com) | | `store_name` | Auto-formatted brand name e.g. `GYMSHARK` | | `product_id` | Shopify internal product ID | | `product_handle` | The URL slug for the product | | `title` | Cleaned product title | | `vendor` | The listed manufacturer or brand | | `product_type` | Internal category hierarchy e.g. `womens>apparel` | | `tags` | Array of internal product tags | | `seo_title` | The exact title used for Google Search ranking | | `seo_description` | The meta description used for SEO | | `published_at` | When the product was created/published | #### Pricing & Offers | Field | Description | | --------------------- | ----------------------------------------------------- | | `price` | Current lowest price for the item | | `compare_at_price` | Original price before discount (strike-through) | | `discount_percentage` | Automatically calculated savings percentage e.g. `25` | | `is_on_sale` | `true` if `compare_at_price` is higher than `price` | #### Inventory & Variants | Field | Description | | ----------------- | -------------------------------------------------------------------------------------------- | | `available` | `true` if at least one variant is in stock | | `total_inventory` | Exact aggregate stock count across all variants | | `variants` | Array of size/color objects (includes SKU, variant-specific price, and `inventory_quantity`) | | `total_variants` | Total number of variants for the product | *** ### Input Schema Reference ```json { "shopifyStoreUrls": ["gymshark.com", "https://us.kith.com/collections/mens"], "maxProducts": 50, "collections": ["sale", "new-arrivals"], "includeOutOfStock": false, "includeVariants": true, "onlyOnSale": true, "minPrice": 20, "maxPrice": 150 } ``` *** ### Who Uses This - **Dropshippers** hunting for profitable, heavily discounted products that are guaranteed to be in stock. - **E-commerce brand owners** tracking competitor catalog updates, pricing changes, and restocks. - **Retail analysts** monitoring deep inventory metrics to estimate a brand's sales volume. - **SEO agencies** auditing competitor meta titles, descriptions, and tagging strategies at scale. *** ### Pricing This actor uses **Pay-Per-Result** pricing — you only pay for the products you successfully scrape. > **$4.00 per 1,000 products** **Why this price?** Unlike cheap scrapers that only read basic HTML, this actor executes complex JavaScript to pull hidden backend inventory quantities and utilizes proxy rotation with sitemap tracking to bypass enterprise Cloudflare blocks. *** ### Tips for Best Results **Use Root Domains for bulk scraping** Inputting just `brand.com` tells the scraper to automatically locate the store's XML sitemap, which bypasses WAF (Web Application Firewall) blocks that usually stop catalog scraping. **Leverage the collections filter** If a store has 10,000 items and you only want shoes, don't scrape the whole site. Add `"shoes"` to the Target Collections filter to save money and time. **Track exact `inventory_quantity`** If you scrape a competitor's product every day at midnight, the difference in `inventory_quantity` between runs equals their exact daily sales volume for that item. **Handling strict blocks** If a massive enterprise store (like Gymshark or FashionNova) is returning errors, ensure you have **Residential Proxies** enabled in your Apify proxy configuration to mimic real user traffic. *** ### Limitations **Custom Headless limitations** 99% of Shopify Plus / Next.js stores expose inventory via the `dataLayer` or `__NEXT_DATA__`. If a store has heavily modified their frontend to strip this out entirely, the scraper will fall back to SEO data, meaning `inventory_quantity` may return `null` (though `price` and `title` will still succeed). **Non-Shopify stores** This actor is strictly tuned for Shopify architecture. Attempting to scrape WooCommerce or Magento links will result in empty outputs. # Actor input Schema ## `shopifyStoreUrls` (type: `array`): Accepts store domains like(fashionnova.com), specific collections, or specific product URLs. ## `maxProducts` (type: `integer`): Maximum number of products to scrape per store URL (-1 for all). ## `collections` (type: `array`): Scrape only specific collections (e.g., mens, sale). Leave empty to scrape all. ## `includeOutOfStock` (type: `boolean`): Include products that are currently out of stock. ## `includeVariants` (type: `boolean`): Scrape all size/color/style variants per product. ## `onlyOnSale` (type: `boolean`): Return only products with an active discount (compare\_at\_price > price). ## `sortBy` (type: `string`): Determine the order in which products are retrieved. ## `minPrice` (type: `number`): Optional: Only include products above this price. ## `maxPrice` (type: `number`): Optional: Only include products below this price. ## `scrapeMetafields` (type: `boolean`): Attempt to extract hidden Shopify metafields (requires additional requests per product). ## Actor input object example ```json { "shopifyStoreUrls": [ "https://www.fashionnova.com" ], "maxProducts": 10, "collections": [], "includeOutOfStock": true, "includeVariants": true, "onlyOnSale": false, "sortBy": "default", "scrapeMetafields": false } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "shopifyStoreUrls": [ "https://www.fashionnova.com" ] }; // Run the Actor and wait for it to finish const run = await client.actor("aiscraperdev/shopify-product-inventory-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "shopifyStoreUrls": ["https://www.fashionnova.com"] } # Run the Actor and wait for it to finish run = client.actor("aiscraperdev/shopify-product-inventory-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "shopifyStoreUrls": [ "https://www.fashionnova.com" ] }' | apify call aiscraperdev/shopify-product-inventory-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=aiscraperdev/shopify-product-inventory-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shopify Product Scraper & Inventory Tracker", "description": "Scrape complete product catalogs from any Shopify or headless Next.js store. Extract real-time prices, precise backend stock/inventory counts, variant details, discounts, categories, and SEO metadata. Perfect for dropshippers, price monitoring, and deep competitor research.", "version": "0.0", "x-build-id": "eVfNM2ZcjZmdVsBfd" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/aiscraperdev~shopify-product-inventory-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-aiscraperdev-shopify-product-inventory-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/aiscraperdev~shopify-product-inventory-scraper/runs": { "post": { "operationId": "runs-sync-aiscraperdev-shopify-product-inventory-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/aiscraperdev~shopify-product-inventory-scraper/run-sync": { "post": { "operationId": "run-sync-aiscraperdev-shopify-product-inventory-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "shopifyStoreUrls", "maxProducts" ], "properties": { "shopifyStoreUrls": { "title": "Shopify Store URLs", "type": "array", "description": "Accepts store domains like(fashionnova.com), specific collections, or specific product URLs.", "items": { "type": "string" }, "default": [ "https://www.fashionnova.com" ] }, "maxProducts": { "title": "Max Products per Store", "type": "integer", "description": "Maximum number of products to scrape per store URL (-1 for all).", "default": 10 }, "collections": { "title": "Target Collections", "type": "array", "description": "Scrape only specific collections (e.g., mens, sale). Leave empty to scrape all.", "items": { "type": "string" }, "default": [] }, "includeOutOfStock": { "title": "Include Out of Stock", "type": "boolean", "description": "Include products that are currently out of stock.", "default": true }, "includeVariants": { "title": "Include Variants", "type": "boolean", "description": "Scrape all size/color/style variants per product.", "default": true }, "onlyOnSale": { "title": "Only On Sale", "type": "boolean", "description": "Return only products with an active discount (compare_at_price > price).", "default": false }, "sortBy": { "title": "Sort By", "enum": [ "default", "price_low_to_high", "price_high_to_low", "newest", "best_selling", "title_a_z" ], "type": "string", "description": "Determine the order in which products are retrieved.", "default": "default" }, "minPrice": { "title": "Min Price Floor", "type": "number", "description": "Optional: Only include products above this price." }, "maxPrice": { "title": "Max Price Ceiling", "type": "number", "description": "Optional: Only include products below this price." }, "scrapeMetafields": { "title": "Scrape Metafields (Slower)", "type": "boolean", "description": "Attempt to extract hidden Shopify metafields (requires additional requests per product).", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```