# Shopify Store Product Scraper (`nexgendata/shopify-product-scraper`) Actor

Detect Shopify stores and extract all products with pricing, variants, images, inventory status, and more. Supports bulk scraping of multiple stores. Uses Shopify's public product API — fast and reliable.

- **URL**: https://apify.com/nexgendata/shopify-product-scraper.md
- **Developed by:** [Stephan Corbeil](https://apify.com/nexgendata) (community)
- **Categories:** E-commerce, Lead generation
- **Stats:** 2 total users, 1 monthly users, 0.0% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Shopify Store Product Scraper

Extract product data from any Shopify store with ease. This actor detects Shopify stores and scrapes all products using the public `/products.json` API endpoint—no browser required, no login needed.

### Features

- **Fast & Lightweight**: Uses httpx for direct API access—no browser overhead
- **Shopify Detection**: Automatically detects if a domain is a Shopify store
- **Complete Product Data**: Extracts titles, descriptions, prices, variants, images, inventory, and more
- **Bulk Scraping**: Process multiple stores in a single run
- **Smart Pagination**: Handles stores with hundreds or thousands of products
- **Flexible Output**: Include/exclude variants and images as needed
- **Error Handling**: Gracefully handles blocked endpoints and non-Shopify sites
- **Pricing Extraction**: Captures regular prices, compare-at prices, and price ranges

### Use Cases

- **Competitor Price Monitoring**: Track pricing changes across competing Shopify stores
- **Market Research**: Analyze product catalogs, categories, and vendor distribution
- **Product Catalog Analysis**: Map product offerings, variants, and inventory
- **Drop-shipping Research**: Find suppliers and analyze product availability
- **SEO & Content Analysis**: Extract product descriptions and metadata
- **Inventory Tracking**: Monitor product availability across multiple stores

### How to Use

#### Input Parameters

| Parameter | Type | Description | Default |
|-----------|------|-------------|---------|
| `storeUrl` | string | Single Shopify store URL (e.g., `https://www.allbirds.com`) | - |
| `storeUrls` | array | Multiple store URLs for bulk scraping | - |
| `includeVariants` | boolean | Include product variants (sizes, colors, etc.) | `true` |
| `includeImages` | boolean | Include product image URLs | `true` |
| `maxProducts` | integer | Maximum products per store (0 = all) | `0` |

#### Example Input

```json
{
  "storeUrl": "https://www.allbirds.com",
  "includeVariants": true,
  "includeImages": true,
  "maxProducts": 0
}
````

Or for bulk scraping:

```json
{
  "storeUrls": [
    "https://www.allbirds.com",
    "https://beardbrand.com",
    "https://shop.gymshark.com"
  ],
  "includeVariants": true,
  "includeImages": true
}
```

### Output Example

Each product is saved as a dataset item:

```json
{
  "id": 7234567890,
  "title": "Classic Runner",
  "handle": "classic-runner",
  "description": "Lightweight and sustainable running shoes made from sugarcane-based foam.",
  "vendor": "Allbirds",
  "product_type": "Shoes",
  "tags": ["womens", "running", "eco-friendly"],
  "created_at": "2023-01-15T10:30:00Z",
  "updated_at": "2024-03-20T14:22:00Z",
  "published_at": "2023-01-15T10:30:00Z",
  "price_range": {
    "min": 79.95,
    "max": 89.95,
    "currency": "USD"
  },
  "compare_at_price_range": {
    "min": 95.00,
    "max": 105.00
  },
  "variants": [
    {
      "id": 112233445566,
      "title": "Women's Size 5",
      "sku": "CLSRUN-W5",
      "price": 79.95,
      "compare_at_price": 95.00,
      "available": true,
      "inventory_quantity": 42
    },
    {
      "id": 112233445567,
      "title": "Women's Size 6",
      "sku": "CLSRUN-W6",
      "price": 79.95,
      "compare_at_price": 95.00,
      "available": true,
      "inventory_quantity": 38
    }
  ],
  "images": [
    {
      "src": "https://cdn.shopify.com/s/files/1/0001/2345/products/runner-1.jpg",
      "alt": "Classic Runner - Front View"
    },
    {
      "src": "https://cdn.shopify.com/s/files/1/0001/2345/products/runner-2.jpg",
      "alt": "Classic Runner - Side View"
    }
  ],
  "store_url": "https://www.allbirds.com"
}
```

### How It Works

1. **Shopify Detection**: The actor checks for Shopify headers (`x-shopify-stage`, `powered-by`) and attempts to fetch `/products.json`
2. **Product Fetching**: Uses the public API endpoint `/products.json?limit=250&page={n}` with pagination
3. **Data Extraction**: Processes each product to extract pricing, variants, images, and metadata
4. **Smart Fallbacks**: If `/products.json` is blocked, tries `/collections/all/products.json`
5. **Rate Limiting**: Includes 200ms delays between requests to avoid overwhelming servers

### Pricing

Based on PPE (Pay-Per-Event) model:

- **Actor Start**: $0.01 per run
- **Product Scraped**: $0.002 per product

#### Example Cost Calculation

Scraping 1,000 products from a Shopify store:

- Actor start: $0.01
- Products: 1,000 × $0.002 = $2.00
- **Total: $2.01**

### Limitations

- Works only with Shopify stores using the public product API
- Some Shopify stores may block the `/products.json` endpoint (typically redirected to login)
- Product data is limited to what the public API exposes (some stores hide certain fields)
- Private/password-protected stores are not supported
- Image URLs are CDN-hosted and may change over time

### Supported Shopify Store Types

- Standard Shopify Plus stores
- Shopify Basic, Professional, Advanced plans
- Custom Shopify implementations
- Stores using custom domains

### Troubleshooting

#### "Not a Shopify store" error

- Verify the domain is actually a Shopify store (check page source for `powered-by: Shopify`)
- Ensure the URL is correct and accessible

#### No products found

- The store may block public API access
- Try accessing `/products.json` directly in your browser
- Some stores require authentication for product data

#### Timeout errors

- The store may be slow to respond
- Try reducing `maxProducts` to fetch fewer items
- Retry the run

### API Reference

#### Shopify Public Product API

Endpoint: `GET https://{domain}/products.json`

Query parameters:

- `limit`: Number of products per page (max 250)
- `page`: Page number (starts at 1)
- `fields`: Specific fields to return (optional)

Response: JSON object with `products` array

### Data Quality

All product data comes directly from Shopify's public API—no parsing or inference. Data accuracy depends on how shop owners maintain their product information.

### Support & Questions

For issues, questions, or feature requests, contact the NexGenData team.

***

Built with httpx. No browser required. Lightning-fast Shopify scraping.

## Actor input object example

```json
{}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("nexgendata/shopify-product-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("nexgendata/shopify-product-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call nexgendata/shopify-product-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=nexgendata/shopify-product-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Shopify Store Product Scraper",
        "description": "Detect Shopify stores and extract all products with pricing, variants, images, inventory status, and more. Supports bulk scraping of multiple stores. Uses Shopify's public product API — fast and reliable.",
        "version": "0.0",
        "x-build-id": "XaoM5D0PWRpEhv864"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/nexgendata~shopify-product-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-nexgendata-shopify-product-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/nexgendata~shopify-product-scraper/runs": {
            "post": {
                "operationId": "runs-sync-nexgendata-shopify-product-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/nexgendata~shopify-product-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-nexgendata-shopify-product-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "properties": {}
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```