# Shopify Scraper - Products, Prices, Variants & Stock (`sweet_stickball/shopify-store-scraper`) Actor

Scrape products from a Shopify store: titles, prices, compare-at prices, variants, stock, images and tags. Shopify product scraper and catalog extractor using the store's public product JSON, with optional store analysis.

- **URL**: https://apify.com/sweet_stickball/shopify-store-scraper.md
- **Developed by:** [CrawlKit](https://apify.com/sweet_stickball) (community)
- **Categories:** E-commerce, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.42 / 1,000 products

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Shopify Scraper - Products, Prices, Variants & Stock

Extract the product catalog of a public Shopify store from its public `/products.json` endpoint. No API key or login is needed and no headless browser is used. Charged per product.

### Features

- **Product catalog extraction** — titles, prices, images, variants, SKUs, stock levels, tags, vendor, product type, and timestamps.
- **Automatic pagination** — reads paginated `/products.json` responses (250 products per page) up to `maxProducts` (max 10,000).
- **Store analysis** (optional) — reads the homepage, `/meta.json` and `/collections.json` to report the Shopify theme, about 25 common apps detected from script patterns (Klaviyo, Yotpo, Judge.me, Loox, ReCharge…), payment methods mentioned on the page (PayPal, Apple Pay, Klarna, Shop Pay…), store currency, and collection count.
- **Proxy handling** — uses browser-like requests and Apify Proxy. If the store rate-limits or blocks a request (HTTP 429/403), the actor retries with a new proxy session, first on datacenter and then on residential proxies.

### Input Parameters

| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| `shopUrl` | string | Yes | — | URL of the Shopify store (e.g. `https://store.myshopify.com` or `https://www.example.com`) |
| `maxProducts` | integer | No | 20 | Maximum number of products to return (1–10,000) |
| `includeVariants` | boolean | No | true | Include per-variant details (price, SKU, stock) |
| `analyzeStore` | boolean | No | false | Add one store analysis record (theme, apps, payments); charged as `STORE_ANALYSIS` |

### Output Example

#### Product

```json
{
  "title": "Classic Cotton T-Shirt",
  "handle": "classic-cotton-t-shirt",
  "description": "<p>Soft organic cotton tee…</p>",
  "vendor": "BrandName",
  "product_type": "T-Shirts",
  "tags": ["cotton", "summer", "bestseller"],
  "price": 24.99,
  "compare_at_price": 34.99,
  "currency": null,
  "available": true,
  "total_inventory": 142,
  "images": [
    "https://cdn.shopify.com/s/files/1/…/shirt-front.jpg",
    "https://cdn.shopify.com/s/files/1/…/shirt-back.jpg"
  ],
  "variants": [
    {
      "title": "Small / White",
      "price": "24.99",
      "sku": "CCT-S-WHT",
      "available": true,
      "inventory_quantity": 38
    }
  ],
  "url": "https://store.myshopify.com/products/classic-cotton-t-shirt",
  "created_at": "2024-03-15T10:00:00Z",
  "updated_at": "2024-06-01T14:30:00Z",
  "published_at": "2024-03-15T12:00:00Z"
}
```

#### Store Analysis

```json
{
  "_type": "store_analysis",
  "store_url": "https://store.myshopify.com",
  "store_name": "My Store",
  "store_domain": "store.myshopify.com",
  "theme_name": "Dawn",
  "theme_id": 123456789,
  "currency": "USD",
  "payment_methods": ["Shopify Payments", "PayPal", "Apple Pay", "Shop Pay"],
  "detected_apps": ["Klaviyo", "Judge.me", "Google Analytics"],
  "collections_count": 12,
  "products_count": 250
}
```

### Use Cases

- **Competitor analysis** — monitor a competitor's catalog, pricing, and installed tech stack.
- **Price monitoring** — track price changes across Shopify stores over time.
- **Catalog backup** — export your own store's product data as structured JSON.
- **Market research** — analyze product trends, popular apps, and pricing strategies across multiple stores.
- **Lead generation** — identify stores using specific apps or payment providers.

### Pricing

Pay-per-event, **no start fee**: **$0.70 per 1,000 products** and **$2.00 per 1,000 store analyses** on the Apify Free plan, with lower prices on paid plans.

| Event | Free | Starter | Scale | Business | Enterprise |
|-------|------|---------|-------|----------|------------|
| Product (`PRODUCT`) | $0.70 | $0.59 | $0.52 | $0.42 | $0.42 |
| Store analysis (`STORE_ANALYSIS`) | $2.00 | $1.70 | $1.50 | $1.20 | $1.20 |

Prices in USD per 1,000 events.

#### Cost examples (Free plan)

| Scenario | Products | Analysis | Total Cost |
|---|---|---|---|
| Quick product lookup (20 products) | 20 | No | $0.014 |
| Full store analysis | 20 | Yes | $0.016 |
| Medium catalog (500 products) | 500 | No | $0.35 |
| Full catalog + analysis (2000 products) | 2,000 | Yes | $1.40 |

### Limitations

- Shopify stores only — the actor checks the platform before scraping and fails if the URL is not a Shopify storefront.
- Some stores disable or block `/products.json` (or are password-protected). Those runs end FAILED with the reason in the status message (rate-limited, forbidden, or no products returned).
- Some stores hide inventory quantities; `total_inventory` is then `0` and `inventory_quantity` is `null`.
- `description` is the product HTML truncated to 500 characters.
- Currency isn't available per product (`currency` is always `null`); enable store analysis to get the store's default currency.
- In the store analysis, `products_count` counts only the first page of `/products.json` (at most 250). App and payment detection relies on patterns in the homepage HTML, so apps that load nothing on the homepage won't appear.

Python 3.11, async httpx, Apify SDK. Retries with a new proxy session on rate limits and server errors.

### Related Actors

- [Tech Stack Detector - Website Technology Lookup](https://apify.com/sweet_stickball/tech-stack-scanner) — Detect the tech stack of a website: CMS, frameworks, analytics, CDN, payment and hosting technologies, from HTTP headers, HTML, scripts and cookies.
- [Google Shopping Scraper - Product Prices & Sellers](https://apify.com/sweet_stickball/google-shopping-scraper) — Scrape Google Shopping results: product titles, prices, old prices, sellers, ratings, review counts and images in 12 countries.
- [Amazon Reviews Scraper - Product Reviews & Ratings](https://apify.com/sweet_stickball/amazon-reviews-scraper) — Scrape Amazon product reviews from the product page: rating, title, text, date, verified purchase and helpful votes, plus product rating and review count.

# Actor input Schema

## `shopUrl` (type: `string`):

The URL of the Shopify store to scrape. Accepted formats: 'https://store.myshopify.com', 'https://www.example.com', or just 'example.myshopify.com'. The store must be a live Shopify site with public product listings.

## `maxProducts` (type: `integer`):

Maximum number of products to scrape. Use a small number (10-20) for quick lookups or set higher for full catalog extraction. Default is 20.

## `includeVariants` (type: `boolean`):

If true, each product includes its full list of variants with individual prices, SKUs, and stock levels. Set to false for a leaner output.

## `analyzeStore` (type: `boolean`):

If true, performs a bonus analysis of the store: detects the Shopify theme, installed apps (Klaviyo, Yotpo, Judge.me, etc.), payment methods (PayPal, Apple Pay, Klarna, etc.), and store metadata. Adds one STORE_ANALYSIS charge.

## Actor input object example

```json
{
  "shopUrl": "https://hydrogen-preview.myshopify.com",
  "maxProducts": 10,
  "includeVariants": true,
  "analyzeStore": false
}
```

# Actor output Schema

## `products` (type: `string`):

Dataset items shown with the 'products' view.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "shopUrl": "https://hydrogen-preview.myshopify.com",
    "maxProducts": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("sweet_stickball/shopify-store-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "shopUrl": "https://hydrogen-preview.myshopify.com",
    "maxProducts": 10,
}

# Run the Actor and wait for it to finish
run = client.actor("sweet_stickball/shopify-store-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "shopUrl": "https://hydrogen-preview.myshopify.com",
  "maxProducts": 10
}' |
apify call sweet_stickball/shopify-store-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,sweet_stickball/shopify-store-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/OQvi6BUK4hnwlVYch/builds/PRObkh9LleSpeOm1I/openapi.json