# Shopify Product Scraper · Full Catalog Export by Store URL (`corent1robert/shopify-products-scraper`) Actor

Turn any public Shopify storefront URL into a clean, export-ready product table: titles, handles, variants, SKUs, prices, availability, and image links. Ideal for merchandising teams, market research, and catalog backups. For custom pipelines or private catalog access, contact corentin@outreacher.fr

- **URL**: https://apify.com/corent1robert/shopify-products-scraper.md
- **Developed by:** [Corentin Robert](https://apify.com/corent1robert) (community)
- **Categories:** E-commerce, Automation, Developer tools
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet

## Pricing

$2.99 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Shopify Store Product Scraper

Turn any **public Shopify storefront** into a clean product dataset you can open in Excel, plug into BI tools, or feed into your stack. **Shopify only** — use the shop URL your customers see (`*.myshopify.com` or a custom domain on Shopify). Other platforms are rejected before scraping with a clear error.

**Built for:** competitor benchmarking · marketplace research · catalog backups · merchandising analysis · enrichment pipelines

### What it does

The Actor walks the **public** side of the store—the same information visible to shoppers—and assembles **one row per variant** (spreadsheet-friendly). It automatically tries the fastest path first and falls back when a store hides its default catalog view, so you get the broadest coverage possible without touching the merchant’s admin or private APIs.

By default there is **no product limit** per store (full public catalog). Use **Maximum products per store** only when you want a smaller sample.

### What you get

| Category | Examples of what’s captured |
|----------|-----------------------------|
| Identity & links | Product and variant IDs, title, URL, handle |
| Merchandising | Brand/vendor, type, tags, options (size, color, …) |
| Pricing & stock signal | Price, compare-at price, currencies, availability when shown publicly |
| Logistics-friendly | SKU, barcode, weight, shipping/tax flags when exposed |
| Media | Main image, variant image, ordered gallery links |
| Timestamps | Created/updated where the storefront exposes them |

**Fixed export shape (by design):** no full **body HTML** on rows, no **one-row-per-product** mode, and no extra **page-enrich** columns—keeps runs fast and files easy to work with. For a custom build (fork), change the `EXPORT_*` and `RUN_VERBOSE_LOGS` constants at the top of `src/main.js`.

**Not included:** warehouse quantities, cost, private metafields, or anything that only exists in the merchant admin—that requires the merchant’s own APIs and permissions.

### Important to know

- **Public catalog only** — no Shopify login, no Admin API, no secrets you don’t already have as a visitor.
- Some shops **limit** how much of the catalog is exposed automatically. The Actor uses fallback strategies; if a store is fully locked down, the run stops with a clear message. Running from **Apify** with **Proxy** can help when the store treats cloud traffic differently than a home browser.
- **Terms and law** — use the data in line with the store’s terms and your jurisdiction. You’re responsible for compliance.

### Pricing (Apify Store)

On the **Apify Store**, this Actor uses **pay-per-event** pricing: you pay for what lands in your **dataset**.

| What you pay for | How it counts |
|------------------|----------------|
| **Exported rows** | **$2.99 per 1,000 rows** (billed proportionally). Each row is one **dataset item**—in practice **usually one row per product variant**, not per parent product. |
| **Run start** | A small default **Actor start** fee (Apify synthetic event—kept minimal). |

**Quick examples (event charges only, rounded):**

- **1,000** rows → about **$2.99**
- **5,000** rows → about **$14.95**
- **10,000** rows → about **$29.90**

Your Apify **plan**, **compute (CU)**, and **proxy** usage may add **separate** platform charges—see [Apify pricing](https://apify.com/pricing) and the run’s usage tab.

**Control your bill:** use **Maximum products per store** to cap how many products are processed (fewer products → fewer variants → fewer rows). In the Apify Console you can also set a **maximum cost per run** for pay-per-event Actors.

### How to use (Apify Console)

1. Open the Actor and add **Shopify** storefront URL(s) (field **Shopify store URLs**).
2. Leave **Maximum products per store** **empty** (or **0**) for the **full** catalog; enter a number (e.g. **25**) only to cap how many products per store.
3. Turn on **Apify Proxy** if the default run can’t reach the site reliably from the cloud.
4. Click **Start**, then download from the **Dataset** tab (JSON, CSV, Excel, or HTML export). Use the **Catalog overview** view for a slim column set, or **All fields** for every captured column (no duplicate “full export” view).

During the run, **Key-Value Store → RUN_LOG** shows a plain-language progress log.

### Input

| Field | Type | Description |
|-------|------|-------------|
| `startUrls` | string[] | **Required.** **Shopify-only** public storefront URLs (with or without `https://`). Non-Shopify sites fail the pre-check. |
| `maxProducts` | integer | **Omit**, **empty**, or **0** = full public catalog per store. Any positive integer caps products (not variants) per store. |
| `proxyConfiguration` | object | Apify Proxy settings. |

**Optional fields (API or `input.json` only — not in the Console form):** `batchSize` (default **5**), `handleRequestConcurrency` (default **3**), `handleBatchCooldownMs` (default **900**), `maxSitemapIndexes` (default **10**) for tuning large or strict storefronts. Omit for normal runs.

**Full catalog (default)**

```json
{
  "startUrls": ["https://www.example.com/"]
}
````

**Sample only (25 products per store)**

```json
{
  "startUrls": ["https://www.example.com/"],
  "maxProducts": 25
}
```

### Output example

One row per variant (typical):

```json
{
  "shopUrl": "https://www.example.com",
  "productId": 1234567890,
  "variantId": 9876543210,
  "title": "Example frame",
  "handle": "example-frame",
  "vendor": "Example Brand",
  "productType": "Eyewear",
  "tags": ["optical", "new"],
  "sku": "SKU-001",
  "price": "189.00",
  "currency": "EUR",
  "available": true,
  "option1": "Blue",
  "imageUrl": "https://cdn.shopify.com/.../image.jpg",
  "productUrl": "https://www.example.com/products/example-frame",
  "scrapedAt": "2026-04-09T12:00:00.000Z"
}
```

Download results from the Dataset tab in the format you need.

### Local development

```bash
npm install
npm start
```

Optional: merge settings from `input.json` at the project root when not running on Apify.

If the CLI reports missing input after clearing storage:

```bash
npm run reset-apify-input
```

**If a local run can’t connect:** check network, VPN, and any system proxy settings. For deeper request detail, set **`RUN_VERBOSE_LOGS`** to `true` in `src/main.js` (developer / fork only).

**If a large catalog slows down or stalls:** pass **`handleBatchCooldownMs`** (e.g. `4000`) and **`handleRequestConcurrency`** (`1` or `2`) in API input, or use Apify **Residential** proxy for strict storefronts.

On local runs, **`output.csv`** is also written at the project root (Excel-friendly, `;` separator) so you can open results immediately.

**Tests:** `npm test`

### FAQ

**Can I get stock levels or wholesale prices?**\
Only what the public storefront shows. True inventory and margin data live behind merchant tools.

**Is this an official Shopify integration?**\
No—it reads the same public pages and feeds a shopper would see, assembled into a dataset for you.

**What if I paste a non-Shopify URL?**\
The Actor runs a quick **Shopify check** (catalog JSON, theme assets, or cart API). If the site does not look like Shopify, the run **stops with an error** and no catalog is produced.

**Why fewer rows than the website?**\
Draft items, hidden channels, or geo-gated catalogs may not appear in the public export.

**How do I get help or a custom export?**\
See **Support** below.

### Support

Contact <corentin@outreacher.fr> for custom scrapers, authenticated catalog access, or tailored fields.

**Ready?** Add your store URL, optionally cap **Maximum products per store**, and start a run.

# Actor input Schema

## `startUrls` (type: `array`):

One public shop URL per line (home page is ideal). The Actor checks that the site looks like **Shopify** before scraping; wrong platforms fail fast with an error.

## `maxProducts` (type: `integer`):

**Leave empty** = full catalog for each store. **Number** = stop after that many products (not variants)—handy for a quick test or to control cost.

## `proxyConfiguration` (type: `object`):

Apify Proxy when the shop blocks cloud IPs. Residential usage is billed per GB.

## Actor input object example

```json
{
  "startUrls": [
    "https://www.jimmyfairly.com/"
  ],
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

All collected product rows

## `catalogOverview` (type: `string`):

Slim columns for reporting and spreadsheets

## `runLog` (type: `string`):

Live progress log updated during execution

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "startUrls": [
        "https://www.jimmyfairly.com/"
    ],
    "proxyConfiguration": {
        "useApifyProxy": false
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("corent1robert/shopify-products-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "startUrls": ["https://www.jimmyfairly.com/"],
    "proxyConfiguration": { "useApifyProxy": False },
}

# Run the Actor and wait for it to finish
run = client.actor("corent1robert/shopify-products-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "startUrls": [
    "https://www.jimmyfairly.com/"
  ],
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}' |
apify call corent1robert/shopify-products-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=corent1robert/shopify-products-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Shopify Product Scraper · Full Catalog Export by Store URL",
        "description": "Turn any public Shopify storefront URL into a clean, export-ready product table: titles, handles, variants, SKUs, prices, availability, and image links. Ideal for merchandising teams, market research, and catalog backups. For custom pipelines or private catalog access, contact corentin@outreacher.fr",
        "version": "1.7",
        "x-build-id": "2TiCjzpDxoDi60Ckp"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/corent1robert~shopify-products-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-corent1robert-shopify-products-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/corent1robert~shopify-products-scraper/runs": {
            "post": {
                "operationId": "runs-sync-corent1robert-shopify-products-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/corent1robert~shopify-products-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-corent1robert-shopify-products-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "startUrls"
                ],
                "properties": {
                    "startUrls": {
                        "title": "Shopify store URLs",
                        "type": "array",
                        "description": "One public shop URL per line (home page is ideal). The Actor checks that the site looks like **Shopify** before scraping; wrong platforms fail fast with an error.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "maxProducts": {
                        "title": "Product cap",
                        "minimum": 0,
                        "type": "integer",
                        "description": "**Leave empty** = full catalog for each store. **Number** = stop after that many products (not variants)—handy for a quick test or to control cost."
                    },
                    "proxyConfiguration": {
                        "title": "Proxy",
                        "type": "object",
                        "description": "Apify Proxy when the shop blocks cloud IPs. Residential usage is billed per GB."
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```