# Shopify Products Scraper — Full Catalog & Shards (`bakos_bence/shopify-products-scraper`) Actor

Extract every public product from Shopify stores — titles, vendors, prices with currency, variants, stock, and images. Collection sharding past the 25k catalog cap. Multi-store runs, optional localization cookies, JSON/CSV export.

- **URL**: https://apify.com/bakos\_bence/shopify-products-scraper.md
- **Developed by:** [Bakos Bence](https://apify.com/bakos_bence) (community)
- **Categories:** E-commerce, Developer tools
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.38 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

### What does Shopify Products Scraper do?

**Extract the full public product catalogue** from any Shopify store domain — paste the store URL or domain and get **titles, vendors, prices with currency, variants, images, and availability**. No Shopify API key and no collection URLs required; optional collection sharding covers very large catalogs.

**Unofficial.** This Actor is **not affiliated with, endorsed by, or maintained by Shopify Inc.** It reads **public** storefront catalogue pages only.

**Dashboards:** connect **Power BI**, **Tableau**, **Looker Studio**, or **Qlik** to the dataset API — see *Export to Power BI, Tableau, Looker Studio & Qlik* near the end. **AI agents:** paste this Actor’s Store page URL into an Apify-capable agent (MCP / Claude / Cursor with Apify), create an Apify account and API token once, and the agent can run the Actor and wire up the output.

Schedule runs, export **JSON/CSV/Excel**, or call via **API / MCP**.

**Other product catalog scrapers:** [eMAG Product Scraper](https://apify.com/bakos_bence/emag-products) (RO/BG/HU marketplace) and [Chrono24 Watch Listings Scraper](https://apify.com/bakos_bence/chrono24-listings) (luxury watch listings) — useful when you monitor prices across Shopify boutiques, CEE marketplaces, and secondary-market watches. Fashion resale / retail: [Vestiaire Collective Scraper](https://apify.com/bakos_bence/vestiaire-collective), [Grailed Listings Scraper](https://apify.com/bakos_bence/grailed-listings), [H\&M Product Scraper](https://apify.com/bakos_bence/hm-products).

#### Why use this Shopify scraper?

- 🏪 **Store domain only** — paste `gymshark.com` or a full URL
- 📦 Automatic pagination (250 products per page)
- 🧩 **Collection sharding** when catalogues exceed Shopify’s ~25k product cap
- 💱 Optional `currency` / `localization` cookies for price context
- 🛡️ Reliable access with automatic retries when a store blocks plain requests
- 🔁 Multi-store runs in one input list

#### What Shopify product data can you extract?

| Fields | Meaning |
|--------|---------|
| `store`, `title`, `vendor`, `url` | Store, title, brand, product URL |
| `currency`, `priceMin`, `priceMax` | Prices with currency |
| `available`, `variantCount`, `variants` | Stock and variant detail |
| `images` / image URLs | CDN images |
| `handle`, `productId` | Stable identifiers |

#### Use cases

- Competitor **price monitoring** on Shopify boutiques
- Catalogue exports for **market research**
- Inventory / availability snapshots
- Multi-store assortment comparison

#### How to scrape all products from a Shopify store

1. Open this Actor in [Apify Console](https://console.apify.com/).
2. Click **Start** on the prefilled store (`maxProducts` 5).
3. Add more `storeUrls` (domain or URL) and raise the cap when ready.
4. For huge catalogues, enable `useCollectionShards`.
5. Leave proxy off unless you see HTTP 403; then enable Apify Proxy.
6. Export the dataset, or open the **Issues** tab on this Store page if a run fails.

#### How much does it cost to scrape Shopify products?

**PPE:** Actor start + each product **result**. Free plan is about **$2.75 / 1,000** depending on your configured tiers — check the Pricing tab. Cap with `maxProducts`.

#### Input

| Field | Description |
|-------|-------------|
| `storeUrls` | Required. Domains or URLs |
| `maxProducts` | Cap per store (`0` = unlimited) |
| `collectionHandles` | Extra collections to scrape |
| `useCollectionShards` | Walk collections after ~25k products |
| `currency` / `localization` | Price-context cookies |
| `sleepSeconds` | Polite delay between pages |
| `proxyConfiguration` | Enable on 403 / rate limits |

#### Sample output

```json
{
  "store": "hardlyeverwornit.com",
  "storeUrl": "https://hardlyeverwornit.com",
  "productId": 8234567890123,
  "title": "Example Item",
  "handle": "example-item",
  "url": "https://hardlyeverwornit.com/products/example-item",
  "vendor": "Brand",
  "currency": "GBP",
  "priceMin": 120.0,
  "priceMax": 120.0,
  "available": true,
  "variantCount": 1,
  "variants": [{ "sku": "ABC", "price": "120.00", "available": true }],
  "images": ["https://cdn.shopify.com/..."]
}
```

#### FAQ

##### Does every Shopify store work?

Most classic Online Store themes do. Headless / Hydrogen storefronts that do not expose a public product catalogue may fail — those need a different approach.

##### Why do I stop around 25,000 products?

Shopify caps a single catalogue walk around ~25k products. Enable `useCollectionShards` to continue via collections.

##### Is this official Shopify software?

No. It is unofficial and not affiliated with Shopify. It only reads public storefront catalogues.

##### Is scraping Shopify product data legal?

This Actor reads **public storefront catalogue** data. Review the target site’s terms and your use case.

##### Monitoring non-Shopify catalogs too?

Use [eMAG Product Scraper](https://apify.com/bakos_bence/emag-products) for emag.ro/.bg/.hu category/search URLs, or [Chrono24 Watch Listings Scraper](https://apify.com/bakos_bence/chrono24-listings) for luxury watch listings — same “price + currency + URL” monitoring pattern, different sources.

#### Related Actors

| Actor | Use together when… |
|-------|-------------------|
| [eMAG Product Scraper](https://apify.com/bakos_bence/emag-products) | You also track **CEE marketplace** SKUs (Romania, Bulgaria, Hungary) |
| [Chrono24 Watch Listings Scraper](https://apify.com/bakos_bence/chrono24-listings) | You monitor **luxury watch** listing prices alongside fashion/product catalogs |
| [LEGO.com Product Scraper](https://apify.com/bakos_bence/lego-products) | You also track **official LEGO.com** set MSRP next to boutique Shopify catalogs |
| [Vestiaire Collective Scraper](https://apify.com/bakos_bence/vestiaire-collective) | You add **designer resale** next to watches / Shopify catalogs |
| [Grailed Listings Scraper](https://apify.com/bakos_bence/grailed-listings) | You add **streetwear resale** listings |
| [H\&M Product Scraper](https://apify.com/bakos_bence/hm-products) | You anchor against **fast-fashion retail** prices |
| [Shopify Products Scraper](https://apify.com/bakos_bence/shopify-products-scraper) | *(this Actor)* — any public Shopify store catalogue |

Profile: [bakos\_bence on Apify](https://apify.com/bakos_bence)

#### For AI agents & LLM apps

Paste this Actor’s **Apify Store URL** into an agent that can use Apify (MCP, Claude, Cursor, etc.). With an Apify account and API token, the agent can set input, run the Actor, and fetch the dataset.

**Actor ID:** `bakos_bence/shopify-products-scraper`

**Purpose:** Full public Shopify catalogue from a store domain, with optional collection sharding past the 25k product cap.

**Minimal input:**

```json
{ "storeUrls": ["https://hardlyeverwornit.com"], "maxProducts": 100 }
```

**Output:** one dataset row per product with prices, variants, images, availability.

#### Export to Power BI, Tableau, Looker Studio & Qlik

After a run, rows live in an Apify **dataset**. You can download JSON/CSV/Excel from the Dataset tab, or point BI tools at a **CSV URL** that refreshes when you scrape again.

**Prefer the token in the URL** (`token=`) — most tools only need “open this link as CSV”, with no custom headers.

##### Build a refreshable CSV URL

1. In Apify Console, open **Settings → Integrations** and copy an API token.
2. Save this Actor as a **Task** (optional but best for dashboards), run or **schedule** it once so there is a successful run.
3. Use the **latest successful task run** URL (replace `TASK_ID` and `YOUR_TOKEN`):

```text
https://api.apify.com/v2/actor-tasks/TASK_ID/runs/last/dataset/items?format=csv&clean=true&status=SUCCEEDED&token=YOUR_TOKEN
```

Or, from any finished run, open the **Dataset** tab, copy the dataset ID, and use:

```text
https://api.apify.com/v2/datasets/DATASET_ID/items?format=csv&clean=true&token=YOUR_TOKEN
```

Anyone with that URL can read the data — treat it like a password. For recurring dashboards, prefer the `actor-tasks/…/runs/last/…` form so refresh always hits the newest successful scrape.

##### Power BI

1. Open Power BI Desktop → **Home** → **Get data** → **Web**.
2. Paste the CSV URL (including `token=`).
3. When asked how to sign in, choose **Anonymous** → **Connect**.
4. Confirm the preview is a table (CSV). **Load** or **Transform data** as needed.
5. Publish / schedule refresh in the Power BI service using the same URL (task `runs/last` keeps it current after each scrape).

`401`: token missing/wrong, or you did not pick **Anonymous**.

##### Tableau

1. Install Tableau’s **REST API** connector from Tableau Exchange (Desktop **2023.3+**).
2. **Connect** → **To a Server** → **REST API**.
3. Paste the CSV URL (including `token=`). Set response format to **CSV**.
4. If the connector asks for auth and the token is already in the URL, leave credentials empty / anonymous; otherwise paste the same token as a Bearer access token.
5. Create an **extract**. Refresh the extract after scheduled Task runs (or point at `runs/last` so each refresh loads the latest success).

Plain **Text file** connect still works if you download CSV from the Dataset tab once — use REST when you want repeatable refresh.

##### Looker Studio

Looker Studio has no strong built-in “private CSV API” connector. Use Google Sheets as the bridge:

1. Create a Google Sheet. In **A1** enter:

```text
=IMPORTDATA("https://api.apify.com/v2/actor-tasks/TASK_ID/runs/last/dataset/items?format=csv&clean=true&status=SUCCEEDED&token=YOUR_TOKEN")
```

2. Wait until columns fill (Sheets refreshes IMPORTDATA periodically).
3. In Looker Studio → **Create** → **Report** → **Google Sheets** → select that spreadsheet / tab.
4. Build the report. After each Actor/Task run, refresh the Sheet (or wait for IMPORTDATA) then refresh the Looker data source.

One-off alternative: Dataset tab → download CSV → Looker Studio **File upload**.

##### Qlik

**REST connector** (refreshable):

1. In Qlik Cloud / Qlik Sense → **Add data** → **REST** (or create a REST connection in the Data load editor).
2. URL = the CSV URL including `token=`. Method **GET**.
3. Set the expected response type to **CSV** (or use `format=json` and JSON mode).
4. **Test connection**, pick the table, **Add** / **Load**.
5. **Reload** the app after scheduled scrapes; with `runs/last`, each reload pulls the latest successful dataset.

**Files:** Dataset tab → download CSV → **Add data** → upload the file (fine for a single snapshot).

#### SEO keywords

shopify products scraper, scrape shopify store, shopify catalogue scraper, shopify price monitoring, extract shopify products, shopify variants scraper, shopify inventory scraper, ecommerce product scraper api

# Actor input Schema

## `storeUrls` (type: `array`):

Paste Shopify store domains or URLs (e.g. hardlyeverwornit.com).

## `maxProducts` (type: `integer`):

Cap products per store. 0 or empty = no limit. Prefill 5 for a cheap first run.

## `maxProductsPerStore` (type: `integer`):

Leave empty unless you use the bisketapis alias. Same cap as Max products. Prefill 5 for a cheap first run; 0 = unlimited.

## `outputGranularity` (type: `string`):

Choose nested products (default) or one row per variant.

## `includeUnavailable` (type: `boolean`):

When outputting variants, include out-of-stock options.

## `collectionHandles` (type: `array`):

Optionally scrape extra collection handles (sale, new-arrivals, …).

## `useCollectionShards` (type: `boolean`):

Turn on to walk collections automatically when a store hits Shopify’s ~25k product cap.

## `currency` (type: `string`):

Set the cart\_currency cookie (GBP, USD, EUR, …).

## `localization` (type: `string`):

Set the localization country cookie (GB, US, DE, …).

## `sleepSeconds` (type: `number`):

Set a polite delay between paginated API calls.

## `requestDelayMs` (type: `integer`):

Same delay in milliseconds — bisketapis alias for sleepSeconds.

## `proxyConfiguration` (type: `object`):

Leave off unless you see 403 or rate limits.

## Actor input object example

```json
{
  "storeUrls": [
    "https://hardlyeverwornit.com",
    "gymshark.com"
  ],
  "maxProducts": 5,
  "maxProductsPerStore": 5,
  "outputGranularity": "product",
  "includeUnavailable": true,
  "collectionHandles": [],
  "useCollectionShards": false,
  "currency": "USD",
  "localization": "US",
  "sleepSeconds": 0.05,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `overview` (type: `string`):

Scraped Shopify products (default dataset).

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "storeUrls": [
        "https://hardlyeverwornit.com"
    ],
    "maxProducts": 5,
    "maxProductsPerStore": 5
};

// Run the Actor and wait for it to finish
const run = await client.actor("bakos_bence/shopify-products-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "storeUrls": ["https://hardlyeverwornit.com"],
    "maxProducts": 5,
    "maxProductsPerStore": 5,
}

# Run the Actor and wait for it to finish
run = client.actor("bakos_bence/shopify-products-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "storeUrls": [
    "https://hardlyeverwornit.com"
  ],
  "maxProducts": 5,
  "maxProductsPerStore": 5
}' |
apify call bakos_bence/shopify-products-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,bakos_bence/shopify-products-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/SLWiLQHNsgqYZmh8l/builds/jFWcePkG6S02Ise3l/openapi.json