# Shopify Store Scraper — Products, Prices & Store Intelligence (`amassuo/shopify-store-intelligence`) Actor
Scrape any public Shopify store: full product catalogs with variants and prices, new-product detection, price-change monitoring, and store tech intelligence (theme + installed apps). No browser, pure JSON endpoints — fast, cheap, and resilient to redesigns.
- **URL**: https://apify.com/amassuo/shopify-store-intelligence.md
- **Developed by:** [oussama dahbi](https://apify.com/amassuo) (community)
- **Categories:** E-commerce, Developer tools, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet
## Pricing
from $5.00 / 1,000 actor starts
This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## Shopify Store Scraper — Products, Prices & Store Intelligence
Scrape **any public Shopify store** — full product catalogs, prices, variants, images — and get **competitor intelligence** on top: detect **new products**, catch **price changes**, and reveal the **theme and apps** a store runs. Works on custom domains, needs zero configuration, and never breaks on storefront redesigns because it reads Shopify's native JSON feeds instead of scraping HTML.
### ⚡ Why this scraper
- 🛒 **Full catalog extraction** — every product with title, vendor, tags, prices, variants (SKU, compare-at price, stock flag, weight) and image URLs
- 🔔 **New-product detection** — run on a schedule and get *only* the products added since your last run
- 📉 **Price-watch mode** — get *only* products whose min/max price moved, with the previous prices included
- 🧠 **Store tech intelligence** — Shopify theme name & version, currency, locale, and 15+ detected apps (Klaviyo, Judge.me, Loox, Yotpo, Recharge, Gorgias, Privy, and more)
- 🎯 **Collection filtering** — scrape just the collections you care about
- 🚀 **No browser, no fragility** — pure JSON endpoints. Fast, cheap, and immune to theme redesigns that kill HTML scrapers
### 🕹️ The four modes
| Mode | What you get | Typical use |
|---|---|---|
| `full_catalog` | Every product in the store | One-off catalog dumps, assortment analysis |
| `new_products_only` | Only products added since your last run | Scheduled launch monitoring |
| `price_watch` | Only products whose price changed, with previous prices | Scheduled repricing intelligence |
| `store_info_only` | Theme, apps, currency, locale — no products | Tech stack research, lead qualification |
The two diff modes keep a snapshot per store in a key-value store. **The first run creates a free baseline** (you'll see a `baseline-created` record); differences flow from the second run onward. Schedule the Actor daily or weekly and you pay only for the *signal* — not for re-downloading thousands of unchanged products.
### 🏁 60-second quickstart
1. Click **Try for free** and open the Actor in Apify Console.
2. Paste a store URL (e.g. `https://allbirds.com`) into **Shopify store URLs**.
3. Keep **Scrape mode** = *Full catalog* and click **Start**.
4. ~30 seconds later, open the **Dataset** tab: your products are there, exportable as JSON, CSV, Excel, or via API.
For monitoring: switch the mode to *Price watch* or *New products only* and add a **Schedule** (e.g. daily at 6:00). That's it.
### 📦 Output fields
Product records (`type`: `product`, `new-product`, or `price-change`):
| Field | Description |
|---|---|
| `storeUrl` | Normalized store base URL |
| `productId` / `handle` / `url` | Shopify product ID, handle, and direct product URL |
| `title` / `vendor` / `productType` / `tags` | Core catalog metadata |
| `createdAt` / `updatedAt` / `publishedAt` | Shopify timestamps |
| `priceMin` / `priceMax` | Cheapest and most expensive variant price |
| `variantCount` / `available` | Number of variants; whether any variant is in stock |
| `variants[]` | Per-variant: `variantId`, `title`, `sku`, `price`, `compareAtPrice`, `available`, `grams` |
| `images[]` | Product image URLs |
| `previousPriceMin` / `previousPriceMax` | Only on `price-change` records — the prices from your last run |
Store intelligence records (`type`: `store-info`):
| Field | Description |
|---|---|
| `title` / `description` | Homepage title and meta description |
| `theme` | `{ name, id, schemaVersion }` of the active Shopify theme |
| `currency` / `locale` | Store currency and language |
| `detectedApps[]` | Installed apps found via fingerprinting (Klaviyo, Loox, Recharge, …) |
### 💰 Pricing (pay per event)
You pay only for what the Actor actually produces:
| Event | Price |
|---|---|
| Actor start | $0.005 per run |
| Product scraped (full catalog) | $0.0015 per product |
| Store intelligence report | $0.02 per store |
| New product detected | $0.003 per product |
| Price change detected | $0.003 per product |
**Worked example — full catalog of a 2,000-product store:**
$0.005 (start) + 2,000 × $0.0015 (products) + $0.02 (store info) ≈ **$3.03**.
And monitoring is far cheaper: a daily *price watch* on that same store where 8 products changed price costs $0.005 + $0.02 + 8 × $0.003 ≈ **$0.05 per day**.
> Free-plan users are limited to 100 products per store — plenty to evaluate the data quality before upgrading.
### ❓ FAQ
**Does it work on custom domains?**
Yes. You don't need the `*.myshopify.com` address — paste the brand's normal domain and the Actor auto-detects whether it runs on Shopify. If a site isn't Shopify, you get a clear `error` record instead of a crash.
**What about password-protected stores?**
Stores behind Shopify's password page (pre-launch or wholesale) don't expose public product feeds. The Actor detects this and reports it as an `error` record with reason `password-protected`; the rest of your stores still run.
**Is scraping Shopify stores legal?**
This Actor only reads data the store itself publishes publicly to every visitor (the same product feeds that power the storefront). It collects no personal data. That said, you are responsible for how you use the data and for compliance with the laws and terms applicable to you — when in doubt, consult a lawyer.
**Can I export to Google Sheets, or pull results via API?**
Yes. Every run's dataset can be downloaded as CSV/Excel/JSON from Apify Console, sent to Google Sheets with Apify's [Google Sheets integration](https://apify.com/apify/google-sheets), or fetched programmatically via the [Apify API](https://docs.apify.com/api/v2) and clients for JavaScript/Python. Webhooks and integrations (Make, Zapier, n8n) work out of the box.
**How is this different from other Shopify scrapers?**
Three things. **(1) Change detection built in** — instead of re-downloading a full catalog daily and diffing it yourself, the `price_watch` and `new_products_only` modes deliver just the changes, so you pay for signal, not dumps. **(2) Store intelligence** — theme and app detection turns a product scraper into a competitor-research tool. **(3) JSON feeds, not HTML** — the Actor reads Shopify's stable product endpoints, so it doesn't break when a store redesigns its theme, and it runs without a browser (faster and cheaper).
**A store returned fewer products than its website shows?**
The public feed contains only *published, online-store-visible* products. Draft, archived, or channel-restricted products are never exposed publicly.
---
⭐ **Finding this Actor useful?** A quick review on the Store page helps other e-commerce folks discover it — and tells me what to build next. Issues and feature requests are very welcome via the Issues tab.
# Actor input Schema
## `storeUrls` (type: `array`):
One or more Shopify store URLs to scrape. Custom domains work fine (e.g. https://allbirds.com) — the Actor auto-detects whether a site runs on Shopify.
## `scrapeMode` (type: `string`):
What to extract. Full catalog scrapes every product. New products only and Price watch compare against a snapshot from your previous run and emit only the differences — perfect for scheduled monitoring. Store info only skips products and returns theme/app/metadata intelligence.
## `maxProductsPerStore` (type: `integer`):
Stop after this many products per store. Use 0 for unlimited. Handy for sampling a large catalog cheaply.
## `includeVariants` (type: `boolean`):
Include the full variant list (SKU, price, compare-at price, availability, weight) on each product record.
## `includeImages` (type: `boolean`):
Include product image URLs on each product record.
## `detectStoreTech` (type: `boolean`):
Fetch the store homepage and detect the Shopify theme, currency, locale and installed apps (Klaviyo, Judge.me, Loox, Recharge and more). Emits one store-info record per store.
## `collectionsFilter` (type: `array`):
Optional list of collection handles (e.g. "mens-shoes") to scrape instead of the whole catalog. Leave empty to scrape all products.
## `trackingKey` (type: `string`):
Optional custom key for the diff snapshot in the key-value store. Use this to keep separate tracking baselines for the same store (e.g. one per collection filter). Defaults to a key derived from the store hostname.
## `proxyConfiguration` (type: `object`):
Proxy settings for the HTTP requests. Apify Proxy (automatic) is recommended to avoid rate limiting on large catalogs.
## Actor input object example
```json
{
"storeUrls": [
"https://allbirds.com"
],
"scrapeMode": "full_catalog",
"maxProductsPerStore": 0,
"includeVariants": true,
"includeImages": true,
"detectStoreTech": true,
"proxyConfiguration": {
"useApifyProxy": true
}
}
````
# Actor output Schema
## `allResults` (type: `string`):
Every record produced by the run: products, price changes, store-info reports, baselines and errors. The "type" field distinguishes them.
## `products` (type: `string`):
Scraped products with prices, availability and variants (full\_catalog and new\_products\_only modes).
## `priceChanges` (type: `string`):
Products whose min/max price moved since the last run, with previous prices (price\_watch mode).
## `storeIntelligence` (type: `string`):
Theme, currency, locale and detected apps for each store.
## `issues` (type: `string`):
Stores skipped with a reason (invalid URL, password-protected, not Shopify) and baseline-created notices from first diff-mode runs.
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"storeUrls": [
"https://allbirds.com"
],
"proxyConfiguration": {
"useApifyProxy": true
}
};
// Run the Actor and wait for it to finish
const run = await client.actor("amassuo/shopify-store-intelligence").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"storeUrls": ["https://allbirds.com"],
"proxyConfiguration": { "useApifyProxy": True },
}
# Run the Actor and wait for it to finish
run = client.actor("amassuo/shopify-store-intelligence").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"storeUrls": [
"https://allbirds.com"
],
"proxyConfiguration": {
"useApifyProxy": true
}
}' |
apify call amassuo/shopify-store-intelligence --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=amassuo/shopify-store-intelligence",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Shopify Store Scraper — Products, Prices & Store Intelligence",
"description": "Scrape any public Shopify store: full product catalogs with variants and prices, new-product detection, price-change monitoring, and store tech intelligence (theme + installed apps). No browser, pure JSON endpoints — fast, cheap, and resilient to redesigns.",
"version": "1.0",
"x-build-id": "g27VtNal0pjJWTWUT"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/amassuo~shopify-store-intelligence/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-amassuo-shopify-store-intelligence",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/amassuo~shopify-store-intelligence/runs": {
"post": {
"operationId": "runs-sync-amassuo-shopify-store-intelligence",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/amassuo~shopify-store-intelligence/run-sync": {
"post": {
"operationId": "run-sync-amassuo-shopify-store-intelligence",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"required": [
"storeUrls"
],
"properties": {
"storeUrls": {
"title": "Shopify store URLs",
"type": "array",
"description": "One or more Shopify store URLs to scrape. Custom domains work fine (e.g. https://allbirds.com) — the Actor auto-detects whether a site runs on Shopify.",
"items": {
"type": "string"
}
},
"scrapeMode": {
"title": "Scrape mode",
"enum": [
"full_catalog",
"new_products_only",
"price_watch",
"store_info_only"
],
"type": "string",
"description": "What to extract. Full catalog scrapes every product. New products only and Price watch compare against a snapshot from your previous run and emit only the differences — perfect for scheduled monitoring. Store info only skips products and returns theme/app/metadata intelligence.",
"default": "full_catalog"
},
"maxProductsPerStore": {
"title": "Max products per store",
"minimum": 0,
"type": "integer",
"description": "Stop after this many products per store. Use 0 for unlimited. Handy for sampling a large catalog cheaply.",
"default": 0
},
"includeVariants": {
"title": "Include variants",
"type": "boolean",
"description": "Include the full variant list (SKU, price, compare-at price, availability, weight) on each product record.",
"default": true
},
"includeImages": {
"title": "Include image URLs",
"type": "boolean",
"description": "Include product image URLs on each product record.",
"default": true
},
"detectStoreTech": {
"title": "Detect store technology",
"type": "boolean",
"description": "Fetch the store homepage and detect the Shopify theme, currency, locale and installed apps (Klaviyo, Judge.me, Loox, Recharge and more). Emits one store-info record per store.",
"default": true
},
"collectionsFilter": {
"title": "Restrict to collections",
"type": "array",
"description": "Optional list of collection handles (e.g. \"mens-shoes\") to scrape instead of the whole catalog. Leave empty to scrape all products.",
"items": {
"type": "string"
}
},
"trackingKey": {
"title": "Custom snapshot key",
"type": "string",
"description": "Optional custom key for the diff snapshot in the key-value store. Use this to keep separate tracking baselines for the same store (e.g. one per collection filter). Defaults to a key derived from the store hostname."
},
"proxyConfiguration": {
"title": "Proxy configuration",
"type": "object",
"description": "Proxy settings for the HTTP requests. Apify Proxy (automatic) is recommended to avoid rate limiting on large catalogs.",
"default": {
"useApifyProxy": true
}
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```