# Shopify & eBay Product Research (`enezli/shopify-ebay-product-research`) Actor

Shopify and eBay product scraper for fast market research. Pulls Shopify (products.json) and eBay listings into one clean, unified schema: every variant, normalized prices, images and stock. Research products, pricing and competitors without manual copy-paste.

- **URL**: https://apify.com/enezli/shopify-ebay-product-research.md
- **Developed by:** [Turgay NANTA](https://apify.com/enezli) (community)
- **Categories:** E-commerce, Automation
- **Stats:** 2 total users, 1 monthly users, 76.2% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 product scrapeds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Shopify & eBay Product Research — Clean Schema, Never Silent

A reliable e-commerce product scraper for **Shopify stores** (public `/products.json`) and **eBay searches**. It returns a **clean, consistent, unified schema** with every variant, normalized prices, and deduplication. Most importantly: it **never silently returns empty** — if a target is blocked, it tells you exactly why.

### What it does
Point it at one or more Shopify stores or eBay search terms, and the actor produces a structured product dataset:

- **One unified schema** for both Shopify and eBay — every row has the same fields.
- **One row per variant** — ideal for price comparison and catalog analysis.
- **Normalized prices** — `"$1,299.00"`, `"1.299,00 €"`, or a raw number → a clean decimal plus an ISO currency code plus a USD equivalent.
- **Deduplication** — the same product/variant appears only once.
- **A data health report** — field-level coverage so you can see at a glance how complete the result is.

### Why it's different
This category is crowded but the quality is poor — popular Shopify scrapers silently return empty pages and break on edge-case prices. This actor is built around three guarantees:

1. **The schema never breaks** — every record has the same keys; a missing field is `null`, never an absent key. Shopify and eBay share one schema, and each variant is its own row.
2. **Honest price parsing** — US (`1,299.00`) and EU (`1.299,00`) formats, currency symbols, and bare numbers are all handled. When the value is ambiguous, nothing is invented — the amount stays `null`.
3. **"Never silent" soft-block detection** — an `HTTP 200` with zero results and a bot-wall marker is reported as `BLOCKED`, not a silent empty page. Statuses: `OK / EMPTY_VALID / BLOCKED / ENDPOINT_DISABLED / RATE_LIMITED / STALE_SELECTOR / HTTP_ERROR`.

This is a deterministic scraper — there is no AI, no LLM, and no guesswork. What you see in the dataset is exactly what was parsed from the source.

### Input
| Field | Description |
|---|---|
| `platform` | `shopify` or `ebay` |
| `storeUrls` | Shopify store addresses (e.g. `allbirds.com`) |
| `searchQueries` | eBay search terms |
| `maxItems` | Total upper limit (one row per variant) |
| `storeCurrency` | (Optional) Shopify store currency; when provided, prices are normalized more reliably |
| `useResidentialProxy` | Use a residential proxy for anti-bot (enabled by default) |

### Output
Delivered in two layers:

- **Dataset (table):** one product/variant per row, always with the same fixed schema: `source` · `product_id` · `variant_id` · `title` · `variant_title` · `handle` · `vendor` · `product_type` · `tags` · `sku` · `price` · `currency` · `price_usd` · `compare_at_price` · `available` · `image` · `images` · `url` · `condition` · `seller` · `shipping`.
- **Run summary (key-value store → `RUN_SUMMARY`):** which target returned what, plus a `data_health` report with English keys (`total_records`, `field_coverage`, `missing_warnings`).

### How to use
1. Choose the `platform` (`shopify` or `ebay`).
2. For Shopify, fill `storeUrls`; for eBay, fill `searchQueries`.
3. Set `maxItems` and keep `useResidentialProxy` on → **Start**.
4. Grab your data from the Dataset tab and the run report from the key-value store.

### Pricing (Pay-Per-Event)
You only pay for what you use: one charge per run, plus one charge per genuinely scraped record. Empty or blocked rows are never billed. No monthly subscription.

### Honest note
eBay uses strong anti-bot protection, so a residential proxy is required, and its listing selectors change over time, so the eBay side may need occasional maintenance. When that happens, the soft-block detection returns an explicit `BLOCKED` / `STALE_SELECTOR` / `EMPTY_VALID` status instead of a silent empty result — so you always know what happened.

# Actor input Schema

## `platform` (type: `string`):

Which source to scrape. Use 'storeUrls' for Shopify stores and 'searchQueries' for eBay.
## `storeUrls` (type: `array`):

Shopify store domains to scrape (e.g. allbirds.com). The public /products.json endpoint is tried first (250 per page). If it is disabled, the status is reported explicitly — it never silently returns empty.
## `searchQueries` (type: `array`):

Terms to search for on eBay. NOTE: eBay uses strong anti-bot protection — a residential proxy is recommended.
## `maxItems` (type: `integer`):

Upper limit of total records to fetch (one row per variant). With Pay-Per-Event, only genuinely scraped records are charged — empty or blocked rows are never billed.
## `storeCurrency` (type: `string`):

The currency of the Shopify store (e.g. USD, EUR, TRY). When provided, prices are normalized more reliably and a USD equivalent is computed. If left empty, the currency is inferred from the price symbol.
## `useResidentialProxy` (type: `boolean`):

Recommended. eBay and some Shopify stores block datacenter IPs. When enabled, an Apify residential proxy is used.

## Actor input object example

```json
{
  "platform": "shopify",
  "storeUrls": [
    "https://www.allbirds.com"
  ],
  "searchQueries": [
    "mechanical keyboard"
  ],
  "maxItems": 1000,
  "storeCurrency": "",
  "useResidentialProxy": true
}
````

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "storeUrls": [
        "https://www.allbirds.com"
    ],
    "searchQueries": [
        "mechanical keyboard"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("enezli/shopify-ebay-product-research").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "storeUrls": ["https://www.allbirds.com"],
    "searchQueries": ["mechanical keyboard"],
}

# Run the Actor and wait for it to finish
run = client.actor("enezli/shopify-ebay-product-research").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "storeUrls": [
    "https://www.allbirds.com"
  ],
  "searchQueries": [
    "mechanical keyboard"
  ]
}' |
apify call enezli/shopify-ebay-product-research --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=enezli/shopify-ebay-product-research",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Shopify & eBay Product Research",
        "description": "Shopify and eBay product scraper for fast market research. Pulls Shopify (products.json) and eBay listings into one clean, unified schema: every variant, normalized prices, images and stock. Research products, pricing and competitors without manual copy-paste.",
        "version": "0.1",
        "x-build-id": "VdnABOFgvZh8EIibL"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/enezli~shopify-ebay-product-research/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-enezli-shopify-ebay-product-research",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/enezli~shopify-ebay-product-research/runs": {
            "post": {
                "operationId": "runs-sync-enezli-shopify-ebay-product-research",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/enezli~shopify-ebay-product-research/run-sync": {
            "post": {
                "operationId": "run-sync-enezli-shopify-ebay-product-research",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "platform"
                ],
                "properties": {
                    "platform": {
                        "title": "Platform",
                        "enum": [
                            "shopify",
                            "ebay"
                        ],
                        "type": "string",
                        "description": "Which source to scrape. Use 'storeUrls' for Shopify stores and 'searchQueries' for eBay.",
                        "default": "shopify"
                    },
                    "storeUrls": {
                        "title": "Shopify store addresses",
                        "type": "array",
                        "description": "Shopify store domains to scrape (e.g. allbirds.com). The public /products.json endpoint is tried first (250 per page). If it is disabled, the status is reported explicitly — it never silently returns empty.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "searchQueries": {
                        "title": "eBay search terms",
                        "type": "array",
                        "description": "Terms to search for on eBay. NOTE: eBay uses strong anti-bot protection — a residential proxy is recommended.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "maxItems": {
                        "title": "Maximum number of records",
                        "minimum": 1,
                        "type": "integer",
                        "description": "Upper limit of total records to fetch (one row per variant). With Pay-Per-Event, only genuinely scraped records are charged — empty or blocked rows are never billed.",
                        "default": 1000
                    },
                    "storeCurrency": {
                        "title": "Store currency (optional)",
                        "type": "string",
                        "description": "The currency of the Shopify store (e.g. USD, EUR, TRY). When provided, prices are normalized more reliably and a USD equivalent is computed. If left empty, the currency is inferred from the price symbol.",
                        "default": ""
                    },
                    "useResidentialProxy": {
                        "title": "Use a residential proxy (anti-bot)",
                        "type": "boolean",
                        "description": "Recommended. eBay and some Shopify stores block datacenter IPs. When enabled, an Apify residential proxy is used.",
                        "default": true
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```