# Shopee Scraper - All In One (`xtracto/shopee-scraper`) Actor All-in-one Shopee scraper to extract product, search, category, and shop data across multiple countries—fast, lightweight, and no browser or proxy required. - **URL**: https://apify.com/xtracto/shopee-scraper.md - **Developed by:** [Xtractoo](https://apify.com/xtracto) (community) - **Categories:** E-commerce, Lead generation, Other - **Stats:** 18 total users, 9 monthly users, 89.3% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $10.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shopee Scraper Extract product data from Shopee across **11 countries** - keyword search, category browsing, product detail, and shop listings. No browser automation, no proxy required for most regions. --- ### Why Use This Actor? Shopee does not provide a public API. Most scraping solutions rely on full browser automation (Playwright/Puppeteer), which is slow, expensive, and fragile. This actor works without launching a browser at all, making it: - **Fast** - lightweight HTTP requests instead of rendering a full browser - **Cost-efficient** - lower compute unit consumption - **Stable** - no dependency on browser fingerprinting or JS rendering pipelines #### Supported Countries | Code | Domain | |------|--------| | `id` | shopee.co.id (Indonesia) | | `sg` | shopee.sg (Singapore) | | `my` | shopee.com.my (Malaysia) | | `th` | shopee.co.th (Thailand) | | `ph` | shopee.ph (Philippines) | | `vn` | shopee.vn (Vietnam) | | `br` | shopee.com.br (Brazil) | | `tw` | shopee.tw (Taiwan) | | `mx` | shopee.com.mx (Mexico) | | `co` | shopee.com.co (Colombia) | | `cl` | shopee.cl (Chile) | --- ### Use Cases - **Price monitoring** - track price changes across products or categories over time - **Competitor research** - analyze competitor shop listings, pricing tiers, and discount strategies - **Market research** - discover bestselling products in a category or keyword segment - **Product catalog extraction** - pull product titles, images, attributes, and variants from a shop or search result - **Lead generation** - collect seller info (shop name, location, rating, follower count, response rate) --- ### Input | Field | Type | Required | Description | |-------|------|----------|-------------| | `country` | select | No (default: `id`) | Shopee regional domain to scrape | | `mode` | select | **Yes** | Scraping mode (see below) | | `keyword` | string | mode=keyword | Search term, e.g. `"laptop gaming"` | | `url` | string | mode=url | Any Shopee URL - product, search, category, or shop page | | `shopId` | integer | mode=detail | Seller's numeric shop ID | | `itemId` | integer | mode=detail | Product's numeric item ID | | `category` | string | mode=category | Category slug, e.g. `/Laptop-cat.11044364.11044440` | | `shop` | string | mode=shop | Shop username or numeric shop ID | | `sort` | select | No (default: `relevancy`) | Sort order for search/category results | | `maxProducts` | integer | No (default: `40`) | Maximum products to return | | `minPrice` | integer | No | Minimum price filter in local currency (keyword mode only) | | `maxPrice` | integer | No | Maximum price filter in local currency (keyword mode only) | | `delay` | number | No (default: `1.0`) | Delay in seconds between requests | #### Modes Explained ##### `keyword` - Search by keyword Searches Shopee for a keyword and returns product cards (name, price, discount, images, IDs, location). > **Note:** Results are capped at ~40 products per sort variant. To get more products, increase `maxProducts` - the actor will automatically cycle through additional sort orders (`sales`, `newest`, `price_asc`, `price_desc`) to surface more unique results. ##### `url` - Auto-detect from any Shopee URL Paste any Shopee URL and the actor auto-detects whether it's a product page, search result, category, or shop listing. Country is also auto-detected from the URL domain, so you can paste a `shopee.sg` URL even when the country input is set to `id`. ##### `detail` - Product detail by Shop ID + Item ID Fetches full detail for a single product: description, all attributes, variants (names + stock availability), seller info, breadcrumb, and pricing when available. You need the **Shop ID** and **Item ID**, which can both be found in the product URL: ```` https://shopee.co.id/Product-Name-i.{SHOP\_ID}.{ITEM\_ID} ↑ ↑ ```` ##### `category` - Browse a category page Provide a category slug (e.g. `/Laptop-cat.11044364.11044440`) or a full category URL. Returns up to `maxProducts` product cards from that category. ##### `shop` - Fetch a shop's product listing Provide a shop username (e.g. `rasyidjaya_computer`) or a numeric shop ID. Returns product cards from that shop's storefront. --- ### Sample Input & Output #### Example 1 - Keyword Search **Input:** ```json { "country": "id", "mode": "keyword", "keyword": "laptop gaming", "sort": "sales", "maxProducts": 40 } ```` **Output (one item):** ```json { "shop_id": 12345678, "item_id": 98765432100, "name": "Laptop Gaming ASUS ROG Strix G15 Ryzen 7 16GB 512GB RTX3060", "url": "https://shopee.co.id/Laptop-Gaming-ASUS-ROG-i.12345678.98765432100", "image_url": "https://down-id.img.susercontent.com/file/id-11134207-xxx", "price": 14999000, "original_price": 17500000, "discount_pct": 14, "rating": 4.9, "rating_count": 312, "sold_count": 1200, "location": "Jakarta Barat", "is_mall": false, "currency": "IDR" } ``` #### Example 2 - Product Detail **Input:** ```json { "country": "id", "mode": "detail", "shopId": 196846900, "itemId": 11089699432 } ``` **Output:** ```json { "shop_id": 196846900, "item_id": 11089699432, "title": "Laptop Lenovo Thinkpad X1 Carbon 6th Intel Core i5 Gen8 Ram 16gb Ssd 256gb Bergaransi", "currency": "IDR", "brand": "Lenovo", "condition": 4, "price": 3570000.0, "price_min": 3200000.0, "price_max": 8370000.0, "availability": "InStock", "rating_star": 4.87, "total_ratings": 55, "stock": 31, "is_hide_stock": false, "images": [ "https://down-id.img.susercontent.com/file/id-11134207-7ra0n-xxx" ], "attributes": [ { "name": "Ukuran Layar", "value": "14 inci" }, { "name": "Sistem Operasi", "value": "Windows" } ], "models": [ { "model_id": 227787022248, "name": "Carbon 6th i5 Gen8,RAM 16GB/256GB SSD", "price": null, "stock": null, "has_stock": true } ], "tier_variations": [], "breadcrumb": [ { "position": 1, "name": "Shopee", "url": "https://shopee.co.id" }, { "position": 2, "name": "Komputer & Aksesoris" }, { "position": 3, "name": "Laptop" } ], "shop": { "shopid": 196846900, "name": "RASYIDJAYA COMPUTER", "username": "rasyidjaya_computer", "location": "KOTA BANDUNG", "rating_star": 4.84, "item_count": 120, "follower_count": 2248, "response_rate": 98 } } ``` #### Example 3 - URL Auto-detect **Input:** ```json { "mode": "url", "url": "https://shopee.co.id/search?keyword=mouse+wireless", "maxProducts": 20 } ``` Returns the same format as keyword search. Country is auto-detected from the URL. *** ### Known Limitations - **Per-variant prices are not always available.** Shopee does not expose per-model pricing without authenticated browser sessions. For products with multiple variants (size/color/spec), individual model prices will appear as `null`. An overall price range (`price_min` / `price_max`) is available for most products. - **Sold count is unreliable.** Shopee intentionally hides sold count in most data sources - it is not available via API or page data. The actor makes a best-effort attempt to parse it from rendered page text, with partial (~30-50%) coverage. Many products will return `null` for `sold_count` / `sold`. - **Search is capped at ~40 results per page.** Shopee’s SEO-rendered search returns at most 40 products per request. Because this actor uses HTTP-only requests (no authenticated browser session), deeper pagination is not available. The actor can exceed this limit by rotating sort orders, but some overlap may occur and the total unique results can be lower than `maxProducts` for smaller queries. - **Search pagination beyond page 1 is not supported for category pages** Only the first page of category results is accessible without an authenticated browser session. Since this actor does not use browser automation or login, it cannot retrieve deeper pages that require client-side navigation or authenticated requests. - **Not suitable for real-time flash sale pricing.** Flash sale and voucher prices require an authenticated browser session and cannot be obtained via HTTP-only methods. # Actor input Schema ## `country` (type: `string`): Shopee regional domain to scrape. ## `mode` (type: `string`): Scraping mode. ## `keyword` (type: `string`): Search keyword. Required for mode=keyword. ## `url` (type: `string`): Any Shopee URL: product page, search result, category, or shop. Required for mode=url. ## `shopId` (type: `integer`): Seller shop ID. Required for mode=detail. ## `itemId` (type: `integer`): Product item ID. Required for mode=detail. ## `category` (type: `string`): Category slug or full URL. e.g. /Laptop-cat.11044364.11044440. Required for mode=category. ## `shop` (type: `string`): Shop username or numeric shop ID. Required for mode=shop. ## `sort` (type: `string`): Sort order for search/category results. ## `maxProducts` (type: `integer`): Maximum number of products to return. Note: Shopee SEO render is capped at ~40 per sort variant. ## `minPrice` (type: `integer`): Minimum price in local currency units (e.g. IDR, SGD). Only applies to keyword search. ## `maxPrice` (type: `integer`): Maximum price in local currency units. Only applies to keyword search. ## `delay` (type: `number`): Delay between HTTP requests to reduce rate-limit risk. ## `fetchDetail` (type: `boolean`): Jika true, setiap product card pada mode keyword/category/shop/url akan di-enrich dengan data lengkap (harga varian, stok, atribut, gambar, dll). Lebih lambat dan menggunakan lebih banyak request. Tidak berlaku untuk mode=detail (selalu lengkap). ## Actor input object example ```json { "country": "id", "mode": "keyword", "sort": "relevancy", "maxProducts": 40, "delay": 1, "fetchDetail": false } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("xtracto/shopee-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("xtracto/shopee-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call xtracto/shopee-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=xtracto/shopee-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shopee Scraper - All In One", "description": "All-in-one Shopee scraper to extract product, search, category, and shop data across multiple countries—fast, lightweight, and no browser or proxy required.", "version": "0.1", "x-build-id": "waRsc7X22bjhrceN6" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/xtracto~shopee-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-xtracto-shopee-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/xtracto~shopee-scraper/runs": { "post": { "operationId": "runs-sync-xtracto-shopee-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/xtracto~shopee-scraper/run-sync": { "post": { "operationId": "run-sync-xtracto-shopee-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "country": { "title": "Country", "enum": [ "id", "sg", "my", "th", "ph", "vn", "br", "tw", "mx", "co", "cl" ], "type": "string", "description": "Shopee regional domain to scrape.", "default": "id" }, "mode": { "title": "Mode", "enum": [ "keyword", "url", "detail", "category", "shop" ], "type": "string", "description": "Scraping mode.", "default": "keyword" }, "keyword": { "title": "Keyword", "type": "string", "description": "Search keyword. Required for mode=keyword." }, "url": { "title": "Shopee URL", "type": "string", "description": "Any Shopee URL: product page, search result, category, or shop. Required for mode=url." }, "shopId": { "title": "Shop ID", "type": "integer", "description": "Seller shop ID. Required for mode=detail." }, "itemId": { "title": "Item ID", "type": "integer", "description": "Product item ID. Required for mode=detail." }, "category": { "title": "Category", "type": "string", "description": "Category slug or full URL. e.g. /Laptop-cat.11044364.11044440. Required for mode=category." }, "shop": { "title": "Shop", "type": "string", "description": "Shop username or numeric shop ID. Required for mode=shop." }, "sort": { "title": "Sort order", "enum": [ "relevancy", "sales", "newest", "price_asc", "price_desc" ], "type": "string", "description": "Sort order for search/category results.", "default": "relevancy" }, "maxProducts": { "title": "Max products", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of products to return. Note: Shopee SEO render is capped at ~40 per sort variant.", "default": 40 }, "minPrice": { "title": "Min price filter", "type": "integer", "description": "Minimum price in local currency units (e.g. IDR, SGD). Only applies to keyword search." }, "maxPrice": { "title": "Max price filter", "type": "integer", "description": "Maximum price in local currency units. Only applies to keyword search." }, "delay": { "title": "Request delay (seconds)", "minimum": 0, "maximum": 10, "type": "number", "description": "Delay between HTTP requests to reduce rate-limit risk.", "default": 1 }, "fetchDetail": { "title": "Fetch full product detail", "type": "boolean", "description": "Jika true, setiap product card pada mode keyword/category/shop/url akan di-enrich dengan data lengkap (harga varian, stok, atribut, gambar, dll). Lebih lambat dan menggunakan lebih banyak request. Tidak berlaku untuk mode=detail (selalu lengkap).", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```