# Shopee Scraper Indonesia (`pumpkin_jingo/shopee-scraper-id`) Actor Scrape produk Shopee Indonesia by keyword, URL, shop, atau category - **URL**: https://apify.com/pumpkin\_jingo/shopee-scraper-id.md - **Developed by:** [Hobby Online](https://apify.com/pumpkin_jingo) (community) - **Categories:** E-commerce, Automation, Jobs - **Stats:** 6 total users, 1 monthly users, 100.0% runs succeeded, 1 bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### Shopee Scraper Indonesia Scrape produk dari **Shopee Indonesia** berdasarkan keyword, URL, Shop ID, atau kategori — tanpa perlu API key. Data diambil langsung dari API internal Shopee menggunakan Playwright. ### Fitur - 4 mode scraping: **keyword**, **url** (auto-detect), **shop**, **category** - Filter harga (min/max) dan sort order (relevansi, penjualan, harga, terbaru) - Support **cookie browser** untuk menghindari rate-limit Shopee - Output mencakup harga, diskon, rating, stok, lokasi toko, dan URL produk - Maks 200 produk per run ### Cara kerja Actor menggunakan Playwright untuk intercept response dari API internal Shopee (`/api/v4/search/search_items`, `/api/v4/item/get`, dll) — bukan scraping HTML. Lebih stabil dan cepat dibanding pendekatan CSS selector biasa. ### Input Parameters | Parameter | Tipe | Default | Keterangan | |---|---|---|---| | `mode` | string | `keyword` | Mode scraping: `keyword` / `url` / `shop` / `category` | | `keyword` | string | — | Kata kunci pencarian, contoh: `sepatu nike` | | `url` | string | — | URL Shopee apa saja, tipe auto-detect | | `shopId` | integer | — | Numeric shop ID dari URL Shopee | | `category` | string | — | Category slug, contoh: `/Laptop-cat.11044364.11044440` | | `maxProducts` | integer | `40` | Jumlah produk, maksimum `200` | | `sort` | string | `relevancy` | `relevancy` / `sales` / `price_asc` / `price_desc` / `newest` | | `minPrice` | integer | — | Filter harga minimum (IDR) | | `maxPrice` | integer | — | Filter harga maksimum (IDR) | | `delay` | number | `1.0` | Jeda antar request ke Shopee (detik) | | `cookieString` | string | — | Cookie sesi browser (opsional, disarankan) | ### Output Setiap produk disimpan sebagai satu objek JSON di Apify Dataset: ```json { "shop_id": 21874626, "item_id": 25432764626, "nama_produk": "TAS RANSEL ANAK BING KELINCI HITAM LUCU", "harga": 69300, "harga_asli": 70000, "diskon_pct": 1, "rating": 4.92, "jumlah_rating": 12, "terjual": 48, "stok": 1, "lokasi": "Kab. Bandung Barat", "is_mall": true, "url": "https://shopee.co.id/product-i.21874626.25432764626", "gambar": "https://down-id.img.susercontent.com/file/id-11134207-7r98x-lx1aczrvuy9pb3" } ```` Mode `url` pada halaman produk akan menghasilkan field tambahan: `deskripsi`, `brand`, `kondisi`, `varian`, `nama_toko`, `rating_toko`, `follower_toko`, `response_rate`, dan `gambar_list`. ### Cara Mendapatkan Cookie (Opsional tapi Disarankan) 1. Buka `shopee.co.id` di browser, lalu **login** 2. Tekan **F12** → tab **Network** → refresh halaman 3. Klik salah satu request ke `shopee.co.id` 4. Di tab **Headers**, cari baris `cookie:` lalu **copy seluruh nilainya** 5. Paste ke field `cookieString` di input Actor Cookie membantu menghindari rate-limit dan CAPTCHA dari Shopee. ### Getting Started Jalankan Actor secara lokal: ```bash apify run ``` ### Deploy ke Apify #### Via Git Repository 1. Buka [Actor creation page](https://console.apify.com/actors/new) 2. Klik **Link Git Repository** #### Via Local Machine 1. Login ke Apify: ```bash apify login ``` 2. Deploy Actor: ```bash apify push ``` Actor akan muncul di [Actors → My Actors](https://console.apify.com/actors?tab=my). ### Dokumentasi - [Apify SDK for Python](https://docs.apify.com/sdk/python) - [Apify Platform](https://docs.apify.com/platform) - [Discord Community](https://discord.com/invite/jyEM2PRvMU) # Actor input Schema ## `mode` (type: `string`): Pilih mode scraping: keyword, url, shop, atau category ## `keyword` (type: `string`): Kata kunci pencarian. Digunakan jika mode = keyword. ## `url` (type: `string`): URL Shopee — bisa berupa halaman search, produk, toko, atau kategori. Digunakan jika mode = url. ## `shopId` (type: `integer`): Numeric shop ID dari URL Shopee. Contoh: dari URL shopee.co.id/tokoname ambil angka shopid-nya. Digunakan jika mode = shop. ## `category` (type: `string`): Slug kategori Shopee. Digunakan jika mode = category. ## `maxProducts` (type: `integer`): Maksimum jumlah produk yang diambil per run. Maksimum 200. ## `sort` (type: `string`): Urutan hasil pencarian. ## `minPrice` (type: `integer`): Filter harga minimum dalam Rupiah. Kosongkan jika tidak ingin filter. ## `maxPrice` (type: `integer`): Filter harga maksimum dalam Rupiah. Kosongkan jika tidak ingin filter. ## `delay` (type: `number`): Jeda waktu antar request ke Shopee. Naikkan jika sering kena rate-limit. ## Actor input object example ```json { "mode": "keyword", "keyword": "sepatu nike", "url": "https://shopee.co.id/search?keyword=sepatu", "shopId": 21874626, "category": "/Laptop-cat.11044364.11044440", "maxProducts": 40, "sort": "relevancy", "minPrice": 50000, "maxPrice": 500000, "delay": 1 } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "keyword": "sepatu" }; // Run the Actor and wait for it to finish const run = await client.actor("pumpkin_jingo/shopee-scraper-id").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "keyword": "sepatu" } # Run the Actor and wait for it to finish run = client.actor("pumpkin_jingo/shopee-scraper-id").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "keyword": "sepatu" }' | apify call pumpkin_jingo/shopee-scraper-id --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=pumpkin_jingo/shopee-scraper-id", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shopee Scraper Indonesia", "description": "Scrape produk Shopee Indonesia by keyword, URL, shop, atau category", "version": "1.0", "x-build-id": "E8SQ7ESOx9BByTe4s" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/pumpkin_jingo~shopee-scraper-id/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-pumpkin_jingo-shopee-scraper-id", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/pumpkin_jingo~shopee-scraper-id/runs": { "post": { "operationId": "runs-sync-pumpkin_jingo-shopee-scraper-id", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/pumpkin_jingo~shopee-scraper-id/run-sync": { "post": { "operationId": "run-sync-pumpkin_jingo-shopee-scraper-id", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "keyword", "url", "shop", "category" ], "type": "string", "description": "Pilih mode scraping: keyword, url, shop, atau category", "default": "keyword" }, "keyword": { "title": "Keyword", "type": "string", "description": "Kata kunci pencarian. Digunakan jika mode = keyword.", "default": "sepatu" }, "url": { "title": "URL Shopee", "type": "string", "description": "URL Shopee — bisa berupa halaman search, produk, toko, atau kategori. Digunakan jika mode = url." }, "shopId": { "title": "Shop ID", "type": "integer", "description": "Numeric shop ID dari URL Shopee. Contoh: dari URL shopee.co.id/tokoname ambil angka shopid-nya. Digunakan jika mode = shop." }, "category": { "title": "Category Slug", "type": "string", "description": "Slug kategori Shopee. Digunakan jika mode = category." }, "maxProducts": { "title": "Max Products", "minimum": 1, "maximum": 200, "type": "integer", "description": "Maksimum jumlah produk yang diambil per run. Maksimum 200.", "default": 40 }, "sort": { "title": "Sort Order", "enum": [ "relevancy", "sales", "price_asc", "price_desc", "newest" ], "type": "string", "description": "Urutan hasil pencarian.", "default": "relevancy" }, "minPrice": { "title": "Harga Minimum (IDR)", "minimum": 0, "type": "integer", "description": "Filter harga minimum dalam Rupiah. Kosongkan jika tidak ingin filter." }, "maxPrice": { "title": "Harga Maximum (IDR)", "minimum": 0, "type": "integer", "description": "Filter harga maksimum dalam Rupiah. Kosongkan jika tidak ingin filter." }, "delay": { "title": "Delay antar request (detik)", "minimum": 0.5, "maximum": 10, "type": "number", "description": "Jeda waktu antar request ke Shopee. Naikkan jika sering kena rate-limit.", "default": 1 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```