# SHEIN Scraper (All Page Types) (`hypebridge/shein-scraper`) Actor Extracts product listings and product detail data from [SHEIN US](https://us.shein.com/). You can use it to collect products from the homepage, search result pages, supported SHEIN category pages, and direct product pages, then export the results as JSON, CSV, Excel, or HTML from the Dataset tab. - **URL**: https://apify.com/hypebridge/shein-scraper.md - **Developed by:** [Hypebridge](https://apify.com/hypebridge) (community) - **Categories:** E-commerce, Automation, Agents - **Stats:** 3 total users, 1 monthly users, 50.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $20.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### What does SHEIN Product Listing Scraper do? **SHEIN Product Listing Scraper** extracts product listings and product detail data from [SHEIN US](https://us.shein.com/). You can use it to collect products from the homepage, search result pages, supported SHEIN category pages, and direct product pages, then export the results as JSON, CSV, Excel, or HTML from the Dataset tab. This actor is useful when you want a structured catalog of products without manually copying information from the site. It can collect listing-level fields such as product name, price, URL, images, category, and ranking position, and it can also enrich products with extra detail fields such as sizes, colors, materials, brand, seller, and category tree. ### Why scrape SHEIN? - **Track products and pricing**: Monitor current prices, discounts, and product availability across search or category pages. - **Build product datasets**: Export structured fashion catalog data for analysis, research, or internal merchandising workflows. - **Compare categories and search demand**: See what products appear for a keyword or within a supported SHEIN category page. - **Collect richer product detail**: Add product attributes, materials, available colors, and size-level data to listing results. ### What data can SHEIN Product Listing Scraper extract? | Field | Type | Description | | --- | --- | --- | | `sourceUrl` | String | The page URL that produced the product | | `sourceType` | String | Homepage, search, category selection, or direct product source | | `goodsId` | String | SHEIN product identifier | | `title` | String | Product name | | `productUrl` | String | Product page URL | | `imageUrl` | String | Main product image | | `imageUrls` | Array | Product gallery images | | `price` | Number | Current sale price | | `listPrice` | Number | Original price when available | | `discountPercent` | Number | Discount percentage when available | | `categoryId` | String | SHEIN category ID when available | | `searchKeyword` | String | Search term for search-result runs | | `selectId` | String | Category selection identifier for supported category pages | | `attributes` | Array | Product attributes such as fit, neckline, material, and care | | `material` | Array | Material and composition details | | `colors` | Array | Available color variants | | `sizes` | Array | Size and stock breakdown when available | | `brand` | Object | Brand name and code | | `seller` | Object | Seller or store information | The full field list is available in the **Output** tab. ### Supported URLs | Type | Example | | --- | --- | | Homepage | `https://us.shein.com/` | | Search | `https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord` | | Supported category page | `https://us.shein.com/RecommendSelection/Men-Clothing-sc-017172963.html` | | Direct product page | `https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1` | Standard `/c-{id}.html` category pages are not supported in this version. ### How to scrape SHEIN 1. Open **SHEIN Product Listing Scraper** on Apify. 2. Add one or more supported `startUrls`. 3. Set `maxItems` to control the size of the run. 4. Set `maxPagesPerStartUrl` if you want to limit pagination. 5. Keep `enrichProductDetail` enabled if you want sizes, colors, materials, and other detail fields. 6. Start the run and download results from the **Dataset** tab. ### Input See the **Input** tab for the full schema. The main fields are: | Parameter | Type | Default | Description | | --- | --- | --- | --- | | `startUrls` | Array | required | Homepage, search, supported category, or direct product URLs to scrape | | `maxItems` | Number | `500` | Maximum number of products to output. Use `0` for unlimited | | `maxPagesPerStartUrl` | Number | `10` | Maximum number of pages to process per input URL | | `enrichProductDetail` | Boolean | `true` | Adds product detail fields to listing results. Direct product page inputs still return detail records even if this is disabled | | `maxConcurrency` | Number | `2` | Number of browser pages processed in parallel | | `debugMode` | Boolean | `false` | Saves extra run artifacts for troubleshooting | #### Example input ```json { "startUrls": [ { "url": "https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord" }, { "url": "https://us.shein.com/RecommendSelection/Men-Clothing-sc-017172963.html" }, { "url": "https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1" } ], "maxItems": 100, "maxPagesPerStartUrl": 2, "enrichProductDetail": true } ```` ### Output Results are stored in the **Dataset** tab and can be downloaded as JSON, CSV, Excel, or HTML. Each item can include: - **Listing data**: title, product URL, images, price, discount, category, ranking - **Source metadata**: source URL, source type, search keyword, category selection ID - **Detail enrichment**: attributes, materials, colors, sizes, brand, seller, stock, category tree #### Sample output ```json { "sourceUrl": "https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord&page=1", "sourceType": "search", "goodsId": "11133529", "title": "SHEIN EZwear Ripped Raw Trim Denim Shorts Y2k", "productUrl": "https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1", "imageUrl": "https://img.ltwebstatic.com/images3_pi/2023/02/01/example_thumbnail_900x.webp", "price": 23.24, "listPrice": 36.52, "discountPercent": 36, "categoryId": "1935", "searchKeyword": "shorts", "enriched": true } ``` ### Tips - Use smaller `maxItems` values when testing new inputs. - Keep `enrichProductDetail` enabled only when you need the extra fields. - If a product is missing some optional detail fields, the rest of the record will still be saved. ### FAQ #### Can this scrape product detail pages too? Yes. You can provide a direct product page as a start URL. The actor will return the product detail record for that URL even if `enrichProductDetail` is off, while listing URLs use that setting to decide whether to fetch extra detail. #### Does it support every SHEIN category URL? No. This version supports the homepage, search pages, supported `RecommendSelection` category pages, and direct product pages on `us.shein.com`. #### Can I export the results? Yes. Results are stored in the **Dataset** tab and can be downloaded as JSON, CSV, Excel, or HTML. ### Support - Questions or feature requests: use the Actor page or your internal issue tracker - Programmatic access: use the **API** tab in Apify # Actor input Schema ## `startUrls` (type: `array`): SHEIN URLs to scrape — homepage, search results, supported RecommendSelection category pages, or direct product detail pages. ## `maxItems` (type: `integer`): Maximum number of products to extract across all sources. Set to 0 for unlimited. ## `maxPagesPerStartUrl` (type: `integer`): Maximum number of paginated pages to crawl for each input URL. Each page returns up to 120 products. ## `enrichProductDetail` (type: `boolean`): Fetch full product details (sizes, colors, material, reviews, stock, shipping) for each listing. Direct product detail URLs still return detail records even when this is off. Charges one event per product. Disable for faster list-only snapshots from listing pages. ## `maxConcurrency` (type: `integer`): Browser pages processed in parallel. Keep low — SHEIN rate-limits warmed sessions aggressively. ## `debugMode` (type: `boolean`): Save screenshots and HTML to the key-value store when a block or malformed response is encountered. ## `proxyConfiguration` (type: `object`): Residential proxies are strongly recommended — datacenter IPs hit SHEIN's risk pages quickly. ## Actor input object example ```json { "startUrls": [ { "url": "https://us.shein.com/" }, { "url": "https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord" }, { "url": "https://us.shein.com/RecommendSelection/Men-Clothing-sc-017172963.html" }, { "url": "https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1" } ], "maxItems": 100, "maxPagesPerStartUrl": 3, "enrichProductDetail": false, "maxConcurrency": 2, "debugMode": false, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `defaultView` (type: `string`): Complete dataset with every extracted field. ## `overviewView` (type: `string`): Overview dataset view with the most commonly used listing fields. ## `files` (type: `string`): Debug screenshots, HTML, and payload metadata saved to the default key-value store when debug mode is enabled. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://us.shein.com/" }, { "url": "https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord" }, { "url": "https://us.shein.com/RecommendSelection/Men-Clothing-sc-017172963.html" }, { "url": "https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1" } ], "maxItems": 100, "maxPagesPerStartUrl": 3, "enrichProductDetail": false, "maxConcurrency": 2, "debugMode": false, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("hypebridge/shein-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [ { "url": "https://us.shein.com/" }, { "url": "https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord" }, { "url": "https://us.shein.com/RecommendSelection/Men-Clothing-sc-017172963.html" }, { "url": "https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1" }, ], "maxItems": 100, "maxPagesPerStartUrl": 3, "enrichProductDetail": False, "maxConcurrency": 2, "debugMode": False, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("hypebridge/shein-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://us.shein.com/" }, { "url": "https://us.shein.com/pdsearch/shorts/?search_source=4&search_type=all&source=hotWord" }, { "url": "https://us.shein.com/RecommendSelection/Men-Clothing-sc-017172963.html" }, { "url": "https://us.shein.com/SHEIN-EZwear-Ripped-Raw-Trim-Denim-Shorts-Y2k-p-11133529.html?mallCode=1" } ], "maxItems": 100, "maxPagesPerStartUrl": 3, "enrichProductDetail": false, "maxConcurrency": 2, "debugMode": false, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call hypebridge/shein-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=hypebridge/shein-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "SHEIN Scraper (All Page Types)", "description": "Extracts product listings and product detail data from [SHEIN US](https://us.shein.com/). You can use it to collect products from the homepage, search result pages, supported SHEIN category pages, and direct product pages, then export the results as JSON, CSV, Excel, or HTML from the Dataset tab.", "version": "0.0", "x-build-id": "sRSK1AyPHZhuHkfcX" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/hypebridge~shein-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-hypebridge-shein-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/hypebridge~shein-scraper/runs": { "post": { "operationId": "runs-sync-hypebridge-shein-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/hypebridge~shein-scraper/run-sync": { "post": { "operationId": "run-sync-hypebridge-shein-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "startUrls": { "title": "URLs", "type": "array", "description": "SHEIN URLs to scrape — homepage, search results, supported RecommendSelection category pages, or direct product detail pages.", "default": [], "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxItems": { "title": "Max items", "minimum": 0, "type": "integer", "description": "Maximum number of products to extract across all sources. Set to 0 for unlimited.", "default": 500 }, "maxPagesPerStartUrl": { "title": "Max pages per URL", "minimum": 1, "type": "integer", "description": "Maximum number of paginated pages to crawl for each input URL. Each page returns up to 120 products.", "default": 10 }, "enrichProductDetail": { "title": "Enrich with product detail", "type": "boolean", "description": "Fetch full product details (sizes, colors, material, reviews, stock, shipping) for each listing. Direct product detail URLs still return detail records even when this is off. Charges one event per product. Disable for faster list-only snapshots from listing pages.", "default": false }, "maxConcurrency": { "title": "Max concurrency", "minimum": 1, "maximum": 3, "type": "integer", "description": "Browser pages processed in parallel. Keep low — SHEIN rate-limits warmed sessions aggressively.", "default": 2 }, "debugMode": { "title": "Debug mode", "type": "boolean", "description": "Save screenshots and HTML to the key-value store when a block or malformed response is encountered.", "default": false }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Residential proxies are strongly recommended — datacenter IPs hit SHEIN's risk pages quickly.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```