# Shein Search Products Scraper (`api-empire/shein-search-products-scraper`) Actor 🛍️ Shein Search Products Scraper helps you extract product listings from Shein search results quickly. Collect product names, prices, ratings, reviews, images, URLs, and metadata for eCommerce research, competitor analysis, and market insights. - **URL**: https://apify.com/api-empire/shein-search-products-scraper.md - **Developed by:** [API Empire](https://apify.com/api-empire) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 0.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $4.99 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shein Search Products Scraper An Apify Actor that scrapes Shein product search results. Extract product data including prices, images, descriptions, and more from Shein's search pages. ### Why Choose Us? - **Robust proxy fallback**: Starts with no proxy for speed. If Shein blocks requests, automatically falls back to datacenter proxy, then residential proxy (with 3 retries). Once residential succeeds, sticks with it for all remaining requests. - **Live saving**: Results are saved to the dataset as they're scraped, so partial data is preserved if the actor stops. - **Bulk support**: Process multiple search queries or URLs in a single run. - **Dynamic headers**: Uses Playwright to extract required anti-bot tokens (armortoken, etc.) for reliable API access. - **Detailed logging**: Clear proxy events and progress logs to keep you informed. ### Key Features | Feature | Description | |--------|-------------| | **Bulk URLs/Keywords** | Input multiple Shein search URLs or plain keywords | | **Proxy Fallback** | No proxy → Datacenter → Residential (3 retries) | | **Sort Options** | recommend, top rated, most popular, new arrival | | **Country Support** | Scrape from us, uk, de, or other Shein markets | | **Full Product Data** | Prices, images, SKUs, promotions, ratings | ### Input | Field | Type | Required | Description | |-------|------|----------|-------------| | `query` | string | Yes | Search term (e.g., jacket, dress). Use comma for multiple: jeans,jacket,dress | | Field | Type | Default | Description | |-------|------|---------|-------------| | `page` | integer | `1` | Start page for pagination | | `perPage` | string | `"120"` | Items per page: 20, 40, 60, 80, 100, 120 | | `countryCode` | string | `"us"` | Shein market (us, uk, de, etc.) | | `orderBy` | string | `"recommend"` | Sort: recommend, MostPopular, NewArrivals, TopRated | | `maxItems` | integer | `300` | Max products per query (1–1000) | | `proxyConfiguration` | object | No proxy | Apify proxy. Fallback: datacenter → residential | #### Example Input ```json { "query": "jacket", "page": 1, "perPage": "120", "countryCode": "us", "orderBy": "recommend", "maxItems": 300 } ```` ### Output The dataset contains a single object with the same structure as the original scraper output: ```json { "jeans": { "query": "jeans", "total_products": 300, "sort_order": "most popular", "country": "US", "products": [ { "goods_id": "167962972", "goods_name": "Plus Size Blue Denim Casual Skinny Flare Jeans", "goods_img": "//img.ltwebstatic.com/...", "retailPrice": { "amount": "29.99", "amountWithSymbol": "$29.99", "usdAmount": "29.99", "usdAmountWithSymbol": "$29.99" }, "salePrice": { "amount": "23.99", "amountWithSymbol": "$23.99", "usdAmount": "23.99", "usdAmountWithSymbol": "$23.99" }, "detail_image": "...", "productMaterial": { ... }, "rankInfo": { ... } } ] }, "jacket": { ... } } ``` Each product includes full API data: `goods_id`, `goods_name`, `goods_img`, `retailPrice`, `salePrice`, `detail_image`, `productMaterial`, `rankInfo`, `promotionInfo`, and more. ### How to Use the Actor (via Apify Console) 1. Log in at and go to **Actors**. 2. Find **Shein Search Products Scraper** and open it. 3. Add search URLs or keywords in **startUrls**. 4. Optionally set **countryCode**, **orderBy**, and **maxItems**. 5. **Proxy**: Leave as "No proxy" for default. Enable Apify proxy if you prefer to start with a proxy. 6. Run the actor. 7. Monitor logs for proxy events and progress. 8. Open the **OUTPUT** tab. 9. Export results as JSON or CSV. ### Best Use Cases - **Price monitoring**: Track Shein product prices over time. - **Catalog building**: Build product catalogs for comparison or analysis. - **Market research**: Analyze product trends and availability. - **Competitor analysis**: Compare Shein offerings with other retailers. ### Frequently Asked Questions **Q: Why does the actor start without a proxy?**\ A: Direct requests are faster and cheaper. If Shein blocks them, the actor automatically falls back to datacenter proxy, then residential proxy. **Q: Does the actor support multiple countries?**\ A: Yes. Use `countryCode` or include the country in the URL (e.g., `uk.shein.com`). **Q: How many products can I scrape per query?**\ A: Up to 1000 per query via `maxItems`. Default is 300. **Q: What if I get blocked?**\ A: The actor will automatically try datacenter proxy, then residential proxy (with 3 retries). Check logs for `PROXY_EVENT` messages. ### Support and Feedback - **Apify Store**: [Shein Search Products Scraper](https://apify.com) - **Issues**: Report bugs or request features via the actor's page on Apify. ### Cautions - Data is collected only from **publicly available** Shein search pages. - No private or password-protected content is accessed. - You are responsible for ensuring legal compliance (privacy, data protection, terms of service, etc.). # Actor input Schema ## `query` (type: `array`): Product types to search (jacket, dress, shoes...). Add multiple items for separate searches. ## `countryCode` (type: `string`): SHEIN regional site (e.g. US, UK, DE) ## `orderBy` (type: `string`): How to sort the search results ## `maxItems` (type: `integer`): Maximum products to scrape per search query (1–1000) ## `page` (type: `integer`): Start page for pagination (1 = first page) ## `perPage` (type: `string`): Number of products per page (20–120) ## `filter` (type: `string`): Extra filter options. Leave empty for no filter. ## `categoryId` (type: `string`): Filter by category. Leave empty for all categories. ## `minPrice` (type: `string`): Minimum price in local currency (e.g. 10) ## `maxPrice` (type: `string`): Maximum price in local currency (e.g. 100) ## `proxyConfiguration` (type: `object`): Optional proxy for your run. Leave default for no proxy. ## Actor input object example ```json { "query": [ "jacket" ], "countryCode": "us", "orderBy": "recommend", "maxItems": 300, "page": 1, "perPage": "120", "filter": "", "categoryId": "", "minPrice": "", "maxPrice": "", "proxyConfiguration": { "useApifyProxy": false } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "query": [ "jacket" ], "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("api-empire/shein-search-products-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "query": ["jacket"], "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("api-empire/shein-search-products-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "query": [ "jacket" ], "proxyConfiguration": { "useApifyProxy": false } }' | apify call api-empire/shein-search-products-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=api-empire/shein-search-products-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shein Search Products Scraper", "description": "🛍️ Shein Search Products Scraper helps you extract product listings from Shein search results quickly. Collect product names, prices, ratings, reviews, images, URLs, and metadata for eCommerce research, competitor analysis, and market insights.", "version": "0.1", "x-build-id": "369648yGtueMU64jN" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/api-empire~shein-search-products-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-api-empire-shein-search-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/api-empire~shein-search-products-scraper/runs": { "post": { "operationId": "runs-sync-api-empire-shein-search-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/api-empire~shein-search-products-scraper/run-sync": { "post": { "operationId": "run-sync-api-empire-shein-search-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "query" ], "properties": { "query": { "title": "🔍 Search Query", "type": "array", "description": "Product types to search (jacket, dress, shoes...). Add multiple items for separate searches.", "default": [ "jacket" ], "items": { "type": "string" } }, "countryCode": { "title": "🌍 Country", "enum": [ "us", "de", "fr", "it", "ch", "pl", "pt", "es", "se", "uk", "ca", "mx", "br", "ae", "sa", "ru", "jp", "kr", "cn", "tw", "hk", "au", "in", "id", "ph", "my", "sg", "tr", "nl", "be", "at", "dk", "no", "fi", "ie", "vn", "th", "il" ], "type": "string", "description": "SHEIN regional site (e.g. US, UK, DE)", "default": "us" }, "orderBy": { "title": "↕️ Sort Order", "enum": [ "recommend", "MostPopular", "NewArrivals", "TopRated", "PriceLowtoHigh", "PriceHightoLow" ], "type": "string", "description": "How to sort the search results", "default": "recommend" }, "maxItems": { "title": "🎯 Max Items Per Query", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum products to scrape per search query (1–1000)", "default": 300 }, "page": { "title": "📄 Page Number", "minimum": 1, "type": "integer", "description": "Start page for pagination (1 = first page)", "default": 1 }, "perPage": { "title": "📦 Items Per Page", "enum": [ "20", "40", "60", "80", "100", "120" ], "type": "string", "description": "Number of products per page (20–120)", "default": "120" }, "filter": { "title": "🔧 Additional Filters", "type": "string", "description": "Extra filter options. Leave empty for no filter.", "default": "" }, "categoryId": { "title": "📂 Category ID", "type": "string", "description": "Filter by category. Leave empty for all categories.", "default": "" }, "minPrice": { "title": "💰 Min Price", "type": "string", "description": "Minimum price in local currency (e.g. 10)", "default": "" }, "maxPrice": { "title": "💰 Max Price", "type": "string", "description": "Maximum price in local currency (e.g. 100)", "default": "" }, "proxyConfiguration": { "title": "🔒 Proxy Configuration", "type": "object", "description": "Optional proxy for your run. Leave default for no proxy." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```