# Shein Search Products Scraper (`simpleapi/shein-search-products-scraper`) Actor 🛍️ Search & scrape Shein product data from 38 countries. 🔍 Keywords, filters, price range & sort options. 📦 Output: titles, prices, images, ratings & more. - **URL**: https://apify.com/simpleapi/shein-search-products-scraper.md - **Developed by:** [SimpleAPI](https://apify.com/simpleapi) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 1 total users, 0 monthly users, 0.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $2.99 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shein Search Products Scraper An Apify Actor that scrapes Shein product search results. Extract product data including prices, images, descriptions, and more from Shein's search pages. ### Why Choose Us? - **Robust proxy fallback**: Starts with no proxy for speed. If Shein blocks requests, automatically falls back to datacenter proxy, then residential proxy (with 3 retries). Once residential succeeds, sticks with it for all remaining requests. - **Live saving**: Results are saved to the dataset as they're scraped, so partial data is preserved if the actor stops. - **Bulk support**: Process multiple search queries or URLs in a single run. - **Dynamic headers**: Uses Playwright to extract required anti-bot tokens (armortoken, etc.) for reliable API access. - **Detailed logging**: Clear proxy events and progress logs to keep you informed. ### Key Features | Feature | Description | |--------|-------------| | **Bulk URLs/Keywords** | Input multiple Shein search URLs or plain keywords | | **Proxy Fallback** | No proxy → Datacenter → Residential (3 retries) | | **Sort Options** | recommend, top rated, most popular, new arrival | | **Country Support** | Scrape from us, uk, de, or other Shein markets | | **Full Product Data** | Prices, images, SKUs, promotions, ratings | ### Input | Field | Type | Required | Description | |-------|------|----------|-------------| | `query` | string | Yes | Search term (e.g., jacket, dress). Use comma for multiple: jeans,jacket,dress | | Field | Type | Default | Description | |-------|------|---------|-------------| | `page` | integer | `1` | Start page for pagination | | `perPage` | string | `"120"` | Items per page: 20, 40, 60, 80, 100, 120 | | `countryCode` | string | `"us"` | Shein market (us, uk, de, etc.) | | `orderBy` | string | `"recommend"` | Sort: recommend, MostPopular, NewArrivals, TopRated | | `maxItems` | integer | `300` | Max products per query (1–1000) | | `proxyConfiguration` | object | No proxy | Apify proxy. Fallback: datacenter → residential | #### Example Input ```json { "query": "jacket", "page": 1, "perPage": "120", "countryCode": "us", "orderBy": "recommend", "maxItems": 300 } ```` ### Output The dataset contains a single object with the same structure as the original scraper output: ```json { "jeans": { "query": "jeans", "total_products": 300, "sort_order": "most popular", "country": "US", "products": [ { "goods_id": "167962972", "goods_name": "Plus Size Blue Denim Casual Skinny Flare Jeans", "goods_img": "//img.ltwebstatic.com/...", "retailPrice": { "amount": "29.99", "amountWithSymbol": "$29.99", "usdAmount": "29.99", "usdAmountWithSymbol": "$29.99" }, "salePrice": { "amount": "23.99", "amountWithSymbol": "$23.99", "usdAmount": "23.99", "usdAmountWithSymbol": "$23.99" }, "detail_image": "...", "productMaterial": { ... }, "rankInfo": { ... } } ] }, "jacket": { ... } } ``` Each product includes full API data: `goods_id`, `goods_name`, `goods_img`, `retailPrice`, `salePrice`, `detail_image`, `productMaterial`, `rankInfo`, `promotionInfo`, and more. ### How to Use the Actor (via Apify Console) 1. Log in at and go to **Actors**. 2. Find **Shein Search Products Scraper** and open it. 3. Add search URLs or keywords in **startUrls**. 4. Optionally set **countryCode**, **orderBy**, and **maxItems**. 5. **Proxy**: Leave as "No proxy" for default. Enable Apify proxy if you prefer to start with a proxy. 6. Run the actor. 7. Monitor logs for proxy events and progress. 8. Open the **OUTPUT** tab. 9. Export results as JSON or CSV. ### Best Use Cases - **Price monitoring**: Track Shein product prices over time. - **Catalog building**: Build product catalogs for comparison or analysis. - **Market research**: Analyze product trends and availability. - **Competitor analysis**: Compare Shein offerings with other retailers. ### Frequently Asked Questions **Q: Why does the actor start without a proxy?**\ A: Direct requests are faster and cheaper. If Shein blocks them, the actor automatically falls back to datacenter proxy, then residential proxy. **Q: Does the actor support multiple countries?**\ A: Yes. Use `countryCode` or include the country in the URL (e.g., `uk.shein.com`). **Q: How many products can I scrape per query?**\ A: Up to 1000 per query via `maxItems`. Default is 300. **Q: What if I get blocked?**\ A: The actor will automatically try datacenter proxy, then residential proxy (with 3 retries). Check logs for `PROXY_EVENT` messages. ### Support and Feedback - **Apify Store**: [Shein Search Products Scraper](https://apify.com) - **Issues**: Report bugs or request features via the actor's page on Apify. ### Cautions - Data is collected only from **publicly available** Shein search pages. - No private or password-protected content is accessed. - You are responsible for ensuring legal compliance (privacy, data protection, terms of service, etc.). # Actor input Schema ## `query` (type: `array`): Product types to search (jacket, dress, shoes...). Add multiple items for separate searches. ## `countryCode` (type: `string`): SHEIN regional site (e.g. US, UK, DE) ## `orderBy` (type: `string`): How to sort the search results ## `maxItems` (type: `integer`): Maximum products to scrape per search query (1–1000) ## `page` (type: `integer`): Start page for pagination (1 = first page) ## `perPage` (type: `string`): Number of products per page (20–120) ## `filter` (type: `string`): Extra filter options. Leave empty for no filter. ## `categoryId` (type: `string`): Filter by category. Leave empty for all categories. ## `minPrice` (type: `string`): Minimum price in local currency (e.g. 10) ## `maxPrice` (type: `string`): Maximum price in local currency (e.g. 100) ## `proxyConfiguration` (type: `object`): Optional proxy for your run. Leave default for no proxy. ## Actor input object example ```json { "query": [ "jacket" ], "countryCode": "us", "orderBy": "recommend", "maxItems": 300, "page": 1, "perPage": "120", "filter": "", "categoryId": "", "minPrice": "", "maxPrice": "", "proxyConfiguration": { "useApifyProxy": false } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "query": [ "jacket" ], "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("simpleapi/shein-search-products-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "query": ["jacket"], "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("simpleapi/shein-search-products-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "query": [ "jacket" ], "proxyConfiguration": { "useApifyProxy": false } }' | apify call simpleapi/shein-search-products-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=simpleapi/shein-search-products-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shein Search Products Scraper", "description": "🛍️ Search & scrape Shein product data from 38 countries. 🔍 Keywords, filters, price range & sort options. 📦 Output: titles, prices, images, ratings & more.", "version": "0.1", "x-build-id": "0JklXEpig2yOQPvha" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/simpleapi~shein-search-products-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-simpleapi-shein-search-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/simpleapi~shein-search-products-scraper/runs": { "post": { "operationId": "runs-sync-simpleapi-shein-search-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/simpleapi~shein-search-products-scraper/run-sync": { "post": { "operationId": "run-sync-simpleapi-shein-search-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "query" ], "properties": { "query": { "title": "🔍 Search Query", "type": "array", "description": "Product types to search (jacket, dress, shoes...). Add multiple items for separate searches.", "default": [ "jacket" ], "items": { "type": "string" } }, "countryCode": { "title": "🌍 Country", "enum": [ "us", "de", "fr", "it", "ch", "pl", "pt", "es", "se", "uk", "ca", "mx", "br", "ae", "sa", "ru", "jp", "kr", "cn", "tw", "hk", "au", "in", "id", "ph", "my", "sg", "tr", "nl", "be", "at", "dk", "no", "fi", "ie", "vn", "th", "il" ], "type": "string", "description": "SHEIN regional site (e.g. US, UK, DE)", "default": "us" }, "orderBy": { "title": "↕️ Sort Order", "enum": [ "recommend", "MostPopular", "NewArrivals", "TopRated", "PriceLowtoHigh", "PriceHightoLow" ], "type": "string", "description": "How to sort the search results", "default": "recommend" }, "maxItems": { "title": "🎯 Max Items Per Query", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum products to scrape per search query (1–1000)", "default": 300 }, "page": { "title": "📄 Page Number", "minimum": 1, "type": "integer", "description": "Start page for pagination (1 = first page)", "default": 1 }, "perPage": { "title": "📦 Items Per Page", "enum": [ "20", "40", "60", "80", "100", "120" ], "type": "string", "description": "Number of products per page (20–120)", "default": "120" }, "filter": { "title": "🔧 Additional Filters", "type": "string", "description": "Extra filter options. Leave empty for no filter.", "default": "" }, "categoryId": { "title": "📂 Category ID", "type": "string", "description": "Filter by category. Leave empty for all categories.", "default": "" }, "minPrice": { "title": "💰 Min Price", "type": "string", "description": "Minimum price in local currency (e.g. 10)", "default": "" }, "maxPrice": { "title": "💰 Max Price", "type": "string", "description": "Maximum price in local currency (e.g. 100)", "default": "" }, "proxyConfiguration": { "title": "🔒 Proxy Configuration", "type": "object", "description": "Optional proxy for your run. Leave default for no proxy." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```