# Desertcart Product Search Scraper (`stealth_mode/desertcart-product-search-scraper`) Actor Scrape product search results from Desertcart across all countries. Collect 30+ fields including prices, ratings, store info, delivery estimates, and product images — perfect for price comparison, market research, and e-commerce intelligence. - **URL**: https://apify.com/stealth\_mode/desertcart-product-search-scraper.md - **Developed by:** [Stealth mode](https://apify.com/stealth_mode) (community) - **Categories:** Automation, Developer tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Desertcart Product Search Scraper: Extract Global Shopping Data --- ### What Is Desertcart? Desertcart is a global online marketplace and price comparison platform operating in multiple countries, offering millions of products from international sellers and local retailers. The platform aggregates products across diverse categories — from electronics to fashion — making it a valuable source for market analysis, competitive pricing research, and consumer trend data. Manually collecting this product data across countries is impractical; the **Desertcart Product Search Scraper** automates extraction, delivering structured intelligence in minutes. --- ### Overview The **Desertcart Product Search Scraper** extracts product listings from Desertcart search result pages, transforming unstructured web data into clean, machine-readable records. It is ideal for: - **E-commerce analysts** tracking pricing trends and competitor strategies - **Price comparison platforms** aggregating global product data - **Market researchers** studying cross-border retail patterns - **Business intelligence teams** building product catalogs and pricing datasets Key strengths include multi-country support, flexible pagination control, comprehensive product metadata (30+ fields), and robust error handling with `ignore_url_failures`. --- ### Input Format The scraper accepts a JSON configuration object with three main parameters: ```json { "urls": [ "https://www.desertcart.com.au/search?query=shoe" ], "ignore_url_failures": true, "max_items_per_url": 200 } ```` #### Input Fields Explained | Field | Type | Description | |---|---|---| | `urls` | Array | Product search page URLs from Desertcart. Include the full URL with query parameters (e.g., `?query=shoe`). You can add multiple URLs to scrape different product categories or countries. | | `ignore_url_failures` | Boolean | If `true`, the scraper continues if some URLs fail. If `false`, it stops at the first error. Recommended: `true` for bulk runs. | | `max_items_per_url` | Integer | Maximum number of products extracted per URL (e.g., `200`). Helps control run duration and resource usage. Default: `20`, Maximum: `500`. | **Example:** To scrape shoes across multiple Desertcart country sites: ```json { "urls": [ "https://www.desertcart.com.au/search?query=running+shoes", "https://www.desertcart.in/search?query=running+shoes" ], "ignore_url_failures": true, "max_items_per_url": 100 } ``` *** ### Output Format **Sample output** ```json { "id": 790691745, "store_id": 1, "store_uid": "B0FSZP9PCS", "title": "3/4 Length Sleeve Womens Tops Dressy V Neck Collared Shirts Trendy Business Casual Work Blouses Vacation Outfits 2026", "brand_name": "lomon", "estimated_delivery_days": 5, "description": "Buy LOMON Womens 2026 Fashion Tops 3/4 Sleeve V Neck Work Blouses Business Casual Spring Summer Outfits Collared Tee Shirt (Brown White Stripe,XL): Shop top fashion brands Blouses & Button-Down Shirts at desertcart.com ✓ FREE DELIVERY and Returns possible on eligible purchases\n\nReview: Great Blouse - While it was too large for me, it fit my daughter beautifully. We love the material, the color and the style. I am 5’ 3 and 133 lbs with 36c bust line.\nReview: Really nice blouse you won't be disappointed - Good quality, true to size. Little slick so maybe not able to wear if it's really hot out. But other than that for regular weather it's very cute. Suitable for spring fall and winter but not humid. Summer. Nice crisp colors. Good stitching not see-through and not stretchy. Wash as well. As long as you just dry it briefly medium and hang immediately. Really nice cut flattering, neck Is not too low or revealing. Very tailored good office clothes", "main_image_url": "https://m.media-amazon.com/images/I/81P4xoV6KnL.jpg", "image_urls": [ "https://m.media-amazon.com/images/I/81P4xoV6KnL.jpg" ], "rating": 4.2, "faster_delivery_date": null, "store_country_code": "US", "percent_saved_from_list_price": 21, "total_percent_saved": 44, "prime": false, "highlight_badge": null, "tags": [ "Has Variations" ], "bought_raw": "300+ bought in past month", "has_variations": true, "price_breakdown": null, "total_rating": 48, "google_product_taxonomy": "Apparel & Accessories > Clothing > Shirts & Tops", "scout_price": { "raw": "35.70", "currency": "AUD", "subunits": 3570, "formatted": "A$35.70" }, "scout_for_regular_catalog": false, "videos": { "main": [ { "author": "", "title": "", "url": "https://m.media-amazon.com/images/S/vse-vms-transcoding-artifact-us-east-1-prod/502d334e-ba7d-4882-8473-0d8971520ff0/default.vertical.jobtemplate.hls.m3u8" } ], "users": [] }, "enhanced_descriptions": null, "price": { "currency_code": "AUD", "value": 5580.0, "plain": 55.8, "formatted": "A$55.80", "value_usd_cents": 3914 }, "pro_price": { "currency_code": "AUD", "value": 5580.0, "plain": 55.8, "formatted": "A$55.80", "value_usd_cents": 3914 }, "list_price_fils": { "currency_code": "AUD", "value": 7100.0, "plain": 71.0, "formatted": "A$71", "value_usd_cents": 4980 }, "deal_price": { "currency_code": "AUD", "value": 3930.0, "plain": 39.3, "formatted": "A$39.30", "value_usd_cents": 2757 }, "from_url": "https://www.desertcart.com.au/category/fashion/women" } ``` Each product record contains 30+ fields capturing pricing, availability, ratings, and seller information: #### Product Core Data | Field | Meaning | Use Case | |---|---|---| | `ID` | Unique product identifier on Desertcart | Track product across updates | | `Title` | Product name as listed | Search indexing, catalog building | | `Brand Name` | Manufacturer or brand | Filtering, brand analytics | | `Description` | Full product description | Content aggregation, SEO | | `Google Product Taxonomy` | Google's standardized product category | Classification, marketplace mapping | | `Tags` | Categorical tags assigned by Desertcart | Faceted search, filtering | #### Pricing & Deals | Field | Meaning | Use Case | |---|---|---| | `Price` | Current selling price | Real-time price monitoring | | `Pro Price` | Discounted price for members | Loyalty program analysis | | `List Price Fils` | Original/recommended retail price | Discount percentage calculation | | `Deal Price` | Special offer price (if applicable) | Deal detection, trend analysis | | `Percent Saved From List Price` | Discount percentage shown to buyer | Shopping incentive analysis | | `Total Percent Saved` | Total savings across all factors | Value proposition measurement | | `Scout Price` | Historical or benchmark price | Price trend analysis | | `Scout For Regular Catalog` | Indicates if price is regular catalog | Seasonal vs. regular pricing | #### Seller & Delivery Information | Field | Meaning | Use Case | |---|---|---| | `Store ID` | Internal store identifier | Seller tracking, supplier analysis | | `Store UID` | Unique store identifier | Deduplication, seller profiles | | `Store Country Code` | ISO country code of seller | Geographic seller distribution | | `Estimated Delivery Days` | Expected delivery time | Logistics benchmarking | | `Faster Delivery Date` | Expedited delivery option (if available) | Premium delivery analysis | | `Prime` | Whether the product qualifies for Prime/fast shipping | Fast-shipping eligibility metrics | #### Product Attributes & Media | Field | Meaning | Use Case | |---|---|---| | `Main Image URL` | Primary product image | Image asset collection | | `Image URLs` | Array of all product images | Multi-view catalog building | | `Videos` | Embedded or linked product videos | Rich media content aggregation | | `Enhanced Descriptions` | Extended product information with formatting | Detailed content extraction | | `Has Variations` | Whether the product has size/color/style options | Variant availability tracking | #### Ratings & Social Proof | Field | Meaning | Use Case | |---|---|---| | `Rating` | Customer star rating (e.g., 4.5) | Quality assessment, sorting | | `Total Rating` | Total number of customer reviews | Review volume and reliability | | `Highlight Badge` | Special badge (e.g., "Best Seller", "Deal") | Popularity indicators | #### Advanced Fields | Field | Meaning | Use Case | |---|---|---| | `Price Breakdown` | Itemized price components (base, tax, shipping) | Transparent pricing analysis | | `Bought Raw` | Raw purchase count or popularity metric | Demand estimation | *** ### How to Use 1. **Identify search pages** — Visit Desertcart (any country domain: `.com.au`, `.in`, `.ae`, etc.) and perform a search. Copy the full URL with the query parameter. 2. **Prepare input** — Create a JSON config with your URLs. For example: ```json { "urls": ["https://www.desertcart.com.au/search?query=laptop"], "ignore_url_failures": true, "max_items_per_url": 150 } ``` 3. **Run the scraper** — Execute the actor with your configuration. 4. **Monitor execution** — The scraper logs progress, including item counts and errors (if any). 5. **Export data** — Download results as JSON, CSV, or Excel for analysis. **Best practices:** - Start with `max_items_per_url: 50` to test; increase for full runs. - Use specific search queries (`?query=product+name`) for targeted datasets. - For multi-country analysis, add URLs from different Desertcart domains. - Always enable `ignore_url_failures: true` to handle temporary page issues. **Common issues:** - If a URL returns no products, verify the query is valid and Desertcart has stock. - Some pages may load dynamically; the scraper captures server-rendered data only. *** ### Use Cases & Business Value - **Price monitoring:** Track product prices across countries and sellers in real-time - **Competitive intelligence:** Analyze competitor pricing, badges, and seller ratings - **Market research:** Identify trending products, popular brands, and demand patterns - **Data enrichment:** Supplement internal product catalogs with Desertcart pricing and reviews - **Arbitrage analysis:** Discover price differences across Desertcart country sites - **Supply chain insights:** Monitor seller diversity, delivery speeds, and logistics capabilities By automating data collection, the Desertcart scraper enables faster decision-making, deeper market insights, and competitive advantage in global e-commerce. *** ### Conclusion The **Desertcart Product Search Scraper** unlocks the full potential of cross-border shopping data. With comprehensive product information, multi-country support, and flexible configuration, it is the ideal tool for anyone needing real-time product intelligence at scale. Whether you're a price aggregator, market analyst, or competitor tracker, this scraper delivers actionable data instantly. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## Actor input object example ```json { "urls": [ "https://www.desertcart.com.au/search?query=shoe" ], "ignore_url_failures": true, "max_items_per_url": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.desertcart.com.au/search?query=shoe" ], "ignore_url_failures": true, "max_items_per_url": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("stealth_mode/desertcart-product-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.desertcart.com.au/search?query=shoe"], "ignore_url_failures": True, "max_items_per_url": 20, } # Run the Actor and wait for it to finish run = client.actor("stealth_mode/desertcart-product-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.desertcart.com.au/search?query=shoe" ], "ignore_url_failures": true, "max_items_per_url": 20 }' | apify call stealth_mode/desertcart-product-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=stealth_mode/desertcart-product-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Desertcart Product Search Scraper", "description": "Scrape product search results from Desertcart across all countries. Collect 30+ fields including prices, ratings, store info, delivery estimates, and product images — perfect for price comparison, market research, and e-commerce intelligence.", "version": "0.0", "x-build-id": "0EhTNoBBDGkYXsqco" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/stealth_mode~desertcart-product-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-stealth_mode-desertcart-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/stealth_mode~desertcart-product-search-scraper/runs": { "post": { "operationId": "runs-sync-stealth_mode-desertcart-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/stealth_mode~desertcart-product-search-scraper/run-sync": { "post": { "operationId": "run-sync-stealth_mode-desertcart-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the product search list urls to scrape", "type": "array", "description": "Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```