Desertcart Product Search Scraper: Extract Global Shopping Data

---

What Is Desertcart?

Desertcart is a global online marketplace and price comparison platform operating in multiple countries, offering millions of products from international sellers and local retailers. The platform aggregates products across diverse categories — from electronics to fashion — making it a valuable source for market analysis, competitive pricing research, and consumer trend data. Manually collecting this product data across countries is impractical; the Desertcart Product Search Scraper automates extraction, delivering structured intelligence in minutes.

---

Overview

The Desertcart Product Search Scraper extracts product listings from Desertcart search result pages, transforming unstructured web data into clean, machine-readable records. It is ideal for:

• E-commerce analysts tracking pricing trends and competitor strategies
• Price comparison platforms aggregating global product data
• Market researchers studying cross-border retail patterns
• Business intelligence teams building product catalogs and pricing datasets

Key strengths include multi-country support, flexible pagination control, comprehensive product metadata (30+ fields), and robust error handling with ignore_url_failures.

---

Input Format

The scraper accepts a JSON configuration object with three main parameters:

{
  "urls": [
    "https://www.desertcart.com.au/search?query=shoe"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Input Fields Explained

Field	Type	Description
urls	Array	Product search page URLs from Desertcart. Include the full URL with query parameters (e.g., ?query=shoe). You can add multiple URLs to scrape different product categories or countries.
ignore_url_failures	Boolean	If true, the scraper continues if some URLs fail. If false, it stops at the first error. Recommended: true for bulk runs.
max_items_per_url	Integer	Maximum number of products extracted per URL (e.g., 200). Helps control run duration and resource usage. Default: 20, Maximum: 500.

Example: To scrape shoes across multiple Desertcart country sites:

{
  "urls": [
    "https://www.desertcart.com.au/search?query=running+shoes",
    "https://www.desertcart.in/search?query=running+shoes"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 100
}

---

Output Format

Sample output

{
  "id": 790691745,
  "store_id": 1,
  "store_uid": "B0FSZP9PCS",
  "title": "3/4 Length Sleeve Womens Tops Dressy V Neck Collared Shirts Trendy Business Casual Work Blouses Vacation Outfits 2026",
  "brand_name": "lomon",
  "estimated_delivery_days": 5,
  "description": "Buy LOMON Womens 2026 Fashion Tops 3/4 Sleeve V Neck Work Blouses Business Casual Spring Summer Outfits Collared Tee Shirt (Brown White Stripe,XL): Shop top fashion brands Blouses & Button-Down Shirts at desertcart.com ✓ FREE DELIVERY and Returns possible on eligible purchases\n\nReview: Great Blouse - While it was too large for me, it fit my daughter beautifully. We love the material, the color and the style. I am 5’ 3 and 133 lbs with 36c bust line.\nReview: Really nice blouse you won't be disappointed - Good quality, true to size. Little slick so maybe not able to wear if it's really hot out. But other than that for regular weather it's very cute. Suitable for spring fall and winter but not humid. Summer. Nice crisp colors. Good stitching not see-through and not stretchy. Wash as well. As long as you just dry it briefly medium and hang immediately. Really nice cut flattering, neck Is not too low or revealing. Very tailored good office clothes",
  "main_image_url": "https://m.media-amazon.com/images/I/81P4xoV6KnL.jpg",
  "image_urls": [
    "https://m.media-amazon.com/images/I/81P4xoV6KnL.jpg"
  ],
  "rating": 4.2,
  "faster_delivery_date": null,
  "store_country_code": "US",
  "percent_saved_from_list_price": 21,
  "total_percent_saved": 44,
  "prime": false,
  "highlight_badge": null,
  "tags": [
    "Has Variations"
  ],
  "bought_raw": "300+ bought in past month",
  "has_variations": true,
  "price_breakdown": null,
  "total_rating": 48,
  "google_product_taxonomy": "Apparel & Accessories > Clothing > Shirts & Tops",
  "scout_price": {
    "raw": "35.70",
    "currency": "AUD",
    "subunits": 3570,
    "formatted": "A$35.70"
  },
  "scout_for_regular_catalog": false,
  "videos": {
    "main": [
      {
        "author": "",
        "title": "",
        "url": "https://m.media-amazon.com/images/S/vse-vms-transcoding-artifact-us-east-1-prod/502d334e-ba7d-4882-8473-0d8971520ff0/default.vertical.jobtemplate.hls.m3u8"
      }
    ],
    "users": []
  },
  "enhanced_descriptions": null,
  "price": {
    "currency_code": "AUD",
    "value": 5580.0,
    "plain": 55.8,
    "formatted": "A$55.80",
    "value_usd_cents": 3914
  },
  "pro_price": {
    "currency_code": "AUD",
    "value": 5580.0,
    "plain": 55.8,
    "formatted": "A$55.80",
    "value_usd_cents": 3914
  },
  "list_price_fils": {
    "currency_code": "AUD",
    "value": 7100.0,
    "plain": 71.0,
    "formatted": "A$71",
    "value_usd_cents": 4980
  },
  "deal_price": {
    "currency_code": "AUD",
    "value": 3930.0,
    "plain": 39.3,
    "formatted": "A$39.30",
    "value_usd_cents": 2757
  },
  "from_url": "https://www.desertcart.com.au/category/fashion/women"
}

Each product record contains 30+ fields capturing pricing, availability, ratings, and seller information:

Product Core Data

Field	Meaning	Use Case
ID	Unique product identifier on Desertcart	Track product across updates
Title	Product name as listed	Search indexing, catalog building
Brand Name	Manufacturer or brand	Filtering, brand analytics
Description	Full product description	Content aggregation, SEO
Google Product Taxonomy	Google's standardized product category	Classification, marketplace mapping
Tags	Categorical tags assigned by Desertcart	Faceted search, filtering

Pricing & Deals

Field	Meaning	Use Case
Price	Current selling price	Real-time price monitoring
Pro Price	Discounted price for members	Loyalty program analysis
List Price Fils	Original/recommended retail price	Discount percentage calculation
Deal Price	Special offer price (if applicable)	Deal detection, trend analysis
Percent Saved From List Price	Discount percentage shown to buyer	Shopping incentive analysis
Total Percent Saved	Total savings across all factors	Value proposition measurement
Scout Price	Historical or benchmark price	Price trend analysis
Scout For Regular Catalog	Indicates if price is regular catalog	Seasonal vs. regular pricing

Seller & Delivery Information

Field	Meaning	Use Case
Store ID	Internal store identifier	Seller tracking, supplier analysis
Store UID	Unique store identifier	Deduplication, seller profiles
Store Country Code	ISO country code of seller	Geographic seller distribution
Estimated Delivery Days	Expected delivery time	Logistics benchmarking
Faster Delivery Date	Expedited delivery option (if available)	Premium delivery analysis
Prime	Whether the product qualifies for Prime/fast shipping	Fast-shipping eligibility metrics

Product Attributes & Media

Field	Meaning	Use Case
Main Image URL	Primary product image	Image asset collection
Image URLs	Array of all product images	Multi-view catalog building
Videos	Embedded or linked product videos	Rich media content aggregation
Enhanced Descriptions	Extended product information with formatting	Detailed content extraction
Has Variations	Whether the product has size/color/style options	Variant availability tracking

Ratings & Social Proof

Field	Meaning	Use Case
Rating	Customer star rating (e.g., 4.5)	Quality assessment, sorting
Total Rating	Total number of customer reviews	Review volume and reliability
Highlight Badge	Special badge (e.g., "Best Seller", "Deal")	Popularity indicators

Advanced Fields

Field	Meaning	Use Case
Price Breakdown	Itemized price components (base, tax, shipping)	Transparent pricing analysis
Bought Raw	Raw purchase count or popularity metric	Demand estimation

---

How to Use

1. Identify search pages — Visit Desertcart (any country domain: .com.au, .in, .ae, etc.) and perform a search. Copy the full URL with the query parameter.

2. Prepare input — Create a JSON config with your URLs. For example:

{
     "urls": ["https://www.desertcart.com.au/search?query=laptop"],
     "ignore_url_failures": true,
     "max_items_per_url": 150
   }

3. Run the scraper — Execute the actor with your configuration.

4. Monitor execution — The scraper logs progress, including item counts and errors (if any).

5. Export data — Download results as JSON, CSV, or Excel for analysis.

Best practices:

• Start with max_items_per_url: 50 to test; increase for full runs.
• Use specific search queries (?query=product+name) for targeted datasets.
• For multi-country analysis, add URLs from different Desertcart domains.
• Always enable ignore_url_failures: true to handle temporary page issues.

Common issues:

• If a URL returns no products, verify the query is valid and Desertcart has stock.
• Some pages may load dynamically; the scraper captures server-rendered data only.

---

Use Cases & Business Value

• Price monitoring: Track product prices across countries and sellers in real-time
• Competitive intelligence: Analyze competitor pricing, badges, and seller ratings
• Market research: Identify trending products, popular brands, and demand patterns
• Data enrichment: Supplement internal product catalogs with Desertcart pricing and reviews
• Arbitrage analysis: Discover price differences across Desertcart country sites
• Supply chain insights: Monitor seller diversity, delivery speeds, and logistics capabilities

By automating data collection, the Desertcart scraper enables faster decision-making, deeper market insights, and competitive advantage in global e-commerce.

---

Conclusion

The Desertcart Product Search Scraper unlocks the full potential of cross-border shopping data. With comprehensive product information, multi-country support, and flexible configuration, it is the ideal tool for anyone needing real-time product intelligence at scale. Whether you're a price aggregator, market analyst, or competitor tracker, this scraper delivers actionable data instantly.