Shopsy.in Product Scraper: Extract Ecommerce Data from Search Results

---

What Is Shopsy.in?

Shopsy.in is a prominent Indian e-commerce platform offering a wide variety of products across fashion, electronics, home, and lifestyle categories. With millions of active listings, it serves millions of shoppers seeking competitive pricing and diverse brands. For businesses monitoring market trends, analyzing competitor pricing, or aggregating product data, manually collecting this information is impractical — the Shopsy.in Product Scraper automates the extraction process from search result pages, delivering structured product records in seconds.

---

Overview

The Shopsy Product Scraper extracts product listings from Shopsy.in search result pages, converting item cards into detailed, machine-readable records. It is designed for:

• Price monitoring agents tracking competitor product pricing and promotions
• Market researchers analyzing product assortment and brand presence
• E-commerce aggregators integrating Shopsy data into multi-channel platforms
• Business analysts benchmarking product availability and ratings across categories
• Inventory managers monitoring stock levels and restocking signals

Key advantages include handling multiple search pages at scale, configurable item limits, resilient error handling via ignore_url_failures, and comprehensive product metadata across 20+ fields.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://www.shopsy.in/mens-jeans-online/pr?page=2"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Input Parameters Explained

Parameter	Type	Description	Example
urls	Array	Search result page URLs from Shopsy.in to scrape. Each URL should point to a filtered category or search results page.	["https://www.shopsy.in/mens-jeans-online/pr?page=2"]
ignore_url_failures	Boolean	If true, the scraper continues even if some URLs fail. If false, the entire run stops on the first failure. Recommended: true for batch runs.	true
max_items_per_url	Integer	Maximum number of products to extract from each URL. Useful for testing or controlling data volume. Default: 20, Max: 200.	200

Best Practice: Use category-filtered URLs (e.g., /mens-jeans-online/pr) or search queries (e.g., /search?q=leather-shoes) to target specific product segments. Pagination parameters like ?page=2 automatically load additional results.

---

Output Format

Sample output

{
  "type": "ProductSummaryValue",
  "analytics_data": {
    "category": "ShopsyMensClothingJeans",
    "sub_category": "ShopsyMensJean",
    "super_category": "ShopsyLifeStyle",
    "vertical": "ShopsyMensJean"
  },
  "availability": {
    "message_intent": "positive",
    "display_state": "IN_STOCK",
    "intent": "positive",
    "show_message": false
  },
  "base_url": "/denim-life-loose-fit-men-light-blue-jeans/p/itm0c0e268426dfe?pid=XJNHGMTYAVNEUUBJ",
  "buyability": {
    "intent": "positive",
    "message": null,
    "show_message": false
  },
  "condition_callout": false,
  "flags": {
    "enable_chat": true,
    "enable_compare": false,
    "enable_flipkart_advantage": false,
    "enable_offer_tag": true,
    "enable_visual_discovery": false,
    "enable_wishlist": true,
    "show_secondary_title": true,
    "swatch_available_on_browse_page": true
  },
  "grade": {
    "color": null,
    "id": null,
    "name": null,
    "short_desc": null
  },
  "id": "XJNHGMTYAVNEUUBJ",
  "item_id": "ITM0C0E268426DFE",
  "listing_id": "LSTXJNHGMTYAVNEUUBJ2OX1OE",
  "max_order_quantity_allowed": 0,
  "media": {
    "images": [
      {
        "aspect_ratio": null,
        "content_info": null,
        "height": null,
        "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/shopsy-jean/m/y/a/-original-imahn5xu6yhtzhve.jpeg?q={@quality}",
        "width": null
      },
      {
        "aspect_ratio": null,
        "content_info": null,
        "height": null,
        "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/5/y/h/26-dl-blue-baggy-01-denim-life-original-imahgmnee6crzhfx.jpeg?q={@quality}",
        "width": null
      },
      {
        "aspect_ratio": null,
        "content_info": null,
        "height": null,
        "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/h/6/m/26-dl-blue-baggy-01-denim-life-original-imahgmneyzjxrhxz.jpeg?q={@quality}",
        "width": null
      },
      {
        "aspect_ratio": null,
        "content_info": null,
        "height": null,
        "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/y/w/j/28-dl-blue-baggy-01-denim-life-original-imahgmnehxvtsrze.jpeg?q={@quality}",
        "width": null
      },
      {
        "aspect_ratio": null,
        "content_info": null,
        "height": null,
        "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/y/w/r/30-dl-blue-baggy-01-denim-life-original-imahgmneksqtf6xc.jpeg?q={@quality}",
        "width": null
      }
    ]
  },
  "pricing": {
    "type": "ListingPriceValue",
    "coupon_applied": null,
    "delivery_charge": {
      "additional_text": null,
      "currency": "INR",
      "decimal_value": "0.00",
      "discount": null,
      "downpayment_rate": 0,
      "downpayment_required": false,
      "name": "Delivery Charges",
      "price_type": null,
      "strike_off": false,
      "text_style": null,
      "value": 0
    },
    "discount_amount": 954,
    "emi_price": null,
    "extra_discount": null,
    "final_price": {
      "additional_text": null,
      "currency": "INR",
      "decimal_value": "345.00",
      "discount": null,
      "downpayment_rate": 0,
      "downpayment_required": false,
      "name": "Total",
      "price_type": null,
      "strike_off": false,
      "text_style": null,
      "value": 345
    },
    "final_savings_text": null,
    "insured_price": null,
    "know_more": null,
    "listing_price_type": "REGULAR",
    "mrp": {
      "additional_text": "(incl. of all taxes)",
      "currency": "INR",
      "decimal_value": "1299.00",
      "discount": null,
      "downpayment_rate": 0,
      "downpayment_required": false,
      "name": "Maximum Retail Price",
      "price_type": null,
      "strike_off": true,
      "text_style": null,
      "value": 1299
    },
    "part_price_info": null,
    "plus_price_info": null,
    "price_descriptions": null,
    "price_per_unit": null,
    "price_tags": null,
    "prices": [
      {
        "additional_text": null,
        "currency": "INR",
        "decimal_value": "1299.00",
        "discount": 73,
        "downpayment_rate": 0,
        "downpayment_required": false,
        "name": "Selling Price",
        "price_type": "FSP",
        "strike_off": true,
        "text_style": null,
        "value": 1299
      },
      {
        "additional_text": null,
        "currency": "INR",
        "decimal_value": "345.00",
        "discount": null,
        "downpayment_rate": 0,
        "downpayment_required": false,
        "name": "Special Price",
        "price_type": "SPECIAL_PRICE",
        "strike_off": false,
        "text_style": null,
        "value": 345
      }
    ],
    "selected": null,
    "show_discount_as_amount": false,
    "sub_title": null,
    "title": null,
    "total_discount": 73,
    "upi_price_callout": null,
    "upi_regular_price_title": null
  },
  "product_brand": "Denim Life",
  "product_card_tag_details": [],
  "rating": {
    "type": "RatingValue",
    "average": 3.6,
    "base": 5,
    "breakup": [
      24,
      15,
      18,
      28,
      62
    ],
    "count": 147,
    "histogram_base_count": 62,
    "review_count": 9,
    "round_off_count": "147"
  },
  "smart_url": "http://dl.flipkart.com/dl/denim-life-loose-fit-men-light-blue-jeans/p/itm0c0e268426dfe?pid=XJNHGMTYAVNEUUBJ",
  "tags": [],
  "titles": {
    "co_subtitle": "Size: 28",
    "title": "Denim Life Loose Fit Men Light Blue Jeans"
  },
  "vertical": "shopsy_jean",
  "from_url": "https://www.shopsy.in/mens-jeans-online/pr?page=2"
}

Each scraped product returns a comprehensive record with 20+ fields:

Product Identification

Field	Meaning	Example
Type	Product category type (e.g., "Apparel", "Electronics")	"Apparel"
ID	Unique Shopsy product identifier	"prod_abc123xyz"
Item ID	Internal item reference number	"item_9876543"
Listing ID	Specific marketplace listing ID	"listing_prod_456789"
Product Brand	Official brand name of the product	"Lee" or "Nike"
Titles	Full product title/name as displayed	"Men's Slim Fit Blue Denim Jeans - Size 32"
Smart URL	Canonical product page URL on Shopsy	"https://www.shopsy.in/p/product-slug-123"
Base URL	Original search page or category URL	"https://www.shopsy.in/mens-jeans-online/pr?page=2"

Pricing & Purchasing

Field	Meaning	Example
Pricing	Price object containing MRP, discounted price, currency, savings	{"mrp": 3999, "discounted": 2499, "currency": "INR", "discount_percent": 37}
Buyability	Whether the product is purchasable (e.g., "in_stock", "out_of_stock")	"in_stock"
Max Order Quantity Allowed	Maximum units a customer can purchase in one order	5
Availability	Stock availability status and fulfillment type	"In Stock - Ships within 2 days"

Product Details & Metadata

Field	Meaning	Example
Condition Callout	Product condition label (e.g., "New", "Refurbished", "Like New")	"New"
Grade	Product grade or quality rating (seller/system assigned)	"Grade A"
Vertical	Marketplace category or vertical	"Fashion & Apparel"
Tags	Searchable tags and labels (size, color, material)	["blue", "slim-fit", "cotton", "mens", "denim"]
Product Card Tag Details	Structured tag objects with metadata	[{"tag": "blue", "type": "color"}]

Media & Visual Content

Field	Meaning	Example
Media	Array of image and video URLs for the product	["https://cdn.shopsy.in/img1.jpg", "https://cdn.shopsy.in/img2.jpg"]

Reviews & Social Proof

Field	Meaning	Example
Rating	Customer rating object (score, review count, average stars)	{"average": 4.2, "count": 156, "max": 5}

Performance & Analytics

Field	Meaning	Example
Analytics Data	Click-through rate, impression count, or trending signals	{"clicks": 342, "impressions": 5821, "trend": "rising"}
Flags	Special labels or warnings (e.g., "low_stock", "best_seller", "trending")	["best_seller", "trending"]

---

How to Use

1. Find search URLs — Navigate to Shopsy.in, use category filters or search for products, and copy the page URL from your browser's address bar.
2. Prepare the configuration — Add URLs to the urls array. Example: https://www.shopsy.in/womens-sarees-online/pr?page=1
3. Set parameters — Configure max_items_per_url (recommend 50-200 for balanced speed and data) and enable ignore_url_failures for robustness.
4. Execute the scraper — Start the run and monitor progress in the logs.
5. Export results — Download output as JSON, CSV, or Excel for analysis in spreadsheets, databases, or BI platforms.

Tips:

• Use specific category URLs to collect homogeneous product data (e.g., /womens-sarees-online/pr rather than the homepage).
• For large-scale collection, spread URLs across multiple runs to avoid rate limiting.
• Inspect the Media field — it contains product images essential for visual search and aggregators.

---

Use Cases & Business Value

• Price intelligence: Monitor competitor pricing on Shopsy, track discounts, and identify arbitrage opportunities.
• Product analytics: Analyze brand presence, category trends, and bestseller patterns across Indian e-commerce.
• Inventory monitoring: Track stock levels and availability signals to optimize supply chain decisions.
• Marketplace aggregation: Feed Shopsy product data into price comparison sites, shopping bots, or internal catalogs.
• Competitive benchmarking: Compare product ratings, titles, and promotional strategies across sellers.

The Shopsy Product Scraper transforms tedious manual browsing into automated data pipelines, enabling data-driven decisions at scale.

---

Conclusion

The Shopsy.in Product Scraper is an essential tool for businesses operating in the Indian e-commerce space. With flexible input options, comprehensive 20+ field output, and reliable error handling, it streamlines product data collection from one of India's fastest-growing marketplaces. Whether you're monitoring prices, analyzing trends, or aggregating inventory, this scraper delivers the structured data you need — fast and reliably.