Shopsy.in Product Scraper: Extract Ecommerce Data from Search Results

---

What Is Shopsy.in?

Shopsy.in is a prominent Indian e-commerce platform offering a wide variety of products across fashion, electronics, home, and lifestyle categories. With millions of active listings, it serves millions of shoppers seeking competitive pricing and diverse brands. For businesses monitoring market trends, analyzing competitor pricing, or aggregating product data, manually collecting this information is impractical — the Shopsy.in Product Scraper automates the extraction process from search result pages, delivering structured product records in seconds.

---

Overview

The Shopsy Product Scraper extracts product listings from Shopsy.in search result pages, converting item cards into detailed, machine-readable records. It is designed for:

• Price monitoring agents tracking competitor product pricing and promotions
• Market researchers analyzing product assortment and brand presence
• E-commerce aggregators integrating Shopsy data into multi-channel platforms
• Business analysts benchmarking product availability and ratings across categories
• Inventory managers monitoring stock levels and restocking signals

Key advantages include handling multiple search pages at scale, configurable item limits, resilient error handling via ignore_url_failures, and comprehensive product metadata across 20+ fields.

---

Input Format

The Actor supports two scraping modes — use only one at a time:

1. Scrape by URLs — scrape data directly from a list of Shopsy.in product search/category URLs.

{
  "urls": [
    "https://www.shopsy.in/mens-jeans-online/pr?page=2"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

2. Scrape by search filters — scrape data using a keyword and additional filters (gender, color, price, rating, discount, etc.) instead of providing URLs.

{
  "keyword": "shoe",
  "sort_by": "popularity",
  "brand": "",
  "gender": "Women",
  "color": "Black",
  "price_from": 500,
  "price_to": 1500,
  "rating": "4",
  "discount": "30",
  "page": 1,
  "max_items_per_url": 200
}

There is also a General settings group that applies to both modes.

1. Scrape by URLs

Use this mode when you already have specific search result or category URLs. When this mode is used, all options in the "Scrape by search filters" section will be disabled.

Field	Type	Default	Description
urls	array	(required)	One or more Shopsy.in product search list URLs to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. Use category-filtered URLs (e.g., /mens-jeans-online/pr) or search queries (e.g., /search?q=leather-shoes) to target specific product segments. Pagination parameters like ?page=2 automatically load additional results.
ignore_url_failures	boolean	true	If true, the scraper continues running when a URL fails instead of stopping the entire run. Recommended for bulk jobs.

2. Scrape by search filters

Use this mode when you want to search using a keyword and additional filter attributes instead of scraping by URLs. If you use this mode, leave the urls field above empty.

Field	Type	Default	Description
keyword	string	—	The keyword to search for.
sort_by	string (relevance, popularity, price_asc, price_desc, recency_desc)	—	Sort results by Relevance, Popularity, Price (asc), Price (desc), or Recency (desc).
gender	string ("", Men, Women, Boys, Girls, Boys & Girls, Unisex)	—	Filter by gender. Leave empty for All.
color	string	—	Filter by product color. One of: Beige, Black, Blue, Bronze, Brown, Burgundy, Camel, Copper, Dark Blue, Dark Green, Gold, Green, Grey, Khaki, Light Blue, Light Green, Maroon, Multicolor, Natural, Navy, Neutral, Off White, Olive, Orange, Pink, Purple, Red, Silver, Steel, Tan, White, Yellow.
price_from	string ("", 500, 1000, 1500, 2000, 3000)	—	Minimum price filter. Leave empty for All.
price_to	string ("", 500, 1000, 1500, 2000, 3000)	—	Maximum price filter. Leave empty for All.
rating	string ("", 4, 3)	—	Minimum customer rating: All, 4 stars and above, 3 stars and above.
discount	string ("", 30, 40, 50, 60, 70)	—	Minimum discount percentage: All, 30% or more, 40% or more, 50% or more, 60% or more, 70% or more.
page	integer	—	The page number to start scraping from.

3. General settings

Applies to both scraping modes above.

Field	Type	Default	Description
max_items_per_url	integer	20	The maximum number of products to extract per URL/search. Default: 20, Max: 200. Useful for testing or controlling data volume.

Best Practice: Use category-filtered URLs (e.g., /mens-jeans-online/pr) or search queries (e.g., /search?q=leather-shoes) to target specific product segments. Pagination parameters like ?page=2 automatically load additional results.

---

Output Format

Sample output

{
  "id": "EOEG6RCENNGYAHKV",
  "item_id": "ITMDCCDE819BE6BF",
  "listing_id": "LSTEOEG6RCENNGYAHKVUMLUSJ",
  "product_url": "https://www.shopsy.in//krafter-girls-shoes-stylish-fashion-party-wear-heel-boots-women/p/itmdccde819be6bf?pid=EOEG6RCENNGYAHKV",
  "title": "KRAFTER girls shoes stylish fashion party wear heel Boots For Women",
  "subtitle": "Size: 39",
  "size": "39",
  "brand": "KRAFTER",
  "super_category": "ShopsyLifeStyle",
  "category": "ShopsyWomenFootwear",
  "sub_category": "ShopsyWomenCasualShoes",
  "vertical": "ShopsyWomenBoots",
  "availability_status": "IN_STOCK",
  "currency": "INR",
  "mrp": 999,
  "price": 541,
  "discount_amount": 458,
  "discount_percent": 45,
  "delivery_charge": 0,
  "price_type": "REGULAR",
  "rating_average": 4.1,
  "rating_base": 5,
  "rating_count": 248,
  "review_count": 14,
  "rating_1_star_count": 22,
  "rating_2_star_count": 9,
  "rating_3_star_count": 28,
  "rating_4_star_count": 40,
  "rating_5_star_count": 149,
  "image_count": 8,
  "image_urls": [
    "https://rukmini1.flixcart.com/image/832/832/xif0q/shopsy-shoe/b/t/d/5-1600-dil-krafter-black-enriched-1-original-imag6rbszgvfdg2s.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/xif0q/shopsy-shoe/b/t/d/5-1600-dil-krafter-black-enriched-2-original-imag6rbszgvfdg2s.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/xif0q/shopsy-shoe/b/t/d/5-1600-dil-krafter-black-enriched-3-original-imag6rbszgvfdg2s.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/ktep2fk0/shopsy-shoe/b/t/d/5-1600-dil-krafter-black-original-imag6rbszgvfdg2s.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/ktep2fk0/shopsy-shoe/e/u/l/5-1600-dil-krafter-black-original-imag6rbshpp7gzzm.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/ktep2fk0/shopsy-shoe/v/h/r/5-1600-dil-krafter-black-original-imag6rbsxyyazgmb.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/ktep2fk0/shopsy-shoe/p/g/4/5-1600-dil-krafter-black-original-imag6rbsqmh5gyu4.jpeg?q=70",
    "https://rukmini1.flixcart.com/image/832/832/ktep2fk0/shopsy-shoe/s/8/z/5-1600-dil-krafter-black-original-imag6rbscgstpgzp.jpeg?q=70"
  ],
  "raw_data": {},
  "from_url": "https://www.shopsy.in/search?q=shoe&sort=popularity&page=1&p[]=facets.ideal_for[]=Women&p[]=facets.color[]=Black&p[]=facets.price_range.from=500&p[]=facets.price_range.to=1500&p[]=facets.rating[]=4%E2%98%85%2B%26%2Babove&p[]=facets.discount_range_v1[]=30%2525%2Bor%2Bmore"
}

Complete Output Structure and Field Definitions

The scraper returns JSON data with each product as an object containing detailed fields. Understanding field purposes enables effective analysis and application.

Product Identification

ID: Unique product identifier (PID) on Shopsy/Flipkart. Purpose: Database indexing, tracking specific products over time, avoiding duplicates.

Item ID: Item-level identifier of the product. Purpose: Cross-referencing the same item across listings and URLs.

Listing ID: Identifier of the specific seller listing for the product. Purpose: Distinguishing listings of the same product from different sellers.

Product URL: Direct link to the product page on Shopsy. Purpose: Accessing complete details, sharing products with clients, verification of scraped data.

Title: Product name as displayed on the listing. Purpose: Quick preview, keyword analysis, product matching.

Subtitle: Secondary text of the listing, usually the selected variant (e.g., size). Purpose: Identifying the variant shown in search results.

Size: Size extracted from the subtitle. Purpose: Size-based filtering and stock analysis.

Brand: Brand of the product. Purpose: Brand-level comparison, market share and pricing analysis.

Category

Super Category: Top-level category group (e.g., ShopsyLifeStyle). Purpose: High-level market segmentation.

Category: Product category (e.g., ShopsyMensClothingJeans). Purpose: Category-level analysis and filtering.

Sub Category: Specific product type within the category. Purpose: Fine-grained segmentation.

Vertical: Product vertical used by the platform. Purpose: Grouping products of the same type across categories.

Availability

Availability Status: Stock state of the product (e.g., IN_STOCK). Purpose: Monitoring stock levels, identifying out-of-stock opportunities.

Pricing

Currency: Currency of the listed prices (INR). Purpose: Correct financial interpretation when merging datasets from multiple markets.

MRP: Maximum Retail Price including all taxes. Purpose: Baseline for discount analysis and price positioning.

Price: Current selling price paid by the customer. Purpose: Price comparison, competitor monitoring, price tracking over time.

Discount Amount: Absolute discount from MRP to selling price. Purpose: Measuring promotion depth in currency terms.

Discount Percent: Discount from MRP as a percentage. Purpose: Comparing promotions across products and brands.

Delivery Charge: Delivery fee for the product (0 means free delivery). Purpose: Calculating total cost to customer.

Price Type: Type of listing price (e.g., REGULAR). Purpose: Distinguishing regular prices from special or deal prices.

Ratings and Reviews

Rating Average: Average customer rating. Purpose: Quality assessment, product ranking, customer satisfaction analysis.

Rating Base: Maximum possible rating value (5). Purpose: Normalizing ratings across platforms.

Rating Count: Total number of ratings. Purpose: Measuring popularity and rating reliability.

Review Count: Total number of written reviews. Purpose: Assessing customer engagement.

Rating 1-5 Star Count: Number of ratings for each star level (1 to 5). Purpose: Analyzing rating distribution, detecting polarized or low-quality products.

Media

Image Count: Total number of product images. Purpose: Evaluating listing quality and completeness.

Image URLs: List of direct links to product images in original order (832x832, quality 70). Purpose: Downloading images, visual inspection, computer vision analysis.

Raw Data

Raw Data: Complete original JSON object of the product as scraped, without modification. Purpose: Auditing, debugging, accessing fields not included in the cleaned output, and reprocessing without re-scraping.

---

How to Use

1. Find search URLs — Navigate to Shopsy.in, use category filters or search for products, and copy the page URL from your browser's address bar.
2. Prepare the configuration — Add URLs to the urls array. Example: https://www.shopsy.in/womens-sarees-online/pr?page=1
3. Set parameters — Configure max_items_per_url (recommend 50-200 for balanced speed and data) and enable ignore_url_failures for robustness.
4. Execute the scraper — Start the run and monitor progress in the logs.
5. Export results — Download output as JSON, CSV, or Excel for analysis in spreadsheets, databases, or BI platforms.

Tips:

• Use specific category URLs to collect homogeneous product data (e.g., /womens-sarees-online/pr rather than the homepage).
• For large-scale collection, spread URLs across multiple runs to avoid rate limiting.
• Inspect the Media field — it contains product images essential for visual search and aggregators.

---

Use Cases & Business Value

• Price intelligence: Monitor competitor pricing on Shopsy, track discounts, and identify arbitrage opportunities.
• Product analytics: Analyze brand presence, category trends, and bestseller patterns across Indian e-commerce.
• Inventory monitoring: Track stock levels and availability signals to optimize supply chain decisions.
• Marketplace aggregation: Feed Shopsy product data into price comparison sites, shopping bots, or internal catalogs.
• Competitive benchmarking: Compare product ratings, titles, and promotional strategies across sellers.

The Shopsy Product Scraper transforms tedious manual browsing into automated data pipelines, enabling data-driven decisions at scale.

---

Conclusion

The Shopsy.in Product Scraper is an essential tool for businesses operating in the Indian e-commerce space. With flexible input options, comprehensive 20+ field output, and reliable error handling, it streamlines product data collection from one of India's fastest-growing marketplaces. Whether you're monitoring prices, analyzing trends, or aggregating inventory, this scraper delivers the structured data you need — fast and reliably.