# Shopsy Product Search Scraper (`stealth_mode/shopsy-product-search-scraper`) Actor Collect product data from Shopsy.in search pages instantly. Extract pricing, ratings, availability, brand info, media URLs, and 20+ fields per product — perfect for price monitoring, inventory analysis, and competitive intelligence on India's growing marketplace. - **URL**: https://apify.com/stealth\_mode/shopsy-product-search-scraper.md - **Developed by:** [Stealth mode](https://apify.com/stealth_mode) (community) - **Categories:** Automation, Developer tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Shopsy.in Product Scraper: Extract Ecommerce Data from Search Results --- ### What Is Shopsy.in? Shopsy.in is a prominent Indian e-commerce platform offering a wide variety of products across fashion, electronics, home, and lifestyle categories. With millions of active listings, it serves millions of shoppers seeking competitive pricing and diverse brands. For businesses monitoring market trends, analyzing competitor pricing, or aggregating product data, manually collecting this information is impractical — the **Shopsy.in Product Scraper** automates the extraction process from search result pages, delivering structured product records in seconds. --- ### Overview The **Shopsy Product Scraper** extracts product listings from Shopsy.in search result pages, converting item cards into detailed, machine-readable records. It is designed for: - **Price monitoring agents** tracking competitor product pricing and promotions - **Market researchers** analyzing product assortment and brand presence - **E-commerce aggregators** integrating Shopsy data into multi-channel platforms - **Business analysts** benchmarking product availability and ratings across categories - **Inventory managers** monitoring stock levels and restocking signals Key advantages include handling multiple search pages at scale, configurable item limits, resilient error handling via `ignore_url_failures`, and comprehensive product metadata across 20+ fields. --- ### Input Format The scraper accepts a JSON configuration object: ```json { "urls": [ "https://www.shopsy.in/mens-jeans-online/pr?page=2" ], "ignore_url_failures": true, "max_items_per_url": 200 } ```` #### Input Parameters Explained | Parameter | Type | Description | Example | |---|---|---|---| | `urls` | Array | Search result page URLs from Shopsy.in to scrape. Each URL should point to a filtered category or search results page. | `["https://www.shopsy.in/mens-jeans-online/pr?page=2"]` | | `ignore_url_failures` | Boolean | If `true`, the scraper continues even if some URLs fail. If `false`, the entire run stops on the first failure. Recommended: `true` for batch runs. | `true` | | `max_items_per_url` | Integer | Maximum number of products to extract from each URL. Useful for testing or controlling data volume. Default: 20, Max: 200. | `200` | > **Best Practice:** Use category-filtered URLs (e.g., `/mens-jeans-online/pr`) or search queries (e.g., `/search?q=leather-shoes`) to target specific product segments. Pagination parameters like `?page=2` automatically load additional results. *** ### Output Format **Sample output** ```json { "type": "ProductSummaryValue", "analytics_data": { "category": "ShopsyMensClothingJeans", "sub_category": "ShopsyMensJean", "super_category": "ShopsyLifeStyle", "vertical": "ShopsyMensJean" }, "availability": { "message_intent": "positive", "display_state": "IN_STOCK", "intent": "positive", "show_message": false }, "base_url": "/denim-life-loose-fit-men-light-blue-jeans/p/itm0c0e268426dfe?pid=XJNHGMTYAVNEUUBJ", "buyability": { "intent": "positive", "message": null, "show_message": false }, "condition_callout": false, "flags": { "enable_chat": true, "enable_compare": false, "enable_flipkart_advantage": false, "enable_offer_tag": true, "enable_visual_discovery": false, "enable_wishlist": true, "show_secondary_title": true, "swatch_available_on_browse_page": true }, "grade": { "color": null, "id": null, "name": null, "short_desc": null }, "id": "XJNHGMTYAVNEUUBJ", "item_id": "ITM0C0E268426DFE", "listing_id": "LSTXJNHGMTYAVNEUUBJ2OX1OE", "max_order_quantity_allowed": 0, "media": { "images": [ { "aspect_ratio": null, "content_info": null, "height": null, "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/shopsy-jean/m/y/a/-original-imahn5xu6yhtzhve.jpeg?q={@quality}", "width": null }, { "aspect_ratio": null, "content_info": null, "height": null, "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/5/y/h/26-dl-blue-baggy-01-denim-life-original-imahgmnee6crzhfx.jpeg?q={@quality}", "width": null }, { "aspect_ratio": null, "content_info": null, "height": null, "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/h/6/m/26-dl-blue-baggy-01-denim-life-original-imahgmneyzjxrhxz.jpeg?q={@quality}", "width": null }, { "aspect_ratio": null, "content_info": null, "height": null, "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/y/w/j/28-dl-blue-baggy-01-denim-life-original-imahgmnehxvtsrze.jpeg?q={@quality}", "width": null }, { "aspect_ratio": null, "content_info": null, "height": null, "url": "http://rukmini1.flixcart.com/image/{@width}/{@height}/xif0q/jean/y/w/r/30-dl-blue-baggy-01-denim-life-original-imahgmneksqtf6xc.jpeg?q={@quality}", "width": null } ] }, "pricing": { "type": "ListingPriceValue", "coupon_applied": null, "delivery_charge": { "additional_text": null, "currency": "INR", "decimal_value": "0.00", "discount": null, "downpayment_rate": 0, "downpayment_required": false, "name": "Delivery Charges", "price_type": null, "strike_off": false, "text_style": null, "value": 0 }, "discount_amount": 954, "emi_price": null, "extra_discount": null, "final_price": { "additional_text": null, "currency": "INR", "decimal_value": "345.00", "discount": null, "downpayment_rate": 0, "downpayment_required": false, "name": "Total", "price_type": null, "strike_off": false, "text_style": null, "value": 345 }, "final_savings_text": null, "insured_price": null, "know_more": null, "listing_price_type": "REGULAR", "mrp": { "additional_text": "(incl. of all taxes)", "currency": "INR", "decimal_value": "1299.00", "discount": null, "downpayment_rate": 0, "downpayment_required": false, "name": "Maximum Retail Price", "price_type": null, "strike_off": true, "text_style": null, "value": 1299 }, "part_price_info": null, "plus_price_info": null, "price_descriptions": null, "price_per_unit": null, "price_tags": null, "prices": [ { "additional_text": null, "currency": "INR", "decimal_value": "1299.00", "discount": 73, "downpayment_rate": 0, "downpayment_required": false, "name": "Selling Price", "price_type": "FSP", "strike_off": true, "text_style": null, "value": 1299 }, { "additional_text": null, "currency": "INR", "decimal_value": "345.00", "discount": null, "downpayment_rate": 0, "downpayment_required": false, "name": "Special Price", "price_type": "SPECIAL_PRICE", "strike_off": false, "text_style": null, "value": 345 } ], "selected": null, "show_discount_as_amount": false, "sub_title": null, "title": null, "total_discount": 73, "upi_price_callout": null, "upi_regular_price_title": null }, "product_brand": "Denim Life", "product_card_tag_details": [], "rating": { "type": "RatingValue", "average": 3.6, "base": 5, "breakup": [ 24, 15, 18, 28, 62 ], "count": 147, "histogram_base_count": 62, "review_count": 9, "round_off_count": "147" }, "smart_url": "http://dl.flipkart.com/dl/denim-life-loose-fit-men-light-blue-jeans/p/itm0c0e268426dfe?pid=XJNHGMTYAVNEUUBJ", "tags": [], "titles": { "co_subtitle": "Size: 28", "title": "Denim Life Loose Fit Men Light Blue Jeans" }, "vertical": "shopsy_jean", "from_url": "https://www.shopsy.in/mens-jeans-online/pr?page=2" } ``` Each scraped product returns a comprehensive record with 20+ fields: #### Product Identification | Field | Meaning | Example | |---|---|---| | `Type` | Product category type (e.g., "Apparel", "Electronics") | `"Apparel"` | | `ID` | Unique Shopsy product identifier | `"prod_abc123xyz"` | | `Item ID` | Internal item reference number | `"item_9876543"` | | `Listing ID` | Specific marketplace listing ID | `"listing_prod_456789"` | | `Product Brand` | Official brand name of the product | `"Lee"` or `"Nike"` | | `Titles` | Full product title/name as displayed | `"Men's Slim Fit Blue Denim Jeans - Size 32"` | | `Smart URL` | Canonical product page URL on Shopsy | `"https://www.shopsy.in/p/product-slug-123"` | | `Base URL` | Original search page or category URL | `"https://www.shopsy.in/mens-jeans-online/pr?page=2"` | #### Pricing & Purchasing | Field | Meaning | Example | |---|---|---| | `Pricing` | Price object containing MRP, discounted price, currency, savings | `{"mrp": 3999, "discounted": 2499, "currency": "INR", "discount_percent": 37}` | | `Buyability` | Whether the product is purchasable (e.g., "in\_stock", "out\_of\_stock") | `"in_stock"` | | `Max Order Quantity Allowed` | Maximum units a customer can purchase in one order | `5` | | `Availability` | Stock availability status and fulfillment type | `"In Stock - Ships within 2 days"` | #### Product Details & Metadata | Field | Meaning | Example | |---|---|---| | `Condition Callout` | Product condition label (e.g., "New", "Refurbished", "Like New") | `"New"` | | `Grade` | Product grade or quality rating (seller/system assigned) | `"Grade A"` | | `Vertical` | Marketplace category or vertical | `"Fashion & Apparel"` | | `Tags` | Searchable tags and labels (size, color, material) | `["blue", "slim-fit", "cotton", "mens", "denim"]` | | `Product Card Tag Details` | Structured tag objects with metadata | `[{"tag": "blue", "type": "color"}]` | #### Media & Visual Content | Field | Meaning | Example | |---|---|---| | `Media` | Array of image and video URLs for the product | `["https://cdn.shopsy.in/img1.jpg", "https://cdn.shopsy.in/img2.jpg"]` | #### Reviews & Social Proof | Field | Meaning | Example | |---|---|---| | `Rating` | Customer rating object (score, review count, average stars) | `{"average": 4.2, "count": 156, "max": 5}` | #### Performance & Analytics | Field | Meaning | Example | |---|---|---| | `Analytics Data` | Click-through rate, impression count, or trending signals | `{"clicks": 342, "impressions": 5821, "trend": "rising"}` | | `Flags` | Special labels or warnings (e.g., "low\_stock", "best\_seller", "trending") | `["best_seller", "trending"]` | *** ### How to Use 1. **Find search URLs** — Navigate to Shopsy.in, use category filters or search for products, and copy the page URL from your browser's address bar. 2. **Prepare the configuration** — Add URLs to the `urls` array. Example: `https://www.shopsy.in/womens-sarees-online/pr?page=1` 3. **Set parameters** — Configure `max_items_per_url` (recommend 50-200 for balanced speed and data) and enable `ignore_url_failures` for robustness. 4. **Execute the scraper** — Start the run and monitor progress in the logs. 5. **Export results** — Download output as JSON, CSV, or Excel for analysis in spreadsheets, databases, or BI platforms. **Tips:** - Use specific category URLs to collect homogeneous product data (e.g., `/womens-sarees-online/pr` rather than the homepage). - For large-scale collection, spread URLs across multiple runs to avoid rate limiting. - Inspect the `Media` field — it contains product images essential for visual search and aggregators. *** ### Use Cases & Business Value - **Price intelligence:** Monitor competitor pricing on Shopsy, track discounts, and identify arbitrage opportunities. - **Product analytics:** Analyze brand presence, category trends, and bestseller patterns across Indian e-commerce. - **Inventory monitoring:** Track stock levels and availability signals to optimize supply chain decisions. - **Marketplace aggregation:** Feed Shopsy product data into price comparison sites, shopping bots, or internal catalogs. - **Competitive benchmarking:** Compare product ratings, titles, and promotional strategies across sellers. The Shopsy Product Scraper transforms tedious manual browsing into automated data pipelines, enabling data-driven decisions at scale. *** ### Conclusion The **Shopsy.in Product Scraper** is an essential tool for businesses operating in the Indian e-commerce space. With flexible input options, comprehensive 20+ field output, and reliable error handling, it streamlines product data collection from one of India's fastest-growing marketplaces. Whether you're monitoring prices, analyzing trends, or aggregating inventory, this scraper delivers the structured data you need — fast and reliably. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## Actor input object example ```json { "urls": [ "https://www.shopsy.in/mens-jeans-online/pr?page=2" ], "ignore_url_failures": true, "max_items_per_url": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.shopsy.in/mens-jeans-online/pr?page=2" ], "ignore_url_failures": true, "max_items_per_url": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("stealth_mode/shopsy-product-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.shopsy.in/mens-jeans-online/pr?page=2"], "ignore_url_failures": True, "max_items_per_url": 20, } # Run the Actor and wait for it to finish run = client.actor("stealth_mode/shopsy-product-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.shopsy.in/mens-jeans-online/pr?page=2" ], "ignore_url_failures": true, "max_items_per_url": 20 }' | apify call stealth_mode/shopsy-product-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=stealth_mode/shopsy-product-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Shopsy Product Search Scraper", "description": "Collect product data from Shopsy.in search pages instantly. Extract pricing, ratings, availability, brand info, media URLs, and 20+ fields per product — perfect for price monitoring, inventory analysis, and competitive intelligence on India's growing marketplace.", "version": "0.0", "x-build-id": "p2PV5LsEja7LsDind" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/stealth_mode~shopsy-product-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-stealth_mode-shopsy-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/stealth_mode~shopsy-product-search-scraper/runs": { "post": { "operationId": "runs-sync-stealth_mode-shopsy-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/stealth_mode~shopsy-product-search-scraper/run-sync": { "post": { "operationId": "run-sync-stealth_mode-shopsy-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the product search list urls to scrape", "type": "array", "description": "Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```