# Etsy Product Search Spider (`getdataforme/etsy-product-search-spider`) Actor Automate Etsy product data extraction with customizable keywords, ensuring high-quality and comprehensive product details. Tailor the process with flexible configurations and export results in JSON, CSV, or Excel for market research, competitive analysis, and more.... - **URL**: https://apify.com/getdataforme/etsy-product-search-spider.md - **Developed by:** [GetDataForMe](https://apify.com/getdataforme) (community) - **Categories:** AI, Automation, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $9.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README --- ## Etsy Product Search Spider ### Introduction The **Etsy Product Search Spider** is a powerful tool designed to automate the extraction of product data from Etsy based on specified keywords. This Apify Actor enables users to efficiently gather detailed information about products for various applications, including market research and competitive analysis. ### Features - **Automated Data Extraction**: Seamlessly scrape product details using customizable search terms. - **High-Quality Data**: Reliable and accurate product information with comprehensive attributes. - **Flexible Configuration**: Set item limits and keywords to tailor the scraping process. - **Efficient Performance**: Optimized for speed and efficiency, ensuring timely data retrieval. - **Versatile Output Formats**: Export results in JSON, CSV, or Excel formats. ### Input Parameters | Parameter | Type | Required | Description | Example | |-------------|---------|----------|-----------------------------------------------------------------------------|------------------------| | Keywords | Array | No | The keywords for the spider. | `["phone cover"]` | | item_limit | Integer | No | Maximum items to scrape per actor run. Set to 0 for no limit. | `10` | ### Example Usage #### Input JSON ```json { "Keywords": ["phone cover"], "item_limit": 10 } ```` #### Output JSON ```json [ { "title": "Real Pressed Flower Phone Case for iPhone 17 16 15 14 13 12 11 Pro Max X case, Samsung S23 S24 25 26 Ultra case, Google Pixel 8 9 Pro case", "price": "30.27", "currency_code": "USD", "url": "https://www.etsy.com/listing/1634486966/real-pressed-flower-phone-case-for", "shop_average_rating": "4.88", "shop_total_rating_count": "11747", "origin_country_id": 219, "min_processing_days": 3, "max_processing_days": 7, "origin_postal_code": "", "are_returns_accepted": true, "are_exchanges_accepted": true, "return_deadline_in_days": 30, "image_urls": [ "https://i.etsystatic.com/25926642/r/il/9da8fb/6325793285/il_fullxfull.6325793285_227x.jpg" ], "actor_id": "Txmp6U3yfjDMuLKBw", "run_id": "buW3U6XYsfEBvzEuT" }, { "title": "Stained Glass Wildflower Phone Case – Mosaic Floral Cover for Samsung S26 Ultra S25 FE S24 S23 iPhone 17 Pro Max 16 15 Plus 14 13 Pixel 10", "price": "27.76", "currency_code": "USD", "url": "https://www.etsy.com/listing/4470243048/stained-glass-wildflower-phone-case", "shop_average_rating": "4.8", "shop_total_rating_count": "4535", "origin_country_id": 146, "min_processing_days": 1, "max_processing_days": 2, "origin_postal_code": "LV1006", "are_returns_accepted": true, "are_exchanges_accepted": true, "return_deadline_in_days": 21, "image_urls": [ "https://i.etsystatic.com/27459213/r/il/189807/7841696321/il_fullxfull.7841696321_2mmy.jpg" ], "actor_id": "Txmp6U3yfjDMuLKBw", "run_id": "buW3U6XYsfEBvzEuT" } ] ``` ### Use Cases - **Market Research and Analysis**: Gain insights into product trends and consumer preferences. - **Competitive Intelligence**: Monitor competitor offerings to inform strategic decisions. - **Price Monitoring**: Track pricing changes across different products for competitive pricing strategies. - **Content Aggregation**: Collect data for content creation, such as blogs or market reports. - **Academic Research**: Use the data for research projects and academic studies in e-commerce. - **Business Automation**: Integrate with business processes to automate data-driven decision-making. ### Installation and Usage 1. Search for "Etsy Product Search Spider" in the Apify Store. 2. Click "Try for free" or "Run". 3. Configure input parameters as needed. 4. Click "Start" to begin extraction. 5. Monitor progress in the log. 6. Export results in your preferred format (JSON, CSV, Excel). ### Output Format The output is a JSON array of product objects, each containing: - `title`: Product title - `price`: Product price - `currency_code`: Currency code for the price - `url`: URL to the Etsy listing - `shop_average_rating`: Average shop rating - `shop_total_rating_count`: Total number of ratings - `origin_country_id`: Country ID where the product is made - `min_processing_days` and `max_processing_days`: Estimated processing time - `origin_postal_code`: Postal code of origin - `are_returns_accepted`, `are_exchanges_accepted`: Return and exchange policies - `return_deadline_in_days`: Deadline for returns in days - `image_urls`: List of image URLs - `actor_id` and `run_id`: Unique identifiers for the actor run ### Error Handling Information The Actor is designed to handle common errors such as network issues or changes in Etsy's HTML structure. If an error occurs, it will be logged, and you can review these logs to understand what went wrong. For persistent issues, please contact support. ### Rate Limiting and Best Practices To avoid being blocked by Etsy, adhere to the following best practices: - Use a reasonable `item_limit` to prevent overloading the server. - Avoid running multiple instances simultaneously on the same account. - Respect Etsy's terms of service regarding data scraping. ### Limitations and Considerations - The Actor may not capture all product variations or options available on Etsy. - Changes in Etsy’s website structure can affect data extraction accuracy. - Ensure compliance with Etsy’s terms of use when using scraped data. # Actor input Schema ## `Keywords` (type: `array`): The keywords for the spider. ## `item_limit` (type: `integer`): Maximum items to scrape per actor run. Set to 0 for no limit. ## Actor input object example ```json { "Keywords": [ "phone cover" ], "item_limit": 10 } ``` # Actor output Schema ## `results` (type: `string`): Scraped data items from dataset # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("getdataforme/etsy-product-search-spider").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("getdataforme/etsy-product-search-spider").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call getdataforme/etsy-product-search-spider --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=getdataforme/etsy-product-search-spider", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Etsy Product Search Spider", "description": "Automate Etsy product data extraction with customizable keywords, ensuring high-quality and comprehensive product details. Tailor the process with flexible configurations and export results in JSON, CSV, or Excel for market research, competitive analysis, and more....", "version": "0.0", "x-build-id": "AxqnCyx3cf1KPOq5A" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/getdataforme~etsy-product-search-spider/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-getdataforme-etsy-product-search-spider", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/getdataforme~etsy-product-search-spider/runs": { "post": { "operationId": "runs-sync-getdataforme-etsy-product-search-spider", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/getdataforme~etsy-product-search-spider/run-sync": { "post": { "operationId": "run-sync-getdataforme-etsy-product-search-spider", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "Keywords": { "title": "Keywords", "type": "array", "description": "The keywords for the spider.", "default": [ "phone cover" ], "items": { "type": "string" } }, "item_limit": { "title": "Item limit", "minimum": 0, "type": "integer", "description": "Maximum items to scrape per actor run. Set to 0 for no limit.", "default": 10 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```