# Hwahae Product Search Scraper (`stealth_mode/hwahae-product-search-scraper`) Actor Scrape product listings from Hwahae.com search results in bulk. Collect names, brands, ratings, ingredients, pricing, rankings, and 25+ fields per product — perfect for beauty market research, competitor analysis, and ingredient tracking. - **URL**: https://apify.com/stealth\_mode/hwahae-product-search-scraper.md - **Developed by:** [Stealth mode](https://apify.com/stealth_mode) (community) - **Categories:** Automation, Developer tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Hwahae.com Products Search Scraper: Extract K-Beauty Data at Scale --- ### What Is Hwahae.com? Hwahae (화해) is one of South Korea's most trusted beauty and skincare platforms, offering product discovery, user reviews, and ingredient analysis for thousands of K-beauty items. Its search functionality surfaces ranked products across categories like creams, serums, and sunscreens. The **Hwahae Products Search Scraper** automates bulk extraction from these search result pages, saving researchers and analysts hours of manual work. --- ### Overview This scraper collects structured product data directly from Hwahae search result URLs. It is suited for: - **Beauty brands** monitoring competitor rankings and pricing - **Cosmetic formulators** researching ingredient trends - **Market researchers** analyzing K-beauty product landscapes - **E-commerce platforms** enriching product catalogs with review and rating data The scraper handles pagination automatically and supports configurable item limits and error tolerance for large-scale runs. --- ### Input Format ```json { "ignore_url_failures": true, "max_items_per_url": 200, "urls": [ "https://www.hwahae.com/en/search?q=cream&tab=all" ] } ```` | Field | Type | Default | Description | |---|---|---|---| | `urls` | `array` | — | One or more Hwahae search result URLs to scrape. Use the `?q=` parameter for keyword searches and `tab=all` to include all product types. Add URLs one by one or via bulk edit. | | `max_items_per_url` | `integer` | `20` | Maximum number of products to collect per URL. Set higher (e.g., `200`) for broader dataset coverage. | | `ignore_url_failures` | `boolean` | `true` | If `true`, the scraper continues running when a URL fails instead of stopping the entire run — recommended for bulk jobs. | > **Tip:** Narrow results by adjusting the `q=` query (e.g., `q=sunscreen`, `q=toner`) or by changing the `tab` parameter if category-specific tabs are available. *** ### Output Format #### Sample Record ```json { "ad_purchase_index": 0, "brand": "WELLAGE (WELLAGE)", "brand_alias": "WELLAGE", "brand_name": "WELLAGE", "product_name": "REAL HYALURONIC SOOTHING CREAM", "obsolete": false, "sale": true, "update_time": 1765387861, "review_count": 3664, "avg_ratings": 4.64410480349345, "view_count": 0, "ingredients": false, "rank": 0, "rank_delta": 0, "rank_delta_new": false, "rank_order": 3, "encrypted_product_id": "d9654d11e8908db59c0f996dd31e3019", "image_url": "https://img.hwahae.co.kr/products/2177164/2177164_20260113144525.jpg", "buy_info": "28,000원", "uid": "12acbded-2573-4bee-a982-0da9e20ff2be", "id": 2177164, "goods": [ { "capacity": "80ml", "discount_price": 22400, "discount_rate": 20, "id": 75134, "name": "[only화해] 리얼 히알루로닉 수딩크림 80ml (+블루 앰플 마스크 2매 증정)" } ], "orderable_goods_stat": { "top_priority_image_url": "https://img.hwahae.co.kr/commerce/goods/20260514_091114_composed-represent.png", "total_count": 1 }, "product_price": 28000, "product_capacity": null, "exchange_rate_price": { "jpy": 2970, "usd": 18.65, "cnh": 126, "vnd": 490865 }, "from_url": "https://www.hwahae.com/en/search?q=cream&tab=all" } ``` Each product record contains 25+ fields: #### Identity & Brand | Field | Meaning | |---|---| | `ID` | Internal Hwahae numeric product identifier | | `UID` | Unique identifier used in platform URLs and API references | | `Encrypted Product ID` | Obfuscated ID used in certain Hwahae endpoints | | `Product Name` | Full product name as listed on Hwahae | | `Brand` | Brand object containing metadata | | `Brand Name` | Display name of the brand | | `Brand Alias` | Alternate or romanized brand name | #### Status & Availability | Field | Meaning | |---|---| | `Obsolete` | Whether the product has been discontinued or delisted | | `Sale` | Whether the product is currently on sale | | `Update Time` | Timestamp of the last data update for this listing | | `Goods` | Associated purchasable goods entries | | `Orderable Goods Stat` | Availability/stock status for orderable variants | #### Pricing | Field | Meaning | |---|---| | `Product Price` | Base price in the local currency | | `Exchange Rate Price` | Price converted using current exchange rates (relevant for international users) | | `Product Capacity` | Volume or weight (e.g., `50ml`, `100g`) | | `Buy Info` | Purchase links or platform availability details | #### Ratings & Engagement | Field | Meaning | |---|---| | `Average Ratings` | Mean user rating score | | `Review Count` | Total number of user reviews submitted | | `View Count` | Number of times the product page has been viewed | | `Ad Purchase Index` | Indicator of paid promotional activity for the listing | #### Ranking | Field | Meaning | |---|---| | `Rank` | Current search/category rank on Hwahae | | `Rank Order` | Ordinal position within the ranked list | | `Rank Delta` | Change in rank since the previous period | | `Rank Delta New` | Adjusted rank delta accounting for new entries | #### Content & Media | Field | Meaning | |---|---| | `Ingredients` | Full ingredient list (INCI format where available) | | `Image URL` | Product thumbnail or main image URL | *** ### How to Use 1. **Build your search URL** — Go to `hwahae.com/en/search?q=YOUR_KEYWORD&tab=all` and copy the URL. 2. **Configure the input** — Paste the URL into `urls`. Set `max_items_per_url` based on how many results you need. 3. **Run the scraper** — Start the actor and monitor progress in the run log. 4. **Export results** — Download as JSON, CSV, or Excel for analysis. **Best practices:** - Run separate URLs for different search queries to keep datasets organized. - Use `max_items_per_url: 200` or higher for market-wide sweeps; lower values work for quick spot checks. - Keep `ignore_url_failures: true` for multi-URL runs to avoid partial failures halting your dataset. *** ### Use Cases & Business Value - **Trend tracking:** Monitor which product types and ingredients are rising in rank week over week - **Ingredient research:** Extract INCI ingredient lists in bulk for formulation analysis - **Pricing intelligence:** Compare price points and sale patterns across brands - **Review analytics:** Correlate review counts and ratings with ranking positions *** ### Conclusion The **Hwahae Products Search Scraper** turns K-beauty search results into structured, analysis-ready datasets. With 25+ fields covering rankings, ingredients, pricing, and engagement metrics, it delivers actionable intelligence for beauty brands, researchers, and developers alike. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## Actor input object example ```json { "urls": [ "https://www.hwahae.com/en/search?q=cream&tab=all" ], "ignore_url_failures": true, "max_items_per_url": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.hwahae.com/en/search?q=cream&tab=all" ], "ignore_url_failures": true, "max_items_per_url": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("stealth_mode/hwahae-product-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.hwahae.com/en/search?q=cream&tab=all"], "ignore_url_failures": True, "max_items_per_url": 20, } # Run the Actor and wait for it to finish run = client.actor("stealth_mode/hwahae-product-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.hwahae.com/en/search?q=cream&tab=all" ], "ignore_url_failures": true, "max_items_per_url": 20 }' | apify call stealth_mode/hwahae-product-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=stealth_mode/hwahae-product-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Hwahae Product Search Scraper", "description": "Scrape product listings from Hwahae.com search results in bulk. Collect names, brands, ratings, ingredients, pricing, rankings, and 25+ fields per product — perfect for beauty market research, competitor analysis, and ingredient tracking.", "version": "0.0", "x-build-id": "lFmEKSS1UBhqdQnh8" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/stealth_mode~hwahae-product-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-stealth_mode-hwahae-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/stealth_mode~hwahae-product-search-scraper/runs": { "post": { "operationId": "runs-sync-stealth_mode-hwahae-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/stealth_mode~hwahae-product-search-scraper/run-sync": { "post": { "operationId": "run-sync-stealth_mode-hwahae-product-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the product search list urls to scrape", "type": "array", "description": "Add the URLs of the product search list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```