Cosme Category List Scraper

Introduction

The Cosme Category List Scraper is a powerful Apify Actor designed to extract detailed product information from Cosme.com category pages. It automates the collection of cosmetic product data, including names, prices, reviews, ratings, and ingredients, enabling efficient market research and competitive analysis. This tool saves time and resources by providing structured, high-quality data directly from one of Japan's leading beauty product platforms.

Features

• Comprehensive Data Extraction: Scrapes key product details such as name, price, review count, rating, URL, brand, category, size, ingredients, and JAN code.
• Flexible URL Input: Supports multiple start URLs for scraping various categories or product lists.
• Configurable Request Limits: Allows setting a maximum number of requests to control data volume and avoid overloading the target site.
• High-Quality Output: Delivers clean, structured JSON data with Japanese text properly handled for international use.
• Reliable Performance: Built on PlaywrightCrawler for robust web scraping, handling dynamic content and anti-bot measures.
• Easy Integration: Outputs data in JSON format, compatible with Apify's export options for CSV, Excel, or direct API access.
• Error-Resilient: Includes built-in handling for common scraping challenges like timeouts or blocked requests.

Input Parameters

Parameter	Type	Required	Description	Example
startUrls	array	Yes	An array of URLs to start scraping from. Each URL should point to a Cosme category page.	[{"url": "https://www.cosme.com/category/index.php?category_id=178"}]
maxItems	number	No	The maximum number of requests to make during the scrape. This helps limit the scope and avoid excessive load. Default is 10.	50

Example Usage

Input

{
  "startUrls": [
    {
      "url": "https://www.cosme.com/category/index.php?category_id=178"
    }
  ],
  "maxItems": 10
}

Output

[
  {
    "product_name": "クリーム イン デイII&ナイトII トライアル セット / 15g×15g",
    "price": "7,700",
    "review_count": "2494",
    "rating_value": "5.8",
    "url": "https://www.cosme.com/products/detail.php?product_id=400850",
    "ブランド名": "KANEBO",
    "アイテムカテゴリ": [
      "キット・セット",
      "スキンケアキット"
    ],
    "サイズ": "15g×15g",
    "成分": "【カネボウ クリーム イン デイII】 成分:ニコチン酸アミド*、グリチルリチン酸ジカリウム*、水、マカデミアナッツ油脂肪酸フィトステリル、DPG、ソルビット液、パラメトキシケイ皮酸オクチル、ジグリセリン、濃グリセリン、シュガースクワラン、トリイソステアリン酸グリセリル、ベヘニルアルコール、BG、雲母Ti、TEA、フェニルベンゾイミダゾールスルホン酸、長鎖分岐脂肪酸コレステリル、水添大豆リン脂質、イソステアリン酸、コレステロール、パルミチン酸、パルミチン酸セチル、N-ステアロイルジヒドロスフィンゴシン、自然ビタミンE、海藻エキス-1、アルテアエキス、2,4-ビス-[{4-(2-エチルヘキシルオキシ)-2-ヒドロキシ}-フェニル]-6-(4-メトキシフェニル)-1,3,5-トリアジン、トリスエチルヘキシルオキシカルボニルアニリノトリアジン、t-ブチルメトキシジベンゾイルメタン、2-[4-(ジエチルアミノ)-2-ヒドロキシベンゾイル]安息香酸ヘキシルエステル、ジメチコン、カルボキシビニルポリマー、キサンタンガム、エデト酸塩、フェノキシエタノール、クロルフェネシン、色素504、香料 *は「有効成分」無表示は「その他の成分」 【カネボウ クリーム イン ナイトII】 成分:ナイアシンアミド*、水、シュガースクワラン、マルチトール液、マカデミアナッツ油脂肪酸フィトステリル、DPG、濃グリセリン、BG、トリイソステアリン酸グリセリル、ホホバ油、オリーブ油、パルミチン酸セチル、ベヘニルアルコール、長鎖分岐脂肪酸コレステリル、水添大豆リン脂質、イソステアリン酸、コレステロール、パルミチン酸、N-ステアロイルジヒドロスフィンゴシン、海藻エキス-1、テンシャエキス、トウヒエキス、自然ビタミンE、ワレモコウエキス、N-メチル-L-セリン、水溶性ショウキョウエキス(K)、セテアリルアルコール、チューベロースポリサッカライド液-BG、N-アミジノ-L-プロリン、フェノキシエタノール、キシリトール、ジメチコン、カルボキシビニルポリマー、クロルフェネシン、カラギーナン、水酸化K、ヒドロキシプロピルメチルセルロース、エデト酸塩、無水エタノール、香料 *は「有効成分」無表示は「その他の成分」",
    "JANコード": "4973167065587"
  }
]

Use Cases

• Market Research: Analyze trends in cosmetic products, pricing, and consumer preferences across categories.
• Competitive Intelligence: Monitor competitors' product offerings, reviews, and ratings on Cosme.com.
• Price Monitoring: Track price changes and promotions for specific brands or items.
• Content Aggregation: Build databases of beauty products for blogs, apps, or e-commerce platforms.
• Academic Research: Study consumer behavior in the beauty industry using real-world data.
• Business Automation: Automate data collection for inventory management or supplier analysis.

Installation and Usage

1. Search for "Cosme Category List Scraper" in the Apify Store
2. Click "Try for free" or "Run"
3. Configure input parameters
4. Click "Start" to begin extraction
5. Monitor progress in the log
6. Export results in your preferred format (JSON, CSV, Excel)

Output Format

The Actor outputs data in JSON format, with each item representing a scraped product. Key fields include:

• product_name: The full name of the product.
• price: The listed price (as a string).
• review_count: Number of reviews.
• rating_value: Average rating.
• url: Direct link to the product page.
• ブランド名: Brand name.
• アイテムカテゴリ: Array of categories.
• サイズ: Product size.
• 成分: Ingredients list.
• JANコード: JAN code for identification.

Data is structured for easy parsing and integration into downstream applications.

Support

For custom/simplified outputs or bug reports, please contact:

• Email: support@getdataforme.com
• Subject line: "custom support"
• Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!

---

PART 2: Concise Description

Unlock comprehensive cosmetic product data from Cosme.com with our scraper. Extract names, prices, reviews, ratings, ingredients, and more in structured JSON. Ideal for market research, competitive analysis, and price monitoring. Fast, reliable, and easy to use—start scraping today! (248 characters)