# 全角半角・カナかなの違いを吸収してデータセットを統合・重複除去

**Use case:** 

複数の Apify データセットをまとめ、商品コードや社名などのキーで重複を除きます。比べるときだけ、前後の空白・大文字小文字・全角半角（ＡＢ１＝AB1、ｶﾅ＝カナ）・カタカナとひらがなの違いを無視でき、出力の値はそのままです。別のデータセットから VLOOKUP のように項目を足すこともできます。

## Input

```json
{
  "removeDuplicates": true,
  "keep": "first",
  "joinType": "left",
  "lookupPrefix": "lookup_",
  "keyNormalization": [
    "trim",
    "case",
    "width",
    "kana"
  ],
  "addSourceDataset": false,
  "addDuplicateCount": false
}
```

## Output

```json
{
  "sku": {
    "label": "Sku"
  },
  "name": {
    "label": "Name"
  },
  "maker": {
    "label": "Maker"
  },
  "price": {
    "label": "Price"
  },
  "currency": {
    "label": "Currency"
  },
  "url": {
    "label": "Url"
  },
  "maker_country": {
    "label": "Maker country"
  },
  "maker_supportEmail": {
    "label": "Maker support email"
  },
  "maker_leadTimeDays": {
    "label": "Maker lead time days"
  },
  "_sourceDataset": {
    "label": "Source dataset"
  },
  "_duplicateCount": {
    "label": "Duplicate count"
  }
}
```

## How it works

### 1. Sign up on Apify or log in

The Merge, Deduplicate & Join Datasets Actor is ready to run with the inputs already set for "全角半角・カナかなの違いを吸収してデータセットを統合・重複除去". [Sign up or log in](https://console.apify.com/create-task-from-example/4WcpjE8gmZwbtD28A) and you'll land in Apify Console with a copy of this exact task.

### 2. Start the "全角半角・カナかなの違いを吸収してデータセットを統合・重複除去" task

The Merge, Deduplicate & Join Datasets Actor will start running based on the input automatically. You can also change all the input fields, like remove duplicates, which duplicate to keep, and more, to match your specific use case.

### 3. Receive the "全角半角・カナかなの違いを吸収してデータセットを統合・重複除去" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as sku, name, maker, and more.

### 4. Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also [run the "全角半角・カナかなの違いを吸収してデータセットを統合・重複除去" task via API](https://apify.com/quietworkslab/merge-dedup-datasets.md).

## FAQ

### 全角半角を無視すると、出力の値も半角になりますか？

Merge, Deduplicate & Join Datasets は、キーを比べるときだけ揃えます。出力の項目の値は元のまま変えません。

### どの重複が残りますか？

Merge, Deduplicate & Join Datasets は並び順だけで決めます。first は先に読んだデータセットの項目、last は後に読んだ項目を残します。新しい版を残したいときは、新しいデータを最後に置いて last を選びます。

### 料金はいくらですか？

Merge, Deduplicate & Join Datasets は読んだ件数1件ごとに $0.0001（1,000件で $0.10）、参照データセットは20件ごとに1件分です。ほかに Apify の Actor の開始のイベントがかかります。同梱の見本は件数の課金がありません。

## About this Actor

This example demonstrates how to use [Merge, Deduplicate & Join Datasets](https://apify.com/quietworkslab/merge-dedup-datasets.md) with a specific input configuration. Visit the [Actor detail page](https://apify.com/quietworkslab/merge-dedup-datasets.md) to learn more, explore other use cases, and run it yourself.


## How to integrate an Actor?

This Task's input is already configured above. Use it as-is rather than inventing a new one.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For full API examples (JavaScript, Python, CLI, MCP, OpenAPI), see this Task's Actor page: https://apify.com/quietworkslab/merge-dedup-datasets.md

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).