You can access the JSON Catalog Deduplicator v2 programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{
<  "searchKeywords": [
<    "source-backed signal",
<    "buyer fit"
<  ],
<  "taskIntent": "buyer-ready-product-run",
<  "sourceMode": "startUrls",
<  "outputMode": "buyer-ready-records",
<  "startUrls": [
<    {
<      "url": "https://colourpop.com/products.json"
<    }
<  ],
<  "requestTimeoutSecs": 30,
<  "maxRequestRetries": 2,
<  "sinceLastRun": false,
<  "deltaMode": true
<}' |
<apify call zentrafoundry/dataset-deduplicator-v2 --silent --output-dataset

JSON catalog dedupe v2 — ColourPop Try API through CLI

The Apify CLI is the official tool that allows you to use JSON Catalog Deduplicator v2 locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

JSON Catalog Deduplicator v2 API in Python

JSON Catalog Deduplicator v2 API in JavaScript

JSON Catalog Deduplicator v2 OpenAPI definition

JSON Catalog Deduplicator v2 API

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

ParseBird

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

DataCach

Public JSON Catalog Diff v2

zentrafoundry/dataset-diff-engine-v2

Diffs two public JSON catalogs. Try is Allbirds vs ColourPop products.json. Distinct pair from v1. $2 / 1,000.

Zentra

JSON Catalog Schema Normalizer v2

zentrafoundry/csv-json-schema-normalizer-v2

Typed rows from a public JSON catalog. Try is ColourPop — distinct from v1 Allbirds. $0.002 / row.

Zentra

JSON Dataset Quality Auditor

zentrafoundry/apify-dataset-quality-auditor-v2

Field-level audit of a public JSON array. Try is Allbirds products.json. Not an Apify platform scanner. $2 / 1,000.

Zentra

🧽 Dataset Deduplicator - Clean Any Scraped Dataset

that_red_bird/dataset-deduplicator

🧽 Upload any dataset — scraped rows, a RAG corpus, an export — and get back exact AND near-duplicates removed, plus a per-field data quality report. ✅ MinHash + LSH banding finds near-duplicate text at scale without O(n²) pairwise comparison.

mohamed alaya

Validate Dataset(s) with JSON Schema

jaroslavhejlek/validate-dataset-with-json-schema

This Actor validates items in one or more datasets against a provided JSON Schema. Use it if you planning to add a dataset validation schema to your actor and you want test it.