You can access the Dataset Deduplicator programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "buyerQuery": "buyer-ready records with source evidence",
10    "taskIntent": "buyer-ready-product-run",
11    "sourceMode": "sample",
12    "outputMode": "sample-records",
13    "startUrls": [],
14    "maxItems": 1,
15    "perSourceLimit": 25,
16    "maxTotalChargeUsd": 5,
17    "overallTimeoutSecs": 900,
18    "requestTimeoutSecs": 30,
19    "maxRequestRetries": 2,
20    "sinceLastRun": False,
21    "deltaMode": True,
22}
23
24# Run the Actor and wait for it to finish
25run = client.actor("zentrafoundry/dataset-deduplicator").call(run_input=run_input)
26
27# Fetch and print Actor results from the run's dataset (if there are any)
28print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
29for item in client.dataset(run["defaultDatasetId"]).iterate_items():
30    print(item)
31
32# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Deduplicate Apify Datasets by URL, Email, Phone, or Fuzzy Ma API in Python

The Apify API client for Python is the official library that allows you to use Dataset Deduplicator API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Dataset Deduplicator API in JavaScript

Dataset Deduplicator API through CLI

Dataset Deduplicator OpenAPI definition

Dataset Deduplicator API

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

DataCach

Lead List Deduplicator & Merger

jurassic_jove/lead-deduplicator-merger

Merge and deduplicate lead lists from multiple Apify datasets, CSV files and inline JSON into one clean, outreach-ready list. Pure data processor — no scraping, no proxies, no external APIs.

Data Runner

Dataset Deduplicator

automation-lab/dataset-dedup

Merge and deduplicate Apify datasets by any field combination. Remove duplicates, keep first or last occurrence. Case-insensitive matching, whitespace trimming. Pay per 1K items processed.

Stas Persiianenko

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

ParseBird

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.

Rodrigo Dias

Dataset Deduplicator v2

zentrafoundry/dataset-deduplicator-v2

Transform dataset deduplicator v2 inputs into structured rows, clear errors, confidence signals, and automation-ready output.

Zentra

Dataset Cleaner Visual Dedup Merge Export

leadsbrary/dataset-cleaner-visual-dedup-merge-export

Clean any Apify dataset visually: dedupe, filter, merge, rename/reorder columns, then export a new dataset, CSV, or XLSX. No code. Everything happens in a spreadsheet-style web UI.

Alexandre Manguis

RSS Feed Merger & Smart Deduplicator

bene123/rss-feed-merger-deduplicator

Merge up to 100 RSS, Atom, or RDF feeds into one JSON/CSV dataset with keyword filters, tracking-parameter cleanup, smart cross-feed deduplication, and duplicate-source provenance.