Pricing

from $0.20 / 1,000 row writtens

Try for free

Go to Apify Store

Merge & Dedup Datasets, CSV, JSON & Excel Files

Try for free

Merge Apify datasets, CSV, JSON, JSON Lines and Excel files into one clean dataset. Remove duplicates on any fields, ignoring case, spaces and URL variants; keep the first, last or most complete row; filter, pick and rename fields. No code. Duplicates and filtered rows are free.

Pricing

from $0.20 / 1,000 row writtens

Rating

0.0

(0)

Developer

WrenTools

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

Developer tools

Integrations

You can access the Merge & Dedup Datasets, CSV, JSON & Excel Files programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "fileUrls": [
12        "https://api.apify.com/v2/key-value-stores/uM2zEXblvgf0s1cES/records/leads-crm.csv",
13        "https://api.apify.com/v2/key-value-stores/uM2zEXblvgf0s1cES/records/leads-signups.jsonl"
14    ],
15    "dedupFields": [
16        "email"
17    ],
18    "keep": "mostComplete",
19    "addSourceField": "_source"
20};
21
22// Run the Actor and wait for it to finish
23const run = await client.actor("wrentools/dataset-merge-dedup").call(input);
24
25// Fetch and print Actor results from the run's dataset (if any)
26console.log('Results from dataset');
27console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
28const { items } = await client.dataset(run.defaultDatasetId).listItems();
29items.forEach((item) => {
30    console.dir(item);
31});
32
33// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Merge & Deduplicate Datasets, CSV, JSON and Excel API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Merge & Dedup Datasets, CSV, JSON & Excel Files API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Merge & Dedup Datasets, CSV, JSON & Excel Files API in Python

Merge & Dedup Datasets, CSV, JSON & Excel Files API through CLI

Merge & Dedup Datasets, CSV, JSON & Excel Files OpenAPI definition

Merge & Dedup Datasets, CSV, JSON & Excel Files API

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

5.3K

5.0

(2)

Merge, Filter, Deduplicate & Transform Datasets — CSV, Excel

tidydata/merge-dedupe-datasets

Filter, merge and deduplicate Apify datasets, CSV, Excel, JSON and Google Sheets: keep only rows matching your conditions, remove or merge duplicates (smart URL/email/phone matching), sort, add computed columns, split lists into rows, keep only new rows and export CSV, Excel or JSON.

tidydata

Dataset Merge & Dedup Datasets — Filter, Join CSV & Excel

saliga/dataset-merge-dedupe

Merge Apify datasets, CSV, JSON and Excel files or Google Sheets into one table. Clean fields, normalise URLs, extract domains, filter, remove duplicates and join (VLOOKUP) in one run. Works with limited permissions. CSV and Excel exports free. $0.50 per 1,000 output rows.

Salih Küçükkayış

Dataset Deduplicator

automation-lab/dataset-dedup

Merge and deduplicate Apify datasets by any field combination. Remove duplicates, keep first or last occurrence. Case-insensitive matching, whitespace trimming. Pay per 1K items processed.

Automation Lab

5.0

(1)

Fast Dataset Cleaner & CSV Formatter

motivational_nickel/dataset-cleaner-and-formatter

Fast dataset cleaning for CSV and JSON files. Automatically removes duplicates, trims whitespace, fixes capitalization, and normalizes fields. Works with Apify datasets or uploaded files and prepares data for analytics, CRM imports, and automation pipelines.

Leoncio Coronado Jr

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

DataCach

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

ParseBird

Dataset Cleaner & Exporter

nerolabs/dataset-cleaner-exporter

Returns a deduplicated, flattened and cleaned copy of any Apify dataset, file or Google Sheet by URL, or JSON array, plus CSV and Excel files, named-dataset append and webhook delivery. Inputs: source, dedup keys, flatten, cleaning options. Agent-ready: pay per event (x402, MCP), per cleaned record.

Adam Pearce

Dataset Query Engine

jiri.spilka/dataset-query-engine

Use natural language queries to retrieve results from an Apify dataset. This Actor provides a query engine that loads a dataset, executes SQL queries, and synthesizes results.

Jiří Spilka

4.6

(5)

LLM Dataset Processor

dusan.vystrcil/llm-dataset-processor

Allows you to process output of other actors or stored dataset with single LLM prompt. It's useful if you need to enrich data, summarize content, extract specific information, or manipulate data in a structured way using AI.