Pricing

from $0.15 / 1,000 row delivereds

Try for free

Go to Apify Store

Dataset Dedup and Merge API: Remove Duplicate Rows

Try for free

Merge several runs into one clean dataset and pay only for the unique rows delivered. Choose the key columns, normalise case, spaces and URLs, keep the most complete row and get a duplicate report. Works inside your own Apify account.

Pricing

from $0.15 / 1,000 row delivereds

Rating

0.0

(0)

Developer

Rowcraft

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Changelog

1.0.5 (2026-11-03)

Dataset schema: every optional field accepts an empty value, so a record with an empty optional field (for example no postal code) no longer stops the run.

1.0.4 (2026-10-29)

README: Python and JavaScript examples with the official apify-client; example list updated.

1.0.3 (2026-10-26)

README: form screenshot with the prefilled example; keyFields prefilled with id.

1.0.2 (2026-10-26)

Prefilled input: two public sample datasets of the Rowcraft account, so the Store example runs without setup. Dataset IDs are a plain list now (the resource picker does not allow a prefilled example).

1.0.1 (2026-10-26)

README: real Console screenshots and three public examples; first public release.

1.0.0 (2026-10-26)

First release: merge 1 to 20 datasets of your own account, remove duplicates by key fields (dotted paths) or by the whole row, normalise before comparing, keep the first, last or most complete copy, fill empty fields from the duplicates, source columns, columns to keep or drop, duplicate report, dry run, Only new rows and notification.

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

5.5K

5.0

(2)

Merge, Dedup & Transform Datasets - Limited permissions

lukaskrivka/dedup-datasets-limited-permissions

Limited permission version of the popular Actor. The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

627

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel

tidydata/merge-dedupe-datasets

Merge datasets and remove duplicates in one call: combine Apify datasets, CSV, Excel, JSON or Google Sheets, dedupe by any field (smart URL/email/phone matching), filter, sort, keep only new rows, export CSV/Excel/JSON. Works from AI agents via Apify MCP (Claude, ChatGPT), n8n and the API.

tidydata

Dataset Deduplicator

automation-lab/dataset-dedup

Merge and deduplicate Apify datasets by any field combination. Remove duplicates, keep first or last occurrence. Case-insensitive matching, whitespace trimming. Pay per 1K items processed.

Automation Lab

Azure dataset uploader

mvolfik/azure-dataset-uploader

The easiest way to upload datasets to Azure blob storage.

Matěj Volf

Merge & Dedup Datasets: Remove Duplicates, Only New Items

charlesmarkette/merge-deduplicate-datasets-only-new-items

Merge any number of Apify datasets and remove duplicates by the fields you choose (or the whole item). Keep the first or last copy, or output only items not seen in earlier runs: ideal after a scheduled scraper. Streams millions of items. Duplicates are free; $0.0019 per 1,000 items output.

Charles Markette

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

DataCach

Fast Dataset Cleaner & CSV Formatter

motivational_nickel/dataset-cleaner-and-formatter

Fast dataset cleaning for CSV and JSON files. Automatically removes duplicates, trims whitespace, fixes capitalization, and normalizes fields. Works with Apify datasets or uploaded files and prepares data for analytics, CRM imports, and automation pipelines.

Leoncio Coronado Jr

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

ParseBird

Google Dataset Items Translator

web.harvester/google-dataset-items-translator

Translate any dataset field(s) to any of the supported languages using the Google Translate website, it goes through all the items in the dataset and translates all of the selected fields