Dataset Deduplicate & Merge (Fuzzy)

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel

tidydata/merge-dedupe-datasets

Merge datasets and remove duplicates in one call: combine Apify datasets, CSV, Excel, JSON or Google Sheets, dedupe by any field (smart URL/email/phone matching), filter, sort, keep only new rows, export CSV/Excel/JSON. Works from AI agents via Apify MCP (Claude, ChatGPT), n8n and the API.

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

Monitoring Checker Duplication

apify/monitoring-checker-duplication

The Monitoring checker duplication is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Merge, Dedup & Transform Datasets – Filter, CSV, Excel

gazidev/dataset-filter-transform

No-code filter, merge and dedupe for Apify datasets, CSV, XLSX and JSON files: combine several datasets, remove duplicates by fields, filter rules (equals, contains, regex, ranges, dates, AND/OR), only-new-since-last-run, rename/select/drop, flatten, sort. Export CSV/XLSX/JSON. Pay per row.

Remove Duplicates & Merge Datasets: Dedup, Only New

brasspage/dataset-dedup-merge

Dedup and merge Apify datasets: removes duplicate items by any fields, or by the whole item, and returns the unique items (or only the duplicates) with their original fields. Can skip items seen in earlier runs, for daily new results. Works with limited permissions. $0.02 per 1,000 items.

**AI Dataset Search**

dtrungtin/ai-dataset-search

The actor lets you query any dataset using **plain English** instead of code. Point it at a dataset — for example the output of a scraper run — describe what you're looking for ("videos about race day at the Belgian Grand Prix", "items with more than 100k plays"), and it returns the matching items.

Remove duplicate rows from an Apify Dataset or inline JSON. Deduplicate by selected fields, trim strings, and write the cleaned rows to a new Dataset.

Dataset Transformer — Filter, Dedupe, Sort & Reshape Data

nexgensignal/dataset-transformer-api

Transform Apify datasets or JSON / CSV links: filter rows, remove duplicates, sort, flatten nested fields, unwind lists, pick and rename columns. Merge several datasets into one clean result for export as JSON, CSV or Excel. Part of NexGen Signal — data tools and official-source data products

Dataset Cleaner & Deduplicator | JSON Data QA

egeusta/dataset-quality-deduplication-engine

Clean JSON records and Apify datasets with exact and bounded fuzzy deduplication. Normalize text and URLs, detect missing fields and email-format issues, and export cleaned records, duplicates and a quality summary.

Dataset Deduper | Exact & Fuzzy Dedupe for Any Dataset

broomwagon/dataset-deduper

Collapse duplicates in any dataset, in two passes you control. Exact matching ignores case, punctuation, and word order; an optional fuzzy pass catches the near-duplicates normalization cannot. Every decision is explained in an audit trail, and a cross-run ledger remembers what you already got.