Merge & Deduplicate Datasets - Only New Items, Join, CSV/XLSX

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Dataset Join & Merge (VLOOKUP for Datasets)

nerolabs/dataset-join-merge

Returns two Apify datasets, files or Google Sheets by URL, or JSON arrays joined on key fields like SQL or VLOOKUP: left, inner, right, full and anti joins plus union, with CSV/Excel export, named-dataset append and webhook delivery. Agent-ready: pay per event (x402, MCP), per output row.

Merge & Deduplicate Datasets - Reliable, Any Size

geese_chief/dataset-merge-dedup

Merge any number of Apify datasets into one and remove duplicates by the fields you choose (url, id, email...). Keep unique items or only the duplicates, pick output fields, tag each item with its source. Streams data, so millions of items work. Pick datasets from your storage: no permission errors.

Merge Datasets & Remove Duplicates: Combine Runs, CSVs, Sheets

nerolabs/dataset-merge-dedupe

Returns one de-duplicated list from many Apify datasets, CSV, Excel or JSON files and Google Sheets, with blanks filled from the copies and each row's source labelled. Inputs: datasetIds, fileUrls, dedupKeys. Charged per merged row written ($0.001). Agent-ready via x402 and MCP.

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.

Merge Apify datasets, JSON and CSV files, then remove duplicate rows by the fields you choose.

Merge and deduplicate Apify datasets and CSV, JSON, Excel or Parquet files in one run. Remove duplicates (exact, normalized or fuzzy), output only new items since your last run, filter, sort, rename, then export to CSV, Excel, JSON or Parquet. $0.002 per 1,000 rows.

Line Deduplicator, Sorter & Shuffler

hipersoft/line-dedup-sort

Clean big text and list files: remove duplicate lines, sort alphabetically or numerically, reverse, shuffle and trim blanks — handles lists too large for a desktop editor.

Dataset Filter, Merge & Dedup – Clean & Export CSV, Excel, JSON

gazidev/dataset-filter-transform

No-code filter, merge and dedupe for Apify datasets, CSV, XLSX and JSON files: combine several datasets, remove duplicates by fields, filter rules (equals, contains, regex, ranges, dates, AND/OR), only-new-since-last-run, rename/select/drop, flatten, sort. Export CSV/XLSX/JSON. Pay per row.