Dataset Deduplicator & Cleaner

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

Dataset Deduplicator & Cleaner

eszetael_lab/dataset-deduplicator-cleaner

Returns your records with duplicates removed and values normalized — same fields as the input, nothing added or renamed. Exact, normalized or fuzzy matching on keys you choose. A data quality report lands under QUALITY_REPORT. Takes a dataset ID or inline JSON, so it chains after any scraper.

XMLs To Dataset

mtrunkat/xmls-to-dataset

Go to actor anytime you need to download XML files and store them in the dataset.

US address cleaner

saswave/us-address-cleaner

Normalize US address. From an address , extract city, state and zipcode. Handles non standard list of physical addresses. Uses advanced NLP (Natural Language Processing) methods.

Airtable (apify/airtable)

apify/airtable-apify-airtable

Imports any Apify dataset into Airtable with append, override, or create modes. Supports custom field mapping, automatic column creation, duplicate detection, batching, retries, and OAuth. Works standalone or as an Actor-to-Actor integration.

Dataset Cleaner & LLM Processor: Filter, Dedupe, AI per Row

automa-flow/dataset-filter-transform

Clean, filter and dedupe Apify Dataset rows, then run an AI prompt on each row with no API key of your own. $1 per 1,000 rows kept, plus $1 per 1,000 AI rows, plus model usage on your Apify account.

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel

tidydata/merge-dedupe-datasets

Merge datasets and remove duplicates in one call: combine Apify datasets, CSV, Excel, JSON or Google Sheets, dedupe by any field (smart URL/email/phone matching), filter, sort, keep only new rows, export CSV/Excel/JSON. Works from AI agents via Apify MCP (Claude, ChatGPT), n8n and the API.

Merge Apify datasets, CSV, JSON, JSONL or Excel files and pasted rows into one clean dataset: remove duplicates by any fields (case and whitespace normalised), keep only items new since your last run, left/inner join on a key, flatten nested JSON. $0.05 per 1,000 rows out.

CSV Cleaner & Deduplication Tool

taroyamada/csv-data-cleaner

Clean CSV data. No API key / no login. Open Input → leave defaults → Start (3 CSV rows cleaned ≈ USD 0.01/run): https://console.apify.com/actors/Rrl9isk1pUMDbShKc/input From USD 0.