Pricing

from $0.30 / 1,000 item cleaneds

Dataset Cleaner & Deduplicator

Clean, normalize and deduplicate any dataset: field names, whitespace, empty values, numbers, plus exact and fuzzy duplicate removal.

Pricing

from $0.30 / 1,000 item cleaneds

Rating

0.0

(0)

Developer

Steve

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Categories

Other

Automation

Dataset ID to clean

inputDatasetId

Optional

ID of a dataset produced by any other Actor. Leave empty if you paste data below.

Type:string

Example:

aBcDeFgHiJkLmNoPq

Or paste your data (JSON)

items

Optional

Array of JSON objects. Only used when no Dataset ID is provided.

Type:array

Normalize field names

normalizeFieldNames

Optional

Turns 'First Name', 'firstName' and 'FIRST_NAME' into a single 'first_name' key.

Type:boolean

Default:true

Trim whitespace

trimWhitespace

Optional

Removes leading and trailing spaces, collapses repeated spaces.

Type:boolean

Default:true

Unify empty values

normalizeEmptyValues

Optional

Converts 'N/A', 'null', '-' and 'unknown' into real null values.

Type:boolean

Default:true

Lowercase emails

lowercaseEmails

Optional

Converts all email fields to lowercase so 'John@X.com' and 'john@x.com' are treated as one address.

Type:boolean

Default:true

Normalize phone numbers

normalizePhones

Optional

Strips spaces, dots and dashes while keeping the international prefix.

Type:boolean

Default:true

Convert text to numbers

coerceNumbers

Optional

Turns '1 234,56' and '1,234.56' into real numeric values. Handles both European and US formats.

Type:boolean

Default:false

Drop empty fields

dropEmptyFields

Optional

Shrinks output size by removing keys with no value.

Type:boolean

Default:false

Required fields

requiredFields

Optional

Any row missing one of these fields is discarded.

Type:array

Default:

[]

Deduplication mode

dedupeMode

Optional

Exact compares values literally. Fuzzy catches near-duplicates like 'Société Dupont' and 'SOCIETE DUPONT', whatever the accents or casing.

Type:string

Default:exact

Options:

noneexactfuzzy

Fields to compare (exact mode)

dedupeFields

Optional

Leave empty to compare the entire row.

Type:array

Default:

[]

Field to compare (fuzzy mode)

fuzzyField

Optional

Name of the field to match on, for example 'company_name'.

Type:string

Similarity threshold

fuzzyThreshold

Optional

50 to 100. Above 95 is strict, below 80 becomes aggressive. 90 is a safe default; use 80 to also merge legal suffixes like SARL, Ltd or Inc.

Type:integer

Minimum:50

Maximum:100

Default:90

Data Cleaner & Normalizer (JSON/CSV)

zenomastro/data-cleaner-normalizer

Clean and normalize JSON/CSV data: trim whitespace, lowercase emails, normalize phone numbers and dates, drop empty values/rows, and deduplicate by a field.

Rosario Vitale

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.

Rodrigo Dias

Dataset Cleaner & Exporter

nerolabs/dataset-cleaner-exporter

Deduplicate, flatten, clean and export any Apify dataset (or your own JSON) into a ready-to-use CSV and Excel file.

Adam Pearce

Dataset Deduplicator

zentrafoundry/dataset-deduplicator

Deduplicate Apify datasets and create stable merge keys.

Zentra

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

ParseBird

Dataset Deduplicator

automation-lab/dataset-dedup

Merge and deduplicate Apify datasets by any field combination. Remove duplicates, keep first or last occurrence. Case-insensitive matching, whitespace trimming. Pay per 1K items processed.

Stas Persiianenko

Fuzzy Search Dataset Actor

dtrungtin/fuzzy-search-dataset-actor

Search any Apify dataset using typo-tolerant fuzzy matching.

Tin

Dataset Deduplicator & Cleaner

eszetael_lab/dataset-deduplicator-cleaner

Returns your records with duplicates removed and values normalized — same fields as the input, nothing added or renamed. Exact, normalized or fuzzy matching on keys you choose. A data quality report lands under QUALITY_REPORT. Takes a dataset ID or inline JSON, so it chains after any scraper.

Radosław Szal

CSV Deduper Normalizer

junipr/csv-deduper-normalizer

Deduplicate and normalize CSV-style rows. Clean whitespace, casing, domains, URLs, and emails, then output kept and duplicate rows plus clean CSV/JSON files.

junipr

🧽 Dataset Deduplicator - Clean Any Scraped Dataset

that_red_bird/dataset-deduplicator

🧽 Upload any dataset — scraped rows, a RAG corpus, an export — and get back exact AND near-duplicates removed, plus a per-field data quality report. ✅ MinHash + LSH banding finds near-duplicate text at scale without O(n²) pairwise comparison.