Dataset Deduplication & Merge Planner

Review Dataset Auditor

agentworkflowlab/review-dataset-auditor

Audit review Datasets for completeness, malformed fields, duplicate IDs, and duplicate content.

Dataset Deduplicator

zentrafoundry/dataset-deduplicator

Deduplicate Apify datasets and create stable merge keys.

Dataset Toolkit — Dedupe, Merge, Clean, Diff

glueworks/dataset-toolkit

Post-process any Apify dataset: remove duplicates, merge multiple datasets, clean and normalize fields, or diff two crawls. Outputs a new dataset plus a summary record.

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

Duplicate Content Similarity Finder

junipr/duplicate-content-similarity-finder

Compare pages for duplicate and near-duplicate main content using normalized shingles and canonical signals.

Google Maps Lead Quality & Duplicate Audit

8tp/google-maps-lead-quality-audit

Turn supplied Google Maps place and business-leads datasets into CRM-readiness, email-evidence, closed-business, and duplicate reports. Support current Compass enrichment fields; preserve only transparent source signals and never scrape, verify mailboxes, merge records, or invent a universal score.

Merge up to 100 RSS, Atom, or RDF feeds into one JSON/CSV dataset with keyword filters, tracking-parameter cleanup, smart cross-feed deduplication, and duplicate-source provenance.

Semantic List Deduplicator

westerly_palisade/list-deduplicate-by-dravara

Paste 2 to 100 list items to merge meaning-equivalent entries without rewriting the originals. Get the unique list, duplicate groups, reasons, and confidence as bounded JSON.

Brand Signal Dataset Merge and Conflict Report

zinin/us-brand-signal-merge-report

Compare two buyer-supplied signal sets in one deterministic union report. Preserve left-only, right-only, exact duplicate, and field-conflict evidence without selecting a winner or fetching recorded source URLs.

Google Maps Scraper Deduper | Merge Duplicates | Cross-Run

broomwagon/google-maps-deduper

Merge duplicate places from Google Maps scraper runs — by placeId, phone, or fuzzy name+address — including duplicates from previous runs. Only get what's new, cut enrichment costs, and keep a full audit trail. Stateless: you hold the memory, we store nothing.