Dataset Diff, Dedupe & Merge - Change Detection

Merge, Dedup & Transform Datasets - Limited permissions

lukaskrivka/dedup-datasets-limited-permissions

Limited permission version of the popular Actor. The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Dataset Deduplicator

automation-lab/dataset-dedup

Merge and deduplicate Apify datasets by any field combination. Remove duplicates, keep first or last occurrence. Case-insensitive matching, whitespace trimming. Pay per 1K items processed.

Compare changes in text fields between two datasets. Monitor new and updated content on websites.

Diff Datasets

pocesar/diff-datasets

Take one dataset on Apify platform, compare it to another, and output the missing ones. This can also be used to output only changed items, using a compound key

Compare 2-10 Apify datasets to detect changes, new/removed records, and duplicates. Features field-level diffs, smart merging, schema validation, data cleaning, and anomaly detection. Perfect for price monitoring, lead deduplication, and data quality tracking.

Webpage Diff Checker

maximedupre/webpage-diff-checker

Check public webpages against saved baselines. Find text, HTML, SEO metadata, semantic data, and link changes, with clear details for each change.

Dataset Change Monitor

egra_van/dataset-change-monitor

Compare every scraper run with the previous one and get only new, changed and removed items, with field-level before/after diffs. Alerts via Telegram, Slack, webhook or email. Works with any Apify Actor, dataset, JSON or CSV.

CSV Deduper Normalizer

junipr/csv-deduper-normalizer

Deduplicate and normalize CSV-style rows. Clean whitespace, casing, domains, URLs, and emails, then output kept and duplicate rows plus clean CSV/JSON files.

Fuzzy Dedupe: Find Near-Duplicate Rows in Datasets

ucchiii/dataset-fuzzy-dedupe

Find near-duplicates that exact dedup misses: 'Acme Inc.' vs 'ACME, Inc', 'Main St.' vs 'Main Street'. Fuzzy match names, addresses, phones, URLs across Apify datasets; mark or merge clusters with reasons. Empty input = free demo. $0.50 per 1,000 rows.

Merge Apify datasets and remove or merge duplicates (with normalized URLs, phones, domains), keep only items new since earlier runs using persistent memory, or compare two datasets or CSV files and get field-level differences. Limited permissions.