Apify Smart Dataset Comparator

Pricing

Pay per event

Apify Smart Dataset Comparator

Compare 2-10 Apify datasets to detect changes, new/removed records, and duplicates. Features field-level diffs, smart merging, schema validation, data cleaning, and anomaly detection. Perfect for price monitoring, lead deduplication, and data quality tracking.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Agenscrape

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

Dataset IDs

datasetIdsarrayOptional

List of Apify Dataset IDs to compare (2-10 datasets). Order matters - first is baseline, subsequent are compared against it.

Dataset URLs

datasetUrlsarrayOptional

URLs to JSON or CSV files (alternative to Dataset IDs)

Primary Key

primaryKeystringOptional

Field(s) to uniquely identify records. Use dot notation for nested fields (e.g., 'product.id'). For composite keys, use comma-separated values: 'url,sku'

Default value of this property is "id"

Ignore Fields

ignoreFieldsarrayOptional

Fields to ignore when comparing records (e.g., timestamps, internal IDs)

Default value of this property is []

Comparison Preset

presetEnumOptional

Pre-configured settings for common use cases

Value options:

"none": string"price_monitoring": string"lead_lists": string"seo": string"real_estate": string

Default value of this property is "none"

Comparison Sensitivity

sensitivityEnumOptional

How strict should the comparison be?

Value options:

"strict": string"medium": string"relaxed": string

Default value of this property is "strict"

Numeric Tolerance (%)

numericToleranceintegerOptional

Ignore numeric changes smaller than this percentage (e.g., 1 = ignore changes <= 1%)

Default value of this property is 0

Case Sensitive

caseSensitivebooleanOptional

Should string comparisons be case-sensitive?

Default value of this property is true

Data Cleaning Rules

cleaningRulesobjectOptional

Rules to normalize data before comparison

Default value of this property is {}

Detect Duplicates

detectDuplicatesbooleanOptional

Find duplicate records within each dataset

Default value of this property is false

Fuzzy Duplicate Matching

fuzzyMatchingbooleanOptional

Use fuzzy matching to find near-duplicates (Levenshtein distance)

Default value of this property is false

Fuzzy Match Threshold

fuzzyThresholdnumberOptional

Similarity threshold for fuzzy matching (0-1, where 1 = exact match)

Default value of this property is 0.85

Duplicate Detection Fields

duplicateFieldsarrayOptional

Additional fields to check for near-match duplicates

Default value of this property is []

Merge Strategy

mergeStrategyEnumOptional

How to merge records when they exist in multiple datasets

Value options:

"left_priority": string"right_priority": string"most_recent": string"most_complete": string"combine_arrays": string"average_numbers": string

Default value of this property is "left_priority"

Timestamp Field

timestampFieldstringOptional

Field name containing record timestamp (for 'most_recent' merge strategy)

Default value of this property is "timestamp"

Field-Level Priorities

fieldPrioritiesobjectOptional

Custom merge priorities per field: left, right, max, min, average, longest, combine

Default value of this property is {}

Validate Schema

validateSchemabooleanOptional

Compare schemas across datasets and detect inconsistencies

Default value of this property is false

Strict Schema Validation

strictSchemaValidationbooleanOptional

Report all type mismatches and unexpected fields as errors

Default value of this property is false

Output to Separate Datasets

outputSeparateDatasetsbooleanOptional

Save results to named datasets (changes, new_records, removed_records, merged_final, duplicates, stats)

Default value of this property is true

Webhook URL

webhookUrlstringOptional

URL to receive notification when comparison completes

Validate Dataset(s) with JSON Schema

jaroslavhejlek/validate-dataset-with-json-schema

This Actor validates items in one or more datasets against a provided JSON Schema. Use it if you planning to add a dataset validation schema to your actor and you want test it.

Jaroslav Hejlek

Monitoring Checker Schema

apify/monitoring-checker-schema

The monitoring checker schema is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

4.8

Diff Dataset Fields

lukaskrivka/diff-dataset-fields

Compare changes in text fields between two datasets. Monitor new and updated content on websites.

Lukáš Křivka

Dataset Schema Super Actor

zuzka/dataset-schema-super-actor

Create your Actor dataset schema with one click.

Zuzka Pelechová

Smart Apify Actor Scraper (+70 Fields + Actor Quality Metrics)

parseforge/smart-apify-actor-scraper

Scrape actor information from Apify store including stats, pricing, quality scores, and feedback. Only tool with actor quality scores, percentiles & user feedback. Save 90% on research costs. The most comprehensive Apify actor intelligence available with retries & deduplication.

ParseForge

5.0

eBay Smart Shopper

dhhoang.dn2/ebay-smart-shopper

Advanced eBay data collector with smart price analysis and deal scoring. Features: ✨ Smart Search & deal scoring 📊 Price comparison ⭐ Seller evaluation 🎯 Best deals finder 🔒 Memory-optimized Perfect for price monitoring and finding the best deals on eBay.

Đinh Huy Hoàng

5.0

Dataset Quality Scorer

fiery_dream/dataset-quality-scorer

Score ML datasets for quality (completeness, consistency, duplicates, balance). Detect data drift, outliers, and recommend improvements.

Cody Churchwell

Dataset(s) To Schema

zuzka/dataset-to-schema

Takes a Dataset ID(s) and outputs a JSON schema of the contents of the dataset into key value store.

Zuzka Pelechová

5.0

GMGN Smart Degen Monitor Scraper

muhammetakkurtt/gmgn-smart-degen-monitor-scraper

GMGN Smart Degen Monitor tracks crypto "smart money" across BSC, Solana, and Base networks. Extract real-time data on tokens and trades from influential investors to identify market trends. Get key metrics including price changes, transaction data, and wallet tracking with customizable timeframes.

Muhammet Akkurt

5.0

Actor 2 Dataset Cleaner and Formatter

motivational_nickel/dataset-cleaner-and-formatter

Automatically cleans and formats datasets by trimming whitespace, fixing capitalization, and removing duplicates. Supports both Apify datasets and uploaded JSON/CSV files.

Leoncio Jr Coronado

Apify Smart Dataset Comparator

Apify Smart Dataset Comparator

Dataset IDs

Dataset URLs

Primary Key

Ignore Fields

Comparison Preset

Value options:

Comparison Sensitivity

Value options:

Numeric Tolerance (%)

Case Sensitive

Data Cleaning Rules

Detect Duplicates

Fuzzy Duplicate Matching

Fuzzy Match Threshold

Duplicate Detection Fields

Merge Strategy

Value options:

Timestamp Field

Field-Level Priorities

Validate Schema

Strict Schema Validation

Output to Separate Datasets

Webhook URL

You might also like

Validate Dataset(s) with JSON Schema

Monitoring Checker Schema

Diff Dataset Fields

Dataset Schema Super Actor

Smart Apify Actor Scraper (+70 Fields + Actor Quality Metrics)

eBay Smart Shopper

Dataset Quality Scorer

Dataset(s) To Schema

GMGN Smart Degen Monitor Scraper

Actor 2 Dataset Cleaner and Formatter

Dataset IDs

Dataset URLs

Primary Key

Ignore Fields

Comparison Preset

Value options:

Comparison Sensitivity

Value options:

Numeric Tolerance (%)

Case Sensitive

Data Cleaning Rules

Detect Duplicates

Fuzzy Duplicate Matching

Fuzzy Match Threshold

Duplicate Detection Fields

Merge Strategy

Value options:

Timestamp Field

Field-Level Priorities

Validate Schema

Strict Schema Validation

Output to Separate Datasets

Webhook URL