Pricing

$54.00 / 1,000 processed-rows

Go to Apify Store

Dataset Deduplicator

Try for free

Deduplicate Apify datasets and create stable merge keys.

Pricing

$54.00 / 1,000 processed-rows

Rating

0.0

(0)

Developer

Zentra

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Developer tools

Automation

Lead generation

Apify Actor Record query

buyerQuery

Optional

Buyer-safe query or scope for the records returned by this product.

Type:string

Default:buyer-ready records with source evidence

Apify Actor Record task intent

taskIntent

Optional

Stable product-specific purpose for this saved Apify task.

Type:string

Default:buyer-ready-product-run

Run sample or approved live sources

sourceMode

Required

Sample emits public-safe Apify Actor Record rows. Approved live source mode keeps the same output fields and only uses owner-approved public URLs.

Type:string

Default:sample

Options:

samplestartUrls

Apify Actor Record output mode

outputMode

Optional

Use sample records for Apify Store QA or buyer-ready records for approved Apify Actor Record delivery.

Type:string

Default:sample-records

Options:

sample-recordsbuyer-ready-records

Approved Apify Actor Record source URLs

startUrls

Optional

Public URLs to use for live Apify Actor Record extraction after source-policy approval. Leave empty for sample mode.

Type:object[]

Default:

[]

Maximum Apify Actor Record rows

maxItems

Optional

Caps the number of Apify Actor Record rows written to the dataset.

Type:integer

Minimum:1

Maximum:1000

Default:1

Maximum rows per source

perSourceLimit

Optional

Caps validated rows from any one source before cross-source deduplication.

Type:integer

Minimum:1

Maximum:100

Default:25

Maximum total charge (USD)

maxTotalChargeUsd

Optional

Buyer-selected spend ceiling; the Apify run-level maximum remains authoritative.

Type:number

Minimum:0.01

Maximum:1000

Default:5

Overall timeout seconds

overallTimeoutSecs

Optional

Stops additional source work once the bounded run deadline is reached.

Type:integer

Minimum:30

Maximum:3600

Default:900

Source request timeout seconds

requestTimeoutSecs

Optional

Timeout applied independently to each approved source request.

Type:integer

Minimum:5

Maximum:120

Default:30

Maximum source retries

maxRequestRetries

Optional

Bounded retry count for transient source failures.

Type:integer

Minimum:0

Maximum:5

Default:2

Only emit new logical records

sinceLastRun

Optional

Uses stable Actor state to skip logical records delivered by earlier runs.

Type:boolean

Default:false

Delta mode

deltaMode

Optional

Preserves stable deduplication keys for recurring tasks and schedules.

Type:boolean

Default:true

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

DataCach

Lead List Deduplicator & Merger

jurassic_jove/lead-deduplicator-merger

Merge and deduplicate lead lists from multiple Apify datasets, CSV files and inline JSON into one clean, outreach-ready list. Pure data processor — no scraping, no proxies, no external APIs.

Data Runner

Dataset Deduplicator

automation-lab/dataset-dedup

Merge and deduplicate Apify datasets by any field combination. Remove duplicates, keep first or last occurrence. Case-insensitive matching, whitespace trimming. Pay per 1K items processed.

Stas Persiianenko

Data Deduplicator

parsebird/dataset-deduplicator

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

ParseBird

JSON Dataset Cleaner and Deduplicator

rodrgds/dataset-cleaner

Clean JSON datasets, remove empty rows, deduplicate by any field, validate emails, and prepare scraper output for CRMs, analysis, or AI workflows.

Rodrigo Dias

Dataset Deduplicator v2

zentrafoundry/dataset-deduplicator-v2

Transform dataset deduplicator v2 inputs into structured rows, clear errors, confidence signals, and automation-ready output.

Zentra

Dataset Cleaner Visual Dedup Merge Export

leadsbrary/dataset-cleaner-visual-dedup-merge-export

Clean any Apify dataset visually: dedupe, filter, merge, rename/reorder columns, then export a new dataset, CSV, or XLSX. No code. Everything happens in a spreadsheet-style web UI.

Alexandre Manguis

RSS Feed Merger & Smart Deduplicator

bene123/rss-feed-merger-deduplicator

Merge up to 100 RSS, Atom, or RDF feeds into one JSON/CSV dataset with keyword filters, tracking-parameter cleanup, smart cross-feed deduplication, and duplicate-source provenance.