Pricing

from $1.00 / 1,000 record examineds

Dataset Deduper | Exact & Fuzzy Dedupe for Any Dataset

Collapse duplicates in any dataset, in two passes you control. Exact matching ignores case, punctuation, and word order; an optional fuzzy pass catches the near-duplicates normalization cannot. Every decision is explained in an audit trail, and a cross-run ledger remembers what you already got.

Pricing

from $1.00 / 1,000 record examineds

Rating

0.0

(0)

Developer

Brandon Mensing

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Configure MCP server with Dataset Deduper: Exact and Fuzzy Duplicate Removal

The configuration above connects to the hosted Apify MCP server with the Dataset Deduper: Exact and Fuzzy Duplicate Removal Actor already loaded. It uses OAuth, so your client opens a browser window to sign you in to Apify on first use. No API token is needed. Clients without OAuth support can authenticate with an Authorization: Bearer header carrying an API token from API & Integrations in Apify Console.

Get a ready-to-use configuration for your MCP client with the Dataset Deduper: Exact and Fuzzy Duplicate Removal Actor preconfigured at https://mcp.apify.com/?tools=fetch-actor-details,broomwagon/dataset-deduper.

You can connect to the Apify MCP Server using clients like Tester MCP Client, or any other MCP client of your choice.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

Fuzzy Search Dataset Actor

dtrungtin/fuzzy-search-dataset-actor

Search any Apify dataset using typo-tolerant fuzzy matching.

Tin

Only New Items | Cross-Run Dedupe Ledger for Any Dataset

broomwagon/only-new-items

Run your scraper on a schedule and get back only what you have never seen before. Name the field that identifies an item, pipe any dataset in, and this actor holds back everything already delivered. Records pass through untouched. The ledger is yours, not a database you rent.

Brandon Mensing

Google Maps Scraper Deduper | Merge Duplicates | Cross-Run

broomwagon/google-maps-deduper

Merge duplicate places from Google Maps scraper runs — by placeId, phone, or fuzzy name+address — including duplicates from previous runs. Only get what's new, cut enrichment costs, and keep a full audit trail. Stateless: you hold the memory, we store nothing.

Brandon Mensing

Dataset Deduplicator & Cleaner

eszetael_lab/dataset-deduplicator-cleaner

Returns your records with duplicates removed and values normalized — same fields as the input, nothing added or renamed. Exact, normalized or fuzzy matching on keys you choose. A data quality report lands under QUALITY_REPORT. Takes a dataset ID or inline JSON, so it chains after any scraper.

Radosław Szal

🧽 Dataset Deduplicator - Clean Any Scraped Dataset

that_red_bird/dataset-deduplicator

🧽 Upload any dataset — scraped rows, a RAG corpus, an export — and get back exact AND near-duplicates removed, plus a per-field data quality report. ✅ MinHash + LSH banding finds near-duplicate text at scale without O(n²) pairwise comparison.

mohamed alaya

Dataset Audit — what you actually paid for

ledgerworks/dataset-audit

Audit any Actor run: duplicates, unmet criteria, and the real cost per usable record. Live Excel receipt included.

Alessandro Bonzio

Dataset Toolkit — Dedupe, Merge, Clean, Diff

glueworks/dataset-toolkit

Post-process any Apify dataset: remove duplicates, merge multiple datasets, clean and normalize fields, or diff two crawls. Outputs a new dataset plus a summary record.

KAHA Chen

Dataset Download

idiatech/apify-Dataset-Download

Download any dataset from the Apify platform automatically and in any format you want. Use this actor along with a Dataset toolbox automation tool.

idIA Tech

Colombia Open Data Scraper

parseforge/colombia-datos-gov-co-scraper

Scrapes any public dataset from datos.gov.co by its resource ID. Returns every matching row as a flat record with optional exact-match field filters and custom sort order.

ParseForge

AI Dataset Search

dtrungtin/ai-dataset-search

The actor lets you query any dataset using **plain English** instead of code. Point it at a dataset — for example the output of a scraper run — describe what you're looking for ("videos about race day at the Belgian Grand Prix", "items with more than 100k plays"), and it returns the matching items.

Tin