Pricing

from $0.20 / 1,000 row in the results

Try for free

Go to Apify Store

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel

Try for free

Merge datasets and remove duplicates in one call: combine Apify datasets, CSV, Excel, JSON or Google Sheets, dedupe by any field (smart URL/email/phone matching), filter, sort, keep only new rows, export CSV/Excel/JSON. Works from AI agents via Apify MCP (Claude, ChatGPT), n8n and the API.

Pricing

from $0.20 / 1,000 row in the results

Rating

0.0

(0)

Developer

tidydata

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

Developer tools

Automation

You can access the Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {}
9
10# Run the Actor and wait for it to finish
11run = client.actor("tidydata/merge-dedupe-datasets").call(run_input=run_input)
12
13# Fetch and print Actor results from the run's dataset (if there are any)
14print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
15for item in client.dataset(run.default_dataset_id).iterate_items():
16    print(item)
17
18# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Merge, Filter & Deduplicate Datasets – Transform, CSV, Excel API in Python

The Apify API client for Python is the official library that allows you to use Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel API in JavaScript

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel API through CLI

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel OpenAPI definition

Merge Datasets & Remove Duplicates — Deduplicate, Filter, Excel API

Fast Instagram Scraper API - Posts, Reels, Profiles & Hashtags

apidojo/instagram-scraper-api

Instagram Scraper API - extract posts, reels, profiles, hashtags, locations & audio FASTat 100-200 posts/sec. Transparent event-based pricing from $0.005/query + $0.0005/post, FREE posts per query, no login, proxies or API keys. Perfect for influencer analysis, brand & social media monitoring.

API Dojo

5.0

(9)

Keyword Search Volume, CPC & Difficulty — Google + Bing Bulk

memo23/keyword-metrics

Keyword search volume, CPC, competition, difficulty and search intent from Google Ads and Bing, with up to ~7 years of monthly history and a trend flag. One flat fee covers up to 1000 keywords per run. Expand seeds into keyword ideas or pull a competitor's ranked keywords. 111 countries.

Muhamed Didovic

1.1K

Fast Instagram Profile Posts Scraper 🚀

instagram-scraper/fast-instagram-post-scraper

Instagram Post Scraper. Post data: hashtags, comment_count, like_count, usertags, images, videos, shortcode and etc. Scrape Instagram Posts with Ease and Speed

Instagram Scraper

8.2K

4.7

(10)

Threads Scraper - Posts, Profiles & Search

futurizerush/meta-threads-scraper

Threads scraper for public posts and profiles: search posts by keyword or hashtag, collect an account's posts, replies or reposts, find accounts by keyword, or save a post and its author's thread from a link. Export text, media, engagement, views when available and profile data. No login.

Rush

8.3K

4.2

(19)

Amazon Reviews Scraper

junglee/amazon-reviews-scraper

Amazon scraper to extract reviews from Amazon products. Scrape and download detailed reviews without using the Amazon API, including rating score, review description, reactions and images. Download your data as HTML table, JSON, CSV, Excel, XML.

Junglee

17K

2.7

(46)

YouTube Transcript & Subtitles Scraper API

johnvc/YoutubeTranscripts

Scrape YouTube transcripts, subtitles, and captions in bulk, the cheapest pay-per-video YouTube transcript API on Apify. Callable from any MCP client (Claude, Cursor, ChatGPT). Supports YouTube videos, Shorts, and every URL format.

John

10K

4.8

(11)

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

5.4K

5.0

(2)

Dataset Cleaner & Exporter

nerolabs/dataset-cleaner-exporter

Returns a deduplicated, flattened and cleaned copy of any Apify dataset, file or Google Sheet by URL, or JSON array, plus CSV and Excel files, named-dataset append and webhook delivery. Inputs: source, dedup keys, flatten, cleaning options. Agent-ready: pay per event (x402, MCP), per cleaned record.

Adam Pearce

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including caption, metrics, images, mentions, coauthors, recent comments, sponsored status, video duration, views. Export scraped data, schedule scraper via API, integrate with other tools or AI workflows.

Apify

153K

4.3

(139)

Dataset Merge & Dedup Datasets — Filter, Join CSV & Excel

saliga/dataset-merge-dedupe

Merge Apify datasets, CSV, JSON and Excel files or Google Sheets into one table. Clean fields, normalise URLs, extract domains, filter, remove duplicates and join (VLOOKUP) in one run. Works with limited permissions. CSV and Excel exports free. $0.50 per 1,000 output rows.