Pricing

from $3.50 / 1,000 differences

Try for free

Go to Apify Store

Dataset Diff & Change Detector: Only New Items

Try for free

Returns what was added, removed or changed between two Apify datasets, files, Google Sheets or JSON arrays, matched by key, or since its own last run. Only-new-items mode returns just rows never seen on any earlier run. CSV/Excel report, change log, webhook. Agent-ready: pay per event (x402, MCP).

Pricing

from $3.50 / 1,000 differences

Rating

0.0

(0)

Developer

Adam Pearce

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Categories

Developer tools

Automation

You can access the Dataset Diff & Change Detector: Only New Items programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "oldData": [
10        {
11            "sku": "A100",
12            "title": "Blue Widget",
13            "price": 19.99,
14            "stock": 42,
15        },
16        {
17            "sku": "A101",
18            "title": "Red Widget",
19            "price": 24.99,
20            "stock": 0,
21        },
22        {
23            "sku": "A102",
24            "title": "Green Widget",
25            "price": 15.5,
26            "stock": 8,
27        },
28    ],
29    "newData": [
30        {
31            "sku": "A100",
32            "title": "Blue Widget",
33            "price": 17.99,
34            "stock": 30,
35        },
36        {
37            "sku": "A102",
38            "title": "Green Widget",
39            "price": 15.5,
40            "stock": 8,
41        },
42        {
43            "sku": "A103",
44            "title": "Yellow Widget",
45            "price": 12,
46            "stock": 100,
47        },
48    ],
49    "keyFields": ["sku"],
50    "ignoreFields": [
51        "scrapedAt",
52        "lastChecked",
53        "timestamp",
54    ],
55}
56
57# Run the Actor and wait for it to finish
58run = client.actor("nerolabs/dataset-diff-detector").call(run_input=run_input)
59
60# Fetch and print Actor results from the run's dataset (if there are any)
61print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
62for item in client.dataset(run.default_dataset_id).iterate_items():
63    print(item)
64
65# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Dataset Diff: Only New Items Since Last Scrape, Compare Data API in Python

The Apify API client for Python is the official library that allows you to use Dataset Diff & Change Detector: Only New Items API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Dataset Diff & Change Detector: Only New Items API in JavaScript

Dataset Diff & Change Detector: Only New Items API through CLI

Dataset Diff & Change Detector: Only New Items OpenAPI definition

Dataset Diff & Change Detector: Only New Items API

Dataset Filter & Transform

nerolabs/dataset-filter-transform

Returns rows of any Apify dataset, CSV/Excel/JSON file URL or Google Sheet that pass filter rules (25 operators, AND/OR, date ranges that fix a scraper's ignored date filter) after transforms (rename, cast, compute, regex), then sort, dedupe, export, webhook. Agent-ready: pay per event (x402, MCP).

Adam Pearce

Dataset Cleaner & Exporter

nerolabs/dataset-cleaner-exporter

Returns a deduplicated, flattened and cleaned copy of any Apify dataset, file or Google Sheet by URL, or JSON array, plus CSV and Excel files, named-dataset append and webhook delivery. Inputs: source, dedup keys, flatten, cleaning options. Agent-ready: pay per event (x402, MCP), per cleaned record.

Adam Pearce

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

5.2K

5.0

(2)

Dataset Join & Merge (VLOOKUP for Datasets)

nerolabs/dataset-join-merge

Returns two Apify datasets, files or Google Sheets by URL, or JSON arrays joined on key fields like SQL or VLOOKUP: left, inner, right, full and anti joins plus union, with CSV/Excel export, named-dataset append and webhook delivery. Agent-ready: pay per event (x402, MCP), per output row.

Adam Pearce

Dataset MCP Uploader

lukaskrivka/dataset-mcp-uploader

Dataset MCP Uploader allows you to process datasets on the Apify platform and then publish the results on other platforms that support the MCP protocol

Lukáš Křivka

Diff Datasets

pocesar/diff-datasets

Take one dataset on Apify platform, compare it to another, and output the missing ones. This can also be used to output only changed items, using a compound key

Paulo Cesar

Fast Dataset Cleaner & CSV Formatter

motivational_nickel/dataset-cleaner-and-formatter

Fast dataset cleaning for CSV and JSON files. Automatically removes duplicates, trims whitespace, fixes capitalization, and normalizes fields. Works with Apify datasets or uploaded files and prepares data for analytics, CRM imports, and automation pipelines.

Leoncio Coronado Jr

XMLs To Dataset

mtrunkat/xmls-to-dataset

Go to actor anytime you need to download XML files and store them in the dataset.

Marek Trunkát

112

Dataset Validity Checker

equidem/Dataset-Validity-Checker

Automatically checks, whether default datasets created by runs of an actor differ too much from the previously encountered ones, allowing it to warn you about web scraping problems caused by, e.g., a website layout changing, or other significant changes in the resulting data.

Matěj Sochor

Web Drift Detector – Website Change Monitoring & Content Diff

muhammad-bilal/web-drift-detector

Detect website changes automatically. Monitor pricing, content, policies, and competitors using fast browserless web change detection. Structured diffs, severity scoring, historical snapshots, and webhook alerts. Ideal for compliance, SaaS, ecommerce, and monitoring workflows.