Pricing

from $0.01 / 1,000 item compareds

Try for free

Go to Apify Store

Dataset Change Tracker

Try for free

Compare two runs of your scraper and get only the new, changed and removed items. Ignores fields you choose, shows which fields changed and their old values, and can remember the last run by storing only hashes of the items.

Pricing

from $0.01 / 1,000 item compareds

Rating

0.0

(0)

Developer

Quiet Works Lab

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Changelog

0.1 (published on Apify Store on 2026-11-01)

Next build (2026-11-01): both datasets are read until a page comes back empty or shorter than asked, instead of stopping at the item count the API reports. Right after items are pushed (for example when an integration starts this Actor the moment a scraper finishes) that count can be behind, even 0, and earlier builds then silently left out the items after it. A last page that is exactly full costs one extra (empty) request.
Build 0.1.2: if the dataset is passed only in an integration's payload (which this Actor cannot read with limited permissions), the run stops before charging and says to set datasetId to {{resource.defaultDatasetId}}.
Build 0.1.2: the memory check also runs after every page of the previous dataset, never plans with more heap than the run's memory, and Node starts with a heap sized from the run's memory (3/4 of it) and a small young generation.
- Because the heap is now checked against its real limit, the check accepts fewer items than in build 0.1.1 (items of about 350 bytes): with 256 MB about 90,000 instead of about 130,000; with 1024 MB about 500,000 instead of about 980,000 (0.1.1 checked only the run's memory; that many items were never tested).
Build 0.1.4: between garbage collections the memory check uses the current rss, so memory outside the heap that grew since the last collection (for example the loaded fingerprint) is counted before charging.
Build 0.1.3: pages grow at most twice as large as the page before (100, 200, 400, ... 5,000 items), so items that become large after a first page of small ones no longer make one huge page.
Build 0.1.3: a run restarted by Apify (for example moved to another server) that stops at the memory check keeps a PARTIAL summary with the items it compared and charged before the restart, instead of saying that nothing was charged.
Build 0.1.3: near the memory limit, garbage is collected only after the heap has grown by a tenth of its limit since the last collection, not on every page.
Build 0.1.3: the README shows the prices.
First version: compare two datasets, or compare with the hash-only fingerprint of the last run.
Key fields, ignored fields (with dotted paths), optional order-insensitive lists, choice of change types.
Changed items list the changed fields and their previous values.
Pay-per-event: one item-compared event per item of the current dataset; stops cleanly at the maximum cost per run.
Checks before any charge: key fields present in the first items, two different datasets, enough memory, readable fingerprint.
Each page is charged right after it is saved; only a page whose charge reaches the maximum cost waits until the final summary is saved. An interrupted run continues without charging an item twice.
Memory check before charging counts both the JavaScript heap and memory outside it, against the run memory.
Platform migrations, aborts and the run timeout (30 s before it) are handled by the Actor itself, also outside the page loop, so the summary is always written. A stop at the maximum cost keeps its message when Apify aborts the run afterwards.
The fingerprint is committed in two steps, so a restart right after saving it does not compare with the new fingerprint. Records left by an interrupted save are deleted when the run restarts or the next fingerprint is saved.
Hidden fields (#...) are not compared; pages are sized by bytes; compact in-memory sets for keys and fingerprints.
README only (2026-11-01): links to the example tasks (ready-made inputs with their own pages) and to the other Actors of Quiet Works Lab.

Dataset Join & Merge (VLOOKUP for Datasets)

nerolabs/dataset-join-merge

Returns two Apify datasets, files or Google Sheets by URL, or JSON arrays joined on key fields like SQL or VLOOKUP: left, inner, right, full and anti joins plus union, with CSV/Excel export, named-dataset append and webhook delivery. Agent-ready: pay per event (x402, MCP), per output row.

Adam Pearce

Shopify Price & Stock Change Tracker

scrapebench/shopify-change-tracker

Monitor any Shopify store for changes — price increases/decreases, back-in-stock & out-of-stock flips, and products added or removed. Run on a schedule for set-and-forget competitor and supplier watching.

ScrapeBench

Deduplicate, Merge & Transform Datasets

datacach/deduplicate-datasets

Merge multiple datasets, deduplicate items by a combination of fields, and apply custom transforms — powered by Polars.

DataCach

Dataset Filter & Transform

nerolabs/dataset-filter-transform

Returns rows of any Apify dataset, CSV/Excel/JSON file URL or Google Sheet that pass filter rules (25 operators, AND/OR, date ranges that fix a scraper's ignored date filter) after transforms (rename, cast, compute, regex), then sort, dedupe, export, webhook. Agent-ready: pay per event (x402, MCP).

Adam Pearce

166

Merge, Dedup & Transform Datasets - Limited permissions

lukaskrivka/dedup-datasets-limited-permissions

Limited permission version of the popular Actor. The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

576

Dataset Validity Checker

equidem/Dataset-Validity-Checker

Automatically checks, whether default datasets created by runs of an actor differ too much from the previously encountered ones, allowing it to warn you about web scraping problems caused by, e.g., a website layout changing, or other significant changes in the resulting data.

Matěj Sochor

Fast Dataset Cleaner & CSV Formatter

motivational_nickel/dataset-cleaner-and-formatter

Fast dataset cleaning for CSV and JSON files. Automatically removes duplicates, trims whitespace, fixes capitalization, and normalizes fields. Works with Apify datasets or uploaded files and prepares data for analytics, CRM imports, and automation pipelines.

Leoncio Coronado Jr

website-change-monitor

desmond-dev/website-change-monitor

Monitor any website for changes. If content updates, convert it to clean Markdown. Perfect for RAG, AI Agents, and competitor tracking. Ignores ads and navigation.

Desmond Chigariro

Dataset Deduplicator & Cleaner

eszetael_lab/dataset-deduplicator-cleaner

Returns your records with duplicates removed and values normalized — same fields as the input, nothing added or renamed. Exact, normalized or fuzzy matching on keys you choose. A data quality report lands under QUALITY_REPORT. Takes a dataset ID or inline JSON, so it chains after any scraper.