Get only new and changed products between two runs

Created by

Argentin Vazdautan

Actor

Dataset Change Monitor

See how the monitor works on a small product list: the first run saves a baseline, and every later run returns only the products that are new, changed (with the old and new price) or removed. Point it at your own scraper's dataset or run it from a scraper's integration to get only what changed, with optional Telegram, Slack or email alerts.

Try for free

Dataset Change Monitoregra_van/dataset-change-monitor

Change

Key

Changed fields

Before → after

+1 field

Input

…or items (JSON)

url:https://shop.example.com/p/1+2

name:Blue mug+2

price:12.5+2

Monitor name:demo-products

Unique key fields:url

Fields to ignore:scrapedAt+2

Report new items:true

Report changed items:true

Report removed items:true

Report all items as new on the first run:true

Show which fields changed (before → after):true

Max field changes listed per item:20

Max items to compare:0

Changes listed in a message:10

Also notify when nothing changed:false

Changes included in the webhook:100

Start over:false

Allow an empty source:false

State storage name:change-monitor-state

Output fields

Change

Key

Changed fields

Before → after

Item

How it works

Sign up on Apify or log in

The Dataset Change Monitor Actor is ready to run with the inputs already set for "Get only new and changed products between two runs". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Get only new and changed products between two runs" task

The Dataset Change Monitor Actor will start running based on the input automatically. You can also change all the input fields, like …or items (json), monitor name, and more, to match your specific use case.

Receive the "Get only new and changed products between two runs" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as change, key, changed fields, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Get only new and changed products between two runs" task via API.