Product Catalog Diff: Find New SKUs Only

Created by

DataCach

Actor

Deduplicate, Merge & Transform Datasets

Filter a daily product scrape against a master catalog so only new SKUs are output. Built for e-commerce analysts who alert on new listings, not reruns.

Try for free

Deduplicate, Merge & Transform Datasetsdatacach/deduplicate-datasets

Source Dataset

Input

Dataset IDs:7ykL2QpRt3NmXaBc9

Deduplication fields:sku+1

Items to output:unique-items

Deduplication mode:dedup-after-load

Treat null fields as unique:false

Dataset IDs of filter items:mQ4vTz8WsE1JdRnK0

Post-deduplication transform function:[{'sku': i.get('sku'), 'name': i.get('name'), 'price': i.get('price'), 'url': i.get('url')} for i in items]

Output destination:dataset

Output dataset ID:new-products-today

Append dataset IDs:false

Fields to load:sku+3

Load batch size:50000

Upload batch size:500

Parallel loads:10

Parallel pushes:5

Verbose logging:false

Output fields

Source Dataset

How it works

Sign up on Apify or log in

The Deduplicate, Merge & Transform Datasets Actor is ready to run with the inputs already set for "Product Catalog Diff: Find New SKUs Only". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Product Catalog Diff: Find New SKUs Only" task

The Deduplicate, Merge & Transform Datasets Actor will start running based on the input automatically. You can also change all the input fields, like dataset ids, deduplication fields, and more, to match your specific use case.

Receive the "Product Catalog Diff: Find New SKUs Only" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as source dataset.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Product Catalog Diff: Find New SKUs Only" task via API.