Keep the latest version of each item when merging scraper runs
Quiet Works Lab
Merges several runs of the same scraper and keeps one item per key, taken from the dataset you list last, so that the newest prices, stock or texts win. The kept item stays at its own position and an optional field shows how many duplicates each item had. Put the newest dataset last; only the order decides which version is kept.
Input
Output fields
Sign up on Apify or log in
The Merge, Deduplicate & Join Datasets Actor is ready to run with the inputs already set for "Keep the latest version of each item when merging scraper runs". Sign up or log in and you'll land in Apify Console with a copy of this exact task.
Start the "Keep the latest version of each item when merging scraper runs" task
The Merge, Deduplicate & Join Datasets Actor will start running based on the input automatically. You can also change all the input fields, like which duplicate to keep and key matching, to match your specific use case.
Receive the "Keep the latest version of each item when merging scraper runs" output
Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as sku, name, maker, and more.
Integrate into your workflow
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Keep the latest version of each item when merging scraper runs" task via API.
Integrate "Keep the latest version of each item when merging scraper runs" into your workflow
Connect "Keep the latest version of each item when merging scraper runs" with 100+ integrations, or run it via API or MCP.
Webhook
n8n
Make
Zapier
Airbyte
Keboola
IFTTT
Hubspot
GDrive
Gmail
Apify MCP
GitHub
Slack
LangChain
LlamaIndex
Flowise
Pinecone
OpenAI
Mastra
Clay
The latest-version task does not read dates: it keeps the item from the dataset read last. List your datasets from oldest to newest, so the newest dataset is read last.
Yes. With keep last, the latest-version task first counts every key and then writes the items, but each item is charged only once. The maximum cost per run must cover all items, or the run stops before reading them.
The Merge, Deduplicate & Join Datasets Actor charges $0.0001 per item read ($0.10 per 1,000 items) and one item per started 20 items of a lookup dataset, plus Apify's Actor start event. The built-in sample is not charged per item.