![Merge, Dedup & Transform Datasets avatar](https://images.apifyusercontent.com/P1i5pot5FZgF0Flm0QzUWm2jv5wgDI8tz8JhzE69prc/rs:fill:92:92/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9vdTJidVBDTjloWWRHTFZkVC9ycjc4bUdLZTk5aWo2YkVheC1wY2Ffcl9vay5wbmc.webp)
Merge, Dedup & Transform Datasets
Try for free
No credit card required
View all Actors![Merge, Dedup & Transform Datasets](https://images.apifyusercontent.com/P1i5pot5FZgF0Flm0QzUWm2jv5wgDI8tz8JhzE69prc/rs:fill:92:92/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9vdTJidVBDTjloWWRHTFZkVC9ycjc4bUdLZTk5aWo2YkVheC1wY2Ffcl9vay5wbmc.webp)
![Merge, Dedup & Transform Datasets](https://images.apifyusercontent.com/P1i5pot5FZgF0Flm0QzUWm2jv5wgDI8tz8JhzE69prc/rs:fill:92:92/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9vdTJidVBDTjloWWRHTFZkVC9ycjc4bUdLZTk5aWo2YkVheC1wY2Ffcl9vay5wbmc.webp)
Merge, Dedup & Transform Datasets
lukaskrivka/dedup-datasets
Try for free
No credit card required
The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.
The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn more
1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4const client = new ApifyClient({
5 token: '<YOUR_API_TOKEN>',
6});
7
8// Prepare Actor input
9const input = {
10 "preDedupTransformFunction": async (items, { Apify }) => {
11 return items;
12 },
13 "postDedupTransformFunction": async (items, { Apify }) => {
14 return items;
15 },
16 "customInputData": {}
17};
18
19(async () => {
20 // Run the Actor and wait for it to finish
21 const run = await client.actor("lukaskrivka/dedup-datasets").call(input);
22
23 // Fetch and print Actor results from the run's dataset (if any)
24 console.log('Results from dataset');
25 console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
26 const { items } = await client.dataset(run.defaultDatasetId).listItems();
27 items.forEach((item) => {
28 console.dir(item);
29 });
30})();
31
32// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
Developer
Maintained by Apify
Actor metrics
- 367 monthly users
- 42 stars
- 84.2% runs succeeded
- 2.8 days response time
- Created in Apr 2020
- Modified 23 days ago
Categories