Merge, Dedup & Transform Datasets avatar
Merge, Dedup & Transform Datasets
Try for free

No credit card required

View all Actors
Merge, Dedup & Transform Datasets

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets
Try for free

No credit card required

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn mode

Node.js

Python

curl

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with API token
4const client = new ApifyClient({
5    token: '<YOUR_API_TOKEN>',
6});
7
8// Prepare Actor input
9const input = {
10    "preDedupTransformFunction": async (items, { Apify }) => {
11        return items;
12    },
13    "postDedupTransformFunction": async (items, { Apify }) => {
14        return items;
15    },
16    "customInputData": {}
17};
18
19(async () => {
20    // Run the Actor and wait for it to finish
21    const run = await client.actor("lukaskrivka/dedup-datasets").call(input);
22
23    // Fetch and print Actor results from the run's dataset (if any)
24    console.log('Results from dataset');
25    const { items } = await client.dataset(run.defaultDatasetId).listItems();
26    items.forEach((item) => {
27        console.dir(item);
28    });
29})();
Developer
Apify logo Maintained by Apify
Actor metrics
  • 240 monthly users
  • 96.2% runs succeeded
  • Modified 16 days ago

You might also like these Actors