Merge, Dedup & Transform Datasets avatar
Merge, Dedup & Transform Datasets
Try for free

No credit card required

View all Actors
Merge, Dedup & Transform Datasets

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets
Try for free

No credit card required

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn mode

Node.js

Python

curl

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your API token
4client = ApifyClient("<YOUR_API_TOKEN>")
5
6# Prepare the Actor input
7run_input = {
8    "preDedupTransformFunction": """async (items, { Apify }) => {
9    return items;
10}""",
11    "postDedupTransformFunction": """async (items, { Apify }) => {
12    return items;
13}""",
14    "customInputData": {},
15}
16
17# Run the Actor and wait for it to finish
18run = client.actor("lukaskrivka/dedup-datasets").call(run_input=run_input)
19
20# Fetch and print Actor results from the run's dataset (if there are any)
21for item in client.dataset(run["defaultDatasetId"]).iterate_items():
22    print(item)
Developer
Apify logo Maintained by Apify
Actor metrics
  • 240 monthly users
  • 96.2% runs succeeded
  • Modified 16 days ago

You might also like these Actors