Merge, Dedup & Transform Datasets avatar
Merge, Dedup & Transform Datasets
Try for free

No credit card required

View all Actors
Merge, Dedup & Transform Datasets

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets
Try for free

No credit card required

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn mode

Node.js

Python

curl

1# Set API token
2API_TOKEN=<YOUR_API_TOKEN>
3
4# Prepare Actor input
5cat > input.json <<'EOF'
6{
7  "preDedupTransformFunction": "async (items, { Apify }) => {\n    return items;\n}",
8  "postDedupTransformFunction": "async (items, { Apify }) => {\n    return items;\n}",
9  "customInputData": {}
10}
11EOF
12
13# Run the Actor using an HTTP API
14# See the full API reference at https://docs.apify.com/api/v2
15curl "https://api.apify.com/v2/acts/lukaskrivka~dedup-datasets/runs?token=$API_TOKEN" \
16  -X POST \
17  -d @input.json \
18  -H 'Content-Type: application/json'
Developer
Apify logo Maintained by Apify
Actor metrics
  • 240 monthly users
  • 96.7% runs succeeded
  • Created in Apr 2020
  • Modified 21 days ago

You might also like these Actors