![Merge, Dedup & Transform Datasets avatar](https://images.apifyusercontent.com/jZpRJwJGXFvhShrc3yw3xGU3R2kAb61Iq-PZNRZ_I7M/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9vdTJidVBDTjloWWRHTFZkVC9ycjc4bUdLZTk5aWo2YkVheC1wY2Ffcl9vay5wbmc.webp)
Merge, Dedup & Transform Datasets
Try for free
No credit card required
View all Actors![Merge, Dedup & Transform Datasets](https://images.apifyusercontent.com/jZpRJwJGXFvhShrc3yw3xGU3R2kAb61Iq-PZNRZ_I7M/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9vdTJidVBDTjloWWRHTFZkVC9ycjc4bUdLZTk5aWo2YkVheC1wY2Ffcl9vay5wbmc.webp)
![Merge, Dedup & Transform Datasets](https://images.apifyusercontent.com/jZpRJwJGXFvhShrc3yw3xGU3R2kAb61Iq-PZNRZ_I7M/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9vdTJidVBDTjloWWRHTFZkVC9ycjc4bUdLZTk5aWo2YkVheC1wY2Ffcl9vay5wbmc.webp)
Merge, Dedup & Transform Datasets
lukaskrivka/dedup-datasets
Try for free
No credit card required
The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.
Do you want to learn more about this Actor?
Get a demoThe code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn more
1# Set API token
2API_TOKEN=<YOUR_API_TOKEN>
3
4# Prepare Actor input
5cat > input.json <<'EOF'
6{
7 "preDedupTransformFunction": "async (items, { Apify }) => {\n return items;\n}",
8 "postDedupTransformFunction": "async (items, { Apify }) => {\n return items;\n}",
9 "customInputData": {}
10}
11EOF
12
13# Run the Actor using an HTTP API
14# See the full API reference at https://docs.apify.com/api/v2
15curl "https://api.apify.com/v2/acts/lukaskrivka~dedup-datasets/runs?token=$API_TOKEN" \
16 -X POST \
17 -d @input.json \
18 -H 'Content-Type: application/json'
Developer
Maintained by Apify
Actor metrics
- 788 monthly users
- 47 stars
- 99.6% runs succeeded
- 16 days response time
- Created in Apr 2020
- Modified 2 months ago
Categories