Pricing

Pay per usage

Go to Store

Merge, Dedup & Transform Datasets

Try for free

Developed by

Lukáš Křivka

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

0.0 (0)

Pricing

Pay per usage

Monthly users

128

Runs succeeded

97%

Response time

26 days

Last modified

3 months ago

Automation

Developer tools

Open source

Back to issues Create new issue

De-duplicate dataset error

Closed

data_explorer opened this issue

While running the task I keep get this error:

2024-05-01T09:22:59.977Z ACTOR: Pulling Docker image of build BzYf2ui1QKTRzHNQI from repository. 2024-05-01T09:23:02.120Z ACTOR: Creating Docker container. 2024-05-01T09:23:02.325Z ACTOR: Starting Docker container. 2024-05-01T09:23:04.501Z INFO System info {"apifyVersion":"2.2.0","apifyClientVersion":"2.0.4","osType":"Linux","nodeVersion":"v16.20.2"} 2024-05-01T09:23:04.604Z My input: 2024-05-01T09:23:04.607Z { 2024-05-01T09:23:04.610Z datasetIds: [ 'Id07DYkDaLOduqIsZ' ], 2024-05-01T09:23:04.612Z fields: [ 2024-05-01T09:23:04.615Z 'categoryName', 2024-05-01T09:23:04.618Z 'title', 2024-05-01T09:23:04.620Z 'address', 2024-05-01T09:23:04.622Z 'phone', 2024-05-01T09:23:04.624Z 'website', 2024-05-01T09:23:04.627Z 'totalScore', 2024-05-01T09:23:04.629Z 'reviewsCount', 2024-05-01T09:23:04.631Z 'openingHours' 2024-05-01T09:23:04.633Z ], 2024-05-01T09:23:04.640Z fieldsToLoad: [ 2024-05-01T09:23:04.642Z 'categoryName', 2024-05-01T09:23:04.645Z 'title', 2024-05-01T09:23:04.650Z 'address', 2024-05-01T09:23:04.652Z 'phone', 2024-05-01T09:23:04.654Z 'website', 2024-05-01T09:23:04.656Z 'totalscore', 2024-05-01T09:23:04.658Z 'reviewsCount', 2024-05-01T09:23:04.665Z 'openingHours' 2024-05-01T09:23:04.667Z ], 2024-05-01T09:23:04.670Z mode: 'dedup-as-loading', 2024-05-01T09:23:04.699Z output: 'unique-items', 2024-05-01T09:23:04.702Z outputDatasetId: 'tenni... [trimmed]

Lukáš Křivka (lukaskrivka)

Hello,

Thanks for the report. This happened because you accidentally passed run ID, instead of dataset ID. But I updated the so that it will handle it as well now.

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

Dataset Toolbox

cyberfly/dataset-toolbox

Perform common actions on datasets - merge, unify, validate, transform, order fields etc.

Vasek Codey Vlcek

Contact Details Merge & Deduplicate

lukaskrivka/contact-details-merge-deduplicate

Merge and deduplicate all contacts extracted by Contact Details Scraper. Works with multiple datasets. One row per domain.

Lukáš Křivka

Diff Datasets

pocesar/diff-datasets

Take one dataset on Apify platform, compare it to another, and output the missing ones. This can also be used to output only changed items, using a compound key

Paulo Cesar

Woocommerce Product Scrapper

naz_here/woocommerce-scrapper

Scrap images, links, title , sku , description etc from ecommerce websites that are based on Wocommerce . This only works for woocommerce based websites.

Nazmul Hasan

CSV File to Dataset

lukaskrivka/csv-file-to-dataset

Upload a local or remote CSV/text file and convert it to Apify Dataset for further use.

Lukáš Křivka

Content Checker

jakubbalada/content-checker

Monitor a website or web page for content changes. Automatically saves before and after screenshots and sends an email notification when content changes are detected.