Actor picture

Dataset Toolbox

cyberfly/dataset-toolbox

Perform common actions on datasets - merge, unify, validate, transform, order fields etc.

No credit card required

Author's avatarVasek Tobey Vlcek
  • Modified
  • Users11
  • Runs220

Actor IDs

actorIds

Optional

array

IDs of actors to use as source of latest default datasets

Dataset IDs

datasetIds

Optional

array

IDs of datasets to use as data sources directly

Output format

outputFormat

Optional

string

Output file format of the result dataset

Options:

"csv", "json", "html", "xlsx"

Items count limit

itemsLimit

Optional

integer

Limit number of items from the source datasets

Pick/sort output fields

manageFields

Optional

boolean

Pick top level fields from the source dataset and sort them in custom order specified below

Fields in this order

sortedFields

Optional

array

Extract these fields from source datasets and sort them in specified order on output linked from dataset download link in KV

Enable post-processing

postProcessing

Optional

boolean

Enable post-processing of individual items

Post-processing function

postProcessFun

Optional

string

Function for post-processing with individual dataset item as its single argument

Validate output schema

validateSchema

Optional

boolean

Validates dataset items against output schema

Validate only (skip output)

validateOnly

Optional

boolean

Validate source items without storing them in default dataset

Output schema

outputSchema

Optional

object

Dataset items are validated against this schema