Sort Dataset Items avatar

Sort Dataset Items

Try for free

No credit card required

Go to Store
Sort Dataset Items

Sort Dataset Items

lukaskrivka/sort-dataset-items
Try for free

No credit card required

Add this actor as a webhook to your scraper to sort the dataset by index field

.editorconfig

1root = true
2
3[*]
4indent_style = space
5indent_size = 4
6charset = utf-8
7trim_trailing_whitespace = true
8insert_final_newline = true
9end_of_line = lf

.eslintrc

1{
2    "extends": "@apify"
3}

.gitignore

1# This file tells Git which files shouldn't be added to source control
2
3.idea
4node_modules

Dockerfile

1# First, specify the base Docker image. You can read more about
2# the available images at https://sdk.apify.com/docs/guides/docker-images
3# You can also use any other image from Docker Hub.
4FROM apify/actor-node:16
5
6# Second, copy just package.json and package-lock.json since it should be
7# the only file that affects "npm install" in the next step, to speed up the build
8COPY package*.json ./
9
10# Install NPM packages, skip optional and development dependencies to
11# keep the image small. Avoid logging too much and print the dependency
12# tree for debugging
13RUN npm --quiet set progress=false \
14 && npm install --only=prod --no-optional \
15 && echo "Installed NPM packages:" \
16 && (npm list --only=prod --no-optional --all || true) \
17 && echo "Node.js version:" \
18 && node --version \
19 && echo "NPM version:" \
20 && npm --version
21
22# Next, copy the remaining files and directories with the source code.
23# Since we do this after NPM install, quick build will be really fast
24# for most source file changes.
25COPY . ./
26
27# Optionally, specify how to launch the source code of your actor.
28# By default, Apify's base Docker images define the CMD instruction
29# that runs the Node.js source code using the command specified
30# in the "scripts.start" section of the package.json file.
31# In short, the instruction looks something like this:
32#
33# CMD npm start

INPUT_SCHEMA.json

1{
2    "title": "Input schema for the apify_project actor.",
3    "type": "object",
4    "schemaVersion": 1,
5    "properties": {
6        "datasetId": {
7            "title": "Dataset Id",
8            "type": "string",
9            "description": "Dataset Id of dataset to sort. You don't need to provide this if you use a webhook.",
10            "editor": "textfield"
11        }
12    },
13    "required": []
14}

apify.json

1{
2    "env": { "npm_config_loglevel": "silent" }
3}

main.js

1const Apify = require('apify');
2
3const transformFunction = (items) => {
4    items.sort((a, b) => {
5        return a.index - b.index;
6    })
7    return items;
8}
9
10Apify.main(async () => {
11    // Get input of the actor (here only for demonstration purposes).
12    const input = await Apify.getInput();
13    console.log('Input:');
14    console.dir(input);
15
16    let {
17        // either called from webhook or directly
18        resource,
19        datasetId
20    } = input;
21
22    if (resource) {
23        datasetId = resource.defaultDatasetId;
24    }
25
26    const actorInput = {
27        datasetIds: [datasetId],
28        preDedupTransformFunction: transformFunction,
29    };
30
31    await Apify.metamorph(
32        'lukaskrivka/dedup-datasets',
33        actorInput,
34    )
35});

package.json

1{
2    "name": "project-empty",
3    "version": "0.0.1",
4    "description": "This is a boilerplate of an Apify actor.",
5    "dependencies": {
6        "apify": "^2.0.7"
7    },
8    "devDependencies": {
9        "@apify/eslint-config": "^0.1.3",
10        "eslint": "^7.0.0"
11    },
12    "scripts": {
13        "start": "node main.js",
14        "lint": "./node_modules/.bin/eslint ./src --ext .js,.jsx",
15        "lint:fix": "./node_modules/.bin/eslint ./src --ext .js,.jsx --fix",
16        "test": "echo \"Error: oops, the actor has no tests yet, sad!\" && exit 1"
17    },
18    "author": "It's not you it's me",
19    "license": "ISC"
20}
Developer
Maintained by Community

Actor Metrics

  • 1 monthly user

  • 3 stars

  • Created in May 2022

  • Modified a year ago