Under maintenance

Pricing

Pay per usage

Try for free

Go to Store

Execution To Knack

Under maintenance

Try for free

Developed by

Petr Cermak

Act for inserting crawler execution results into Knack database.

0.0 (0)

Pricing

Pay per usage

Total users

Monthly users

Runs succeeded

Last modified

4 years ago

Developer tools

Open source

act-execution-to-knack

Apify act for inserting crawler results into Knack database.

This act fetches all results from a specified Apifier crawler execution and inserts them into a view in Knack database.

INPUT

Input is a JSON object with the following properties:

{ 
    // crawler execution id
    "_id": EXECUTION_ID,
    
    // knack connection credentials
    "data": {
        "view": KNACK_VIEW,
        "scene": KNACK_SCENE,
        "appId": KNACK_APP_ID,
        "apiKey": KNACK_API_KEY,
        "schema": TRANSFORM_SCHEMA  // optional
    }
}

The act can be run with a crawler finish webhook, in such case fill just the contents of data attribute into a crawler finish webhook data.

It is possible to transform the crawler column names into the Knack field names using a transform schema. This is what the optional schema attribute is for, it is a simple object with the following structure.

{
    // CRAWLER : KNACK
    "col_name_1": "field_001",
    "col_name_2": "field_002",
    ...
}

MySQL Insert

petr_cermak/MySQL-insert

This act takes a crawler execution and inserts it's results into a remote MySQL database.

Petr Cermak

PostgreSQL Insert

petr_cermak/PostgreSQL-insert

This act takes a crawler execution and inserts it's results into a remote PostgreSQL database.

Petr Cermak

Crawler Results Deduplicate

petr_cermak/crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Petr Cermak

Microsoft SQL Server Insert

petr_cermak/MSSQL-insert

This actor takes a crawler execution and inserts its results into a remote MSSQL database.

Petr Cermak

Datasets Compare

petr_cermak/datasets-compare

Act for comparing crawler execution results. By default the final result set will contain only new and updated records.

Petr Cermak

Execution To Xlsx

petr_cermak/execution-to-xlsx

The act takes a JSON input containing a crawler executionID, downloads the results and converts them to XLSX.

Petr Cermak

Execution ID To XLS Send

vaclavrut/executionid-to-xls-and-send

This actor takes JSON at input, creates it as XLS from the execution ID result and then sends a link by email. The URL is also outputted in the log. Solves attaching XLS files to emails.

Vaclav Rut

Crawler Orchestra

juansgaitan/crawler-orchestra

Call a crawler/s and handle its result/s inside an Act.

Juan Gaitán Villamizar

Example Process Crawl Results

apify/example-process-crawl-results

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.