{ 
    // crawler execution id
    "_id": EXECUTION_ID,
    
    // knack connection credentials
    "data": {
        "view": KNACK_VIEW,
        "scene": KNACK_SCENE,
        "appId": KNACK_APP_ID,
        "apiKey": KNACK_API_KEY,
        "schema": TRANSFORM_SCHEMA  // optional
    }
}

The act can be run with a crawler finish webhook, in such case fill just the contents of data attribute into a crawler finish webhook data.

It is possible to transform the crawler column names into the Knack field names using a transform schema. This is what the optional schema attribute is for, it is a simple object with the following structure.

{
    // CRAWLER : KNACK
    "col_name_1": "field_001",
    "col_name_2": "field_002",
    ...
}

MySQL Insert

petr_cermak/MySQL-insert

This act takes a crawler execution and inserts it's results into a remote MySQL database.

Petr Cermak

PostgreSQL Insert

petr_cermak/PostgreSQL-insert

This act takes a crawler execution and inserts it's results into a remote PostgreSQL database.

Petr Cermak

Crawler Results Deduplicate

petr_cermak/crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Petr Cermak

Microsoft SQL Server Insert

petr_cermak/MSSQL-insert

This actor takes a crawler execution and inserts its results into a remote MSSQL database.

Petr Cermak

Datasets Compare

petr_cermak/datasets-compare

Act for comparing crawler execution results. By default the final result set will contain only new and updated records.

Petr Cermak

Execution To Xlsx

petr_cermak/execution-to-xlsx

The act takes a JSON input containing a crawler executionID, downloads the results and converts them to XLSX.

Petr Cermak

Execution ID To XLS Send

vaclavrut/executionid-to-xls-and-send

This actor takes JSON at input, creates it as XLS from the execution ID result and then sends a link by email. The URL is also outputted in the log. Solves attaching XLS files to emails.

Vaclav Rut

Crawler Orchestra

juansgaitan/crawler-orchestra

Call a crawler/s and handle its result/s inside an Act.

Juan Gaitán Villamizar

Example Process Crawl Results

apify/example-process-crawl-results

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.