Crawler Results Deduplicate avatar
Crawler Results Deduplicate

Pricing

Pay per usage

Go to Store
Crawler Results Deduplicate

Crawler Results Deduplicate

petr_cermak/crawler-results-deduplicate

Developed by

Petr Cermak

Maintained by Community

This acts takes crawler execution results and deduplicates them.

0.0 (0)

Pricing

Pay per usage

1

Monthly users

1

Last modified

4 years ago

act-crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Example input:

1{
2    "_id": "EXECUTION_ID",
3    "data": "{
4        \"compareKey\": \"YOUR_COMPARE_KEY\"
5    }"
6}

The optional "data" attribute must be a stringified JSON and can contain a "compareKey" attribute. This key is used to select an object attribute for comparison. If no key is provided, whole object will be used for comparison. It is expected to be called from a crawler webhook.

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.