Crawler Results Deduplicate

No credit card required

Crawler Results Deduplicate

Crawler Results Deduplicate

petr_cermak/crawler-results-deduplicate

No credit card required

This acts takes crawler execution results and deduplicates them.

act-crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Example input:

{ "_id": "EXECUTION_ID", "data": "{ \"compareKey\": \"YOUR_COMPARE_KEY\" }" }

The optional "data" attribute must be a stringified JSON and can contain a "compareKey" attribute. This key is used to select an object attribute for comparison. If no key is provided, whole object will be used for comparison. It is expected to be called from a crawler webhook.

Developer
Maintained by Community
Actor stats
  • 8 users
  • 24 runs
  • Modified over 2 years ago
Categories

You might also like these Actors