Crawler Results Deduplicate

  • petr_cermak/crawler-results-deduplicate
  • Modified
  • Users 8
  • Runs 22
  • Created by Author's avatarPetr Cermak

This acts takes crawler execution results and deduplicates them.

Crawler Results Deduplicate

To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token. For a more detailed explanation, please read about running Actors via the API in Apify Docs.

from apify_client import ApifyClient

# Initialize the ApifyClient with your API token
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run ="petr_cermak/crawler-results-deduplicate").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():