Actor picture

Crawler Results Dedup Xls

petr_cermak/crawler-results-dedup-xls

This actor downloads crawler execution results, deduplicates them and sends them to a specified e-mail address. It can be used from a crawler finish webhook, the data attribute must be a stringified JSON.

To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token.

const Apify = require('apify');

// Set API token
Apify.client.setOptions({ token: '<YOUR_API_TOKEN>' });

// Prepare actor input
const input = {};

// Run the actor
const run = await Apify.call('petr_cermak/crawler-results-dedup-xls', input);

// Print actor output (if any)
console.log('Output');
console.dir(run.output);

// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');
const dataset = await Apify.openDataset(run.defaultDatasetId, { forceCloud: true });
await dataset.forEach(async (item, index) => {
    console.log(JSON.stringify(item));
});
  • Updated
  • Last run
  • Used4042 times
  • Used by3 users