Actor picture

Crawler Results Dedup Xls


This actor downloads crawler execution results, deduplicates them and sends them to a specified e-mail address. It can be used from a crawler finish webhook, the data attribute must be a stringified JSON.

Author's avatarPetr Cermak
  • Modified
  • Used by3 users
  • Used4,042 times
Actor picture
Crawler Results Dedup Xls

To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token.

const Apify = require('apify');

// Set API token
Apify.client.setOptions({ token: '<YOUR_API_TOKEN>' });

// Prepare actor input
const input = {};

// Run the actor
const run = await'petr_cermak/crawler-results-dedup-xls', input);

// Print actor output (if any)

// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');
const dataset = await Apify.openDataset(run.defaultDatasetId, { forceCloud: true });
await dataset.forEach(async (item, index) => {