Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.
- Modified
- Used by13 users
- Used12,540 times
- API
- Source code
- Recommended actors
To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token.
const Apify = require('apify');
// Set API token
Apify.client.setOptions({ token: '<YOUR_API_TOKEN>' });
// Prepare actor input
const input = {};
// Run the actor
const run = await Apify.call('apify/example-process-crawl-results', input);
// Print actor output (if any)
console.log('Output');
console.dir(run.output);
// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');
const dataset = await Apify.openDataset(run.defaultDatasetId, { forceCloud: true });
await dataset.forEach(async (item, index) => {
console.log(JSON.stringify(item));
});
