Example Process Crawl Results
apify/example-process-crawl-results
Example act that iterates through all results from a crawler run and counts them. The act shall be called from the crawler's finish webhook. To do so, simply add the following URL to the finish webhook of your crawler: https://api.apify.com/v2/acts/apify~example-process-crawl-results/runs?token=<YOUR_API_TOKEN> You can use this act as a starting point to develop custom post-processing of data from the crawler.
- API
- Source code
To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21const Apify = require('apify'); // Set API token Apify.client.setOptions({ token: '<YOUR_API_TOKEN>' }); // Prepare actor input const input = {}; // Run the actor const run = await Apify.call('apify/example-process-crawl-results', input); // Print actor output (if any) console.log('Output'); console.dir(run.output); // Fetch and print actor results from the run's dataset (if any) console.log('Results from dataset'); const dataset = await Apify.openDataset(run.defaultDatasetId); await dataset.forEach(async (item, index) => { console.log(JSON.stringify(item)); });
