Actor picture

Example Process Crawl Results

apify/example-process-crawl-results

Example act that iterates through all results from a crawler run and counts them. The act shall be called from the crawler's finish webhook. To do so, simply add the following URL to the finish webhook of your crawler: https://api.apify.com/v2/acts/apify~example-process-crawl-results/runs?token=<YOUR_API_TOKEN> You can use this act as a starting point to develop custom post-processing of data from the crawler.

To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
const Apify = require('apify');

// Set API token
Apify.client.setOptions({ token: '<YOUR_API_TOKEN>' });

// Prepare actor input
const input = {};

// Run the actor
const run = await Apify.call('apify/example-process-crawl-results', input);

// Print actor output (if any)
console.log('Output');
console.dir(run.output);

// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');
const dataset = await Apify.openDataset(run.defaultDatasetId);
await dataset.forEach(async (item, index) => {
    console.log(JSON.stringify(item));
});
  • Modified
  • Last run
  • Used12539 times
  • Used by12 users
Categories