Task Orchestrator

Overview

The Task Orchestrator is an Apify actor designed to manage and run a list of tasks efficiently. It ensures that tasks do not exceed memory limits and provides detailed status and run IDs for each task.

Features

• Memory Management: Prevents tasks from running out of memory by grouping and scheduling them based on memory usage.
• Task Prioritization: Groups tasks by memory requirements and schedules them in descending order.
• Error Handling: Handles task errors and retries failed tasks up to a configurable limit.
• Debugging: Provides detailed logs and snapshots for debugging purposes.

Input Schema

The actor accepts the following input parameters:

• taskIds (required): An array of task IDs or names to run.
• memoryBufferMB: Memory buffer in MB to allocate for tasks. Default is 5120.
• activeJobBuffer: Number of active jobs to buffer. Default is 2.
• maxActiveJobs: Maximum number of active tasks to run simultaneously.
• maxUsageMB: Maximum memory usage in MB for all tasks combined.