Skip to main content
Pentaho Documentation

Worker Nodes

Overview

Worker nodes allow Pentaho work items to be executed with parallel processing and dynamic scalability with load balancing and dependency management in a clustered environment. 

You can deploy worker nodes in physical, virtual, and Cloud environments to manage the base and peak time processing demands for the workloads of hundreds of work items (PDI jobs and transformations) at different times and with different processing requirements. Moreover, through the use of a hybrid deployment of environments, you can provide additional processing capabilities to distribute the load in cases when the on-premise resources are insufficient, by scaling out into the Cloud for more resources. 

Hitachi Content Intelligence (HCI) and other technologies, such as Docker, Chronos, and Mesos, provide the means to enable the Pentaho Server to scale in a worker node environment. You can manage system scaling by adding or removing instances (servers or virtual machines connected as worker nodes) to the system and also by specifying which services run on an instance. A single-instance system is useful for testing and demonstration purposes, while a multi-instance system is recommended for use in a production environment. Multi-instance systems have two instance types: Master instances, which run essential services, and non-master Worker instances.

distibute and scale.png

Refer your Pentaho or IT administrator to get started with worker nodes for building and installation details, and refer your administrator to use worker nodes for Pentaho Server configuration and use details.