Skip to main content

Pentaho+ documentation has moved!

The new product documentation portal is here. Check it out now at docs.hitachivantara.com

 

Hitachi Vantara Lumada and Pentaho Documentation

Set up Pentaho Worker Nodes on the Pentaho Server

Parent article

After you Installing the Pentaho Worker Nodes product, you are ready to enable Pentaho Worker Nodes on your Pentaho Server and configure it to run work items. In addition, you can enable secure communication between the Pentaho Server and the worker nodes.

Enable Pentaho Worker Nodes

After starting HCI, you will need to configure the Pentaho Server to delegate PDI transformations and jobs to the Pentaho Worker Nodes within the HCI instance.

Perform the following steps in the Karaf environment:

Procedure

  1. If you have not done so already, stop the Pentaho Server.

  2. Navigate to the pentaho-server/pentaho-solutions/system/karaf/etc/ directory and open the org.apache.karaf.features.cfg file with any text editor.

  3. Locate the featuresBoot property and add the pentaho-worker-nodes-ee feature.

    # Comma separated list of features to install at startup
    #
    featuresBoot=config,management,kar,cxf,camel,camel-blueprint,camel-stream,pentaho-camel-jms,pentaho-server,pentaho-monitoring-to-snmp,pentaho-metaverse,pdi-dataservice,pdi-data-refinery,pentaho-big-data-ee-plugin-osgi-obf,pdi-engine-configuration,pentaho-worker-nodes-ee
  4. Save and close the org.apache.karaf.features.cfg file.

  5. Start the Pentaho Server.

  6. Verify that the new configuration file pentaho.worker.nodes.cfg has been created in the following location:

    pentaho-server/pentaho-solutions/system/karaf/etc/
    NoteThe Karaf OSGI framework allows a user to make configuration changes which are applied in real-time to the environment when the configuration file is saved.

Configure the Pentaho Worker Nodes

Once you have enabled Worker Nodes, you must configure the orchestration method, as well as the host and event logging connections for the Worker Nodes. This task assumes you are on the server or virtual machine for your HCI instance.

Perform the following steps in the configuration file:

Procedure

  1. Navigate to the pentaho-server/pentaho-solutions/system/karaf/etc/ directory and open the pentaho.worker.nodes.cfg file with any text editor.

  2. Perform the associated action for each property listed in the table below:

    PropertyActionNotes
    orchestratorChange the value to mesos-chronos.If you wanted to return to standard Pentaho Server operation, set this property value to None.
    wn-hostnameSet the value to the IP address of the Chronos service running within your cluster. To find the IP address of your Chronos service, browse to HCI Admin App > Monitoring > Services > Scheduling Service.
    wn-portSet the value to the port number of the Chronos service running within your cluster.To find the port number of your Chronos service, browse to HCI Admin App > Monitoring > Services > Scheduling Service.
    wn-setup-environment-variablesContains the variables TRUSTED_IP, REPOSITORY_IP, and REPOSITORY_PORT. Set these values to the correct Pentaho Server IP, repository IP, and repository port number, respectively.
    wn-setup-volume-mapping Contains the hostPath.If you have installed your Foundry product in a directory other than /opt/pwnthen you will need to substitute /opt/pwn with your install path.
  3. Make the following changes for each value listed in the table below:

    VariableActionNotes
    TRUSTED_IPAdd ' ,\ ' (a comma and a backslash) after the value.
    EVENTS_SENTINEL_HOSTUncomment (remove the hashtag (#) icon) and provide the following value: IP address of the host where the Sentinel service of HCI is running. This value is located under the “# comma-separated key-value pairs of environment variables needed for Chronos job to launch a worker node” section.
    EVENTS_SENTINEL_PORTUncomment (remove the hashtag (#) icon) and provide the following value: Port where the Sentinel service of HCI is listening. The default value is 8889.This value is located under the “# comma-separated key-value pairs of environment variables needed for Chronos job to launch a worker node” section.
  4. Save and close the pentaho.worker.nodes.cfg file.

    NoteAfter the Worker Nodes are configured, all transformations and jobs submitted to the Pentaho Server are processed using Worker Nodes. To return to standard Pentaho Server operation, set the orchestrator property value to None.