Skip to main content
Pentaho Documentation

Configure Logging Data Collection

For each job or transformation, use this procedure to configure which logging data you would like to collect.

You must set the global logging variables for your database or table in advance. See Setting Global Logging Variables for information about how to set global logging variables for transformations and jobs. If you have already set the global logging variables, start at Step 6 to specify an input and output step for each transformation that collects external input or output data.

  1. From within Spoon, open a job or transformation.
  2. Select the View tab, then right-click the job or transformation and select Settings.
  3. Select the Logging tab and choose the appropriate selection from the left pane.
    • For jobs, select Job.
    • For transformations, select Transformation.
  4. In the Log Connection field, enter or select the appropriate database connection. Using the provided samples, select the connection named live_logging_info.
  5. In the Log table name field
    • For jobs, enter LOG_JOB.
    • For transformations, enter LOG_TRANS.
  6. In order to collect row input or output information for jobs or transformations, for instance for throughput calculations, specify an input and output step for each transformation that collects external input or output data.
    • For LINES_INPUT, specify the step collecting external input data.
    • For LINES_OUPUT, specify the step collecting output data.
  7. Ensure all entries under Log table fields are selected. If the LOG_JOB or LOG_TRANS table has not been created for the specified database, click the SQL button and then click the Execute button in the subsequent dialog box.
  8. Click OK until you return to the Job/Transformation properties dialog box.
  9. From the Monitoring tab, check the box labeled Enable step performance monitoring? Click OK to exit the dialog box, then save the job or transformation.
The DI Operations Mart is configured to collect ETL logging data.