Skip to main content
Pentaho Documentation

Get Records from Stream

This step returns records that were previously generated by another transformation in a job. The records were passed to this step using either the Copy rows to result step or the Transformation Executor step. You can enter the metadata of the fields you are expecting from the previous transformation in a job.

This step produces one or more rows and cannot be placed within a stream. It must be the first step in a stream since it produces rows. If you want to add this data to an existing stream, you need to use a join step.

General

  • Step Name: Specifies the unique name of the Get Records from Stream transformation step on the canvas. You can customize the name or leave it as the default.

Options

PDITrans_GetRecordsFromStream.png

Option Description

Fieldname

Name of the field that contains the records from the previous result.

Type

Type of data. Options include:

  • Number
  • String
  • Date
  • Boolean
  • Integer
  • BigNumber
  • Serializable
  • Binary
  • Timestamp
  • Internet Address

Length

  • For a field with the type of ‘Number’, enter the total number of significant figures in a number.
  • For a field with the type of ‘String’, enter the total length of the string.
  • For a field with type of ‘String’, enter the length of output of the string.

Precision

For a field with the type of ‘Number’, enter the number of floating point digits. Otherwise, leave blank.

 

There is no validation performed on this metadata; it is intended as an aid during design.

Metadata Injection Support

All fields of this step support metadata injection. You can use this step with ETL Metadata Injection to pass metadata to your transformation at runtime.

See Also

Kafka Consumer