Options tab

Pentaho Data Integration

Version
9.3.x
Audience
anonymous
Part Number
MK-95PDIA003-15

Options tab, Copybook Input step

Use this tab to define PDI output stream options.

Output record information

Use this section to specify details about the records for output.

Option Description
Store record as a binary field Specify an additional output field to contain the binary bytes that make up the record currently being processed. You can use the stored binary field as the input for the data fields downstream from the Copybook Input step.
Create field with record number Specify an additional output field to contain the record number within the file. For fixed-length record definitions, multiplying this number by the fixed record size yields the offset of the record within the input file. This field will reset to zero when a new data file is read. Also, the counter is specific to a copy of the step, so changes to the Change Number of Copies to Start option may cause unexpected results.
Create field with record checksum Specify an additional output field to contain a hex string representation of the sha1 checksum of the source record byte data.
Note: This option is useful for debugging conversion errors, but it could be resource intensive.

Conversion errors

Use this section to specify how to handle errors during conversion.

Ignore conversion errors
Select this check box to log multiple conversion error messages such as malformed records, bad enclosure strings, wrong number of fields, and premature line ends. The errors are logged in JSON object format in a single PDI row. See Use Error Handling for details about the format.

Clear this check box if you want conversion errors in the source binary files to stop the transformation.