General

Pentaho Data Integration

Version
9.3.x
Audience
anonymous
Part Number
MK-95PDIA003-15
  • Step name: Specify the unique name of the step on the canvas. You can customize the name or leave it as the default.

Read metadata from Copybook step

Schema

These options define the location of the copybook definition file and include mapping options for the binary data files.

Option Description
COBOL Copybook file path Specify the file path to the copybook definition file. You can enter any VFS or SFTP file path, or click Browse to open the system file browser. After selecting a file, click Validate to verify that the definition file can be accessed and parsed.
COBOL Copybook line structure Specify the line structure of the definition file:
Standard columns (6 to 72)
Select this option when the definition file contains line numbers. The first 6 columns of text from each line are ignored. Any data beyond column 72 is ignored.
Full line
Select this option when the definition file does not contain line numbers.
   

Binary format

Use these options to describe the binary format of the selected file:

Option Description
Source architecture Select the machine architecture of the binary data source files. The values are:
Big endian (mainframe)
The most significant byte first and the least significant byte last.
Little endian
The least significant byte first and the most significant byte last.
Source charset name Select the character encoding set for the binary data file.

Mainframe EBCDIC is typically encoded using IBM037 or cp1047 character sets. For more information about character sets and their aliases, see Supported Encodings in the Oracle® documentation.

Packed decimal (COMP-3) convention

Select how COMP-3 packed decimals are parsed when reading the binary data at runtime of the Copybook Input step.

Strict
Must follow the IBM S370FPD specification to avoid validation errors. Validation is performed to verify that all nibbles (half-bytes), except the sign nibble, are decimal digits (0-9). This is the default value.
  • For signed packed decimals, the sign nibble must be C (positive) or D (negative).
  • For unsigned packed decimals, the sign nibble must be F.
Lenient
Validation is performed to verify that all nibbles contain decimal digits and the sign nibble contains a hexadecimal value of A-F. The sign nibble is only used to interpret a negative number if the value is D.
Lenient - unchecked
No validation is performed on the source bytes. The sign nibble may contain any hexadecimal value 0-F, and the last nibble is not included in the result. The sign nibble is only used to interpret a negative number if the value is D.
Note: The selection of these options changes the output field_record_type field. See Example below.

Output

Use this option to include the metadata of the parent group in the definition file.

  • Extract parent groups?: Select this check box if you want to include parent group metadata in the output stream. Clear this check box to exclude parent group metadata from the output stream.