You can specify what fields to read from your S3 file through the fields table.
- Click Get Fields to have the step populate the table with fields derived from the source file based on the current specified settings (such as Delimiter or Enclosure). All fields identified by this step will be added to the table.
- Click Preview to view the data coming from the source file.
The table contains the following columns:
| Column | Description |
|---|---|
| Name | Specify the name of the field. |
| Type | Select the field’s data type from the dropdown list or enter it manually. |
| Format | Select the format mask (number type) from the dropdown list or enter it manually. See Common Formats for information on common valid date and numeric formats you can use in this step. |
| Length | Specify the length of the field, according to the following field types: |
| Precision | Specify the number of floating point digits for number-type fields. |
| Currency | Specify the symbol used to represent currencies. For example: $ or € |
| Decimal | Specify the symbol used to represent a decimal point, either a
period "." or a comma ",". For example: 5,000.00 or 5.000,00 |
| Group | Specify the method used to separate units of thousands in number
of four digits or larger, either a period “.” Or a comma
“,”. For example: 5,000.00 or 5.000,00 |
| Trim type | Select the trimming method (none, left, right, both) to apply to a string, which truncates the field before processing. Trimming only works when no field length is specified. |
See Understanding PDI data types and field metadata to maximize the efficiency of your transformation and job results.