The table below describes options for configuring the properties of the fields being written for Parquet data.
| Column | Description |
|---|---|
| Parquet Path | Specify the name of the column in the Parquet file. |
| Name | Specify the name of the PDI field. |
| Parquet Type | Specify the data type used to store the data in the Parquet file. |
| Precision | Specify the total number of significant digits in the number (only applies to the Decimal Parquet type). The default value is 20. |
| Scale | Specify the number of digits after the decimal point (only applies to the Decimal Parquet type). The default value is 10. |
| Default value | Specify the default value of the field if it is null or empty. |
| Null | Specify if the field can contain null values. |
| Get Fields (button) | Click to retrieve a list of fields from the input stream. |
Note: To avoid a transformation failure, make
sure the Default value field contains values for all fields where
Null is set to No.
You can define the fields manually, or you can click Get Fields to automatically populate the fields. When the fields are retrieved, a PDI type is converted into an appropriate Parquet type, as shown in the table below. You can also change the selected Parquet type by using the Type drop-down menu or by entering the type manually.
| PDI Type | Parquet Type |
|---|---|
| InetAddress | UTF8 |
| String | UTF8 |
| TimeStamp | TimestampMillis |
| Binary | Binary |
| BigNumber | Decimal |
| Boolean | Boolean |
| Date | Date |
| Integer | Int64 |
| Number | Double |