When used with the Spark engine, the Parquet Input step automatically converts Parquet rows to Spark SQL rows. The following table lists the conversion types:
| Parquet Type | Spark Type Output |
|---|---|
| Boolean | Boolean |
| Int8 | Short |
| Int16 | Short |
| Int32 | Integer |
| Int64 | Long |
| Int96 | Timestamp |
| UInt8 | Short |
| UInt16 | Short |
| UInt32 | Integer |
| UInt64 | Long |
| Binary | Binary |
| FixedLengthByteArray | Binary |
| Float | Float |
| Double | Double |
| Decimal | BigNumber |
| UTF8 | String |
| VarChar | String |
| TimeMillis | Timestamp |
| TimestampMillis | Timestamp |
| Date | Date |