In AEL, the ORC step automatically converts ORC rows to Spark SQL rows. The following table lists the conversion types.
ORC Type | Spark SQL Type |
---|---|
Boolean | Boolean |
TinyInt | Short |
SmallInt | Short |
Integer | Integer |
BigInt | Long |
Binary | Binary |
Float | Float |
Double | Double |
Decimal | BigNumber |
Char | String |
VarChar | String |
Timestamp | Timestamp |
Date | Date |