In AEL, the ORC Output step automatically converts an incoming Spark SQL row to a row in the ORC output file, where the Spark types determine the ORC types that are written to the ORC file.
Note: Some ORC types are not supported because there are no equivalent data types for
conversion in Spark.
| ORC Type Desired | Spark Type Used |
|---|---|
| Boolean | Boolean |
| TinyInt | Not supported |
| SmallInt | Short |
| Integer | Integer |
| BigInt | Long |
| Binary | Binary |
| Float | Float |
| Double | Double |
| Decimal | BigNumber |
| Char | Not supported |
| VarChar | Not supported |
| TimeStamp | TimeStamp |
| Date | Date |