Fields tab

Pentaho Data Integration

Version
9.3.x
Audience
anonymous
Part Number
MK-95PDIA003-15

Fields tab in Kinesis Consumer step

Use this tab to define the fields in the record format.

Option Description
Input name
The input name is received from the Kinesis streams. The following are received by default:
message
The individual message contained in a record. Each record consists of a sequence number, a partition key, and a message.
partition key
Used to group data by shard within a stream. The partition key is associated with each data record to determine which shard a given data record belongs to.
sequence number
A sequential ID number assigned to each record. It uniquely identifies each record within the partition.
subsequence number
Because all subrecords within a record have the same sequence number, additional data is stored with the checkpoint if you need to distinguish between subrecords. This additional data is the subsequence number.
shard id
The unique identifier of the shard within the stream.
Output name The Output name can be mapped to subscriber and member requirements.
Type
The Type field defines the data format for streaming the record. You must choose the same data type that produced the records. This field applies to the message input names. Options include:
  • String
  • Boolean
  • Number
  • Integer
  • Binary

The default value is String.