Set up job logging

Pentaho Data Integration

Version
9.3.x
Audience
anonymous
Part Number
MK-95PDIA003-15

Follow the instructions below to create a log table that keeps a history of information associated with your job information.

  1. Ask your system administrator to create a database or table space called PdiLog.
  2. Right-click in the workspace (canvas) where you have an open job and select Properties, or press CTRL T .
    The Job properties dialog box appears.


    Job properties dialog box

  3. In the Job properties dialog box, click the Log tab. In the left-side navigation pane, select which type of logging you want to use.

    Log tab
  4. In the Log tab, enter the following information.
    Option Description
    Log Connection

    Specify the database connection you are using for logging. You can configure a new connection by clicking New.

    Log schema Specify the schema name, if supported by your database.
    Log table

    Specify the name of the log table.

    Note: If you are also using transformation logging, use a different table name for jobs.
    Logging interval (seconds)

    Specify the interval in which logs are written to the table.

    This property only applies to Job log table logging type.

    Log line timeout (days)

    Specify the number of days to keep log entries in the table before they are deleted.

    If you find that data in the log table is not deleted as expected, see Log table data is not deleted in Troubleshooting for best practice information.

    Log size limit in lines

    Enter the limit for the number of lines that are stored in the LOG_FIELD. PDI stores logging for the job in a long text field (CLOB).

    This property only applies to Job log table logging type.

  5. Select the fields you want to log in the Log table fields pane, or keep the default selections.
    Note: For effective deletion of expired logs, the LOGDATE, and JOBNAME (or TRANSNAME) fields in the Log table fields pane are enabled by default.
  6. Click the SQL button.
    PDI checks the log table.
  7. If the Simple SQL editor opens, proceed to the next step. If it does not open, go to step 10.
  8. Verify your table name, field selections and indices in the Simple SQL editor, and then click Execute to create your log table.
    PDI creates or revises the table and displays the results in the Results dialog box.
  9. Click OK to exit the Results dialog box. Click Close to exit the Simple SQL editor.
  10. Click OK to exit the Job properties dialog box.
The next time you run your job, logging information will appear under the History tab.
Note: Monitoring the LOG_FIELD field can negatively impact Pentaho Server performance. However, if you do not select all fields, including LOG_FIELD, when configuring transformation logging, you will not see information about this transformation in the Operations Mart logging.