If you have a transformation that contains the Catalog Input, Catalog Output, Read Metadata, or Write Metadata steps, there may be instances when a complete search of the records in Data Catalog is not performed. This error can occur if:
The default limit provided to prevent PDI from exceeding memory limits or stop connection timeouts to PDC is too short for your environment.
To resolve this issue:
- Design your transformation.
- Right-click on the canvas to open the Transformation properties dialog box.
- In the Parameters tab, add the following parameter:
catalog-result-limit
- In the Default Value column, enter a number greater than the default value of 25, for example 500.
- Run your transformation.
Note: The behavior of this parameter does not directly control the records received from Data Catalog, but rather it works to limit the sub-queries used to retrieve those records. Therefore, you may need to make additional adjustments to establish the correct limit for your environment.