Perform the following steps to specify the
parameter in PDI using an
environment variable.
-
From the Edit menu, select Set Environment
Variables.
The Set Environment Variables table
appears.
-
Enter the following information:
-
In the Name column, type
spark.hadoop.validateOutputSpecs.
-
In the Value column, type
false.
-
Click OK to activate the parameter.
You can verify it is active in the transformation logging.
For more information about processing Spark parameters, see the Administer Pentaho Data Integration and Analytics document.