Spark Submit

You can use the Spark Submit job entry in PDI to launch Spark jobs on any vendor version that PDI supports.

Using Spark Submit, you can submit Spark applications, which you have written in either Java, Scala, or Python to run Spark jobs in YARN-cluster or YARN-client mode. See the Install Pentaho Data Integration and Analytics document for more information.