On the File tab, you can define basic properties about the file being created by this step.
| Option | Description |
|---|---|
| Filename |
Specify the file name and location of the output file. Click
Browse to display the Open File
window and navigate to the file or folder. For the supported file system types,
see Connecting to Virtual File Systems. Spark attempts to create a new
directory structure based on the name entered. The new directory structure
contains subdirectories and CSV files corresponding to the processing results. For
example: /_SUCCESS, PART-00000-.CSV, PART-00001-.CSV, and so forth.
CAUTION: If a directory with the name
specified in this field already exists, Spark will not overwrite it and the
transformation aborts. To process, you must specify a different directory name
OR delete the existing directory structure, including all the subdirectories and
files contained within it.
If you are using this step to write data to Amazon Simple Storage Service (S3), specify the URI of the S3 system. Both S3 and S3n are supported. When the date and time are to be appended, do not include a file extension. |
| Pass output to servlet | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| Create Parent folder | This option is ignored by the Spark engine. Spark attempts to create a new directory structure based on how it processes the Filename. |
| Do not create file at start | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| Accept file name from field? | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| File name field | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| Extension | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| Include stepnr in filename? | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| Include partition nr in filename? | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
| Include date in filename? | Select to include the system date in the file name (_20181231, for example). |
| Include time in filename? | Select to include the system time in the file name (_235959, for example). |
| Specify Date time format | Select to include the date time in the file name using a format from the Date time format drop-down list. |
| Date time format | Select the date time format. |
| Add filenames to result | This field is either not used by the Spark engine or not implemented for Spark on AEL. |
Click Show filename(s) to display a list of the files that will be generated. This is a simulation and depends on the number of rows that go into each file.