Transforming a list of files as data flow

The following scenario describes a Job that iterates on a list of files, picks up the filename and current date and transforms this into a flow, that gets displayed on the console.

• Drop the following components: tFileList, tIterateToFlow and tLogRow from the Palette to the design workspace.

• Connect the tFileList to the tIterateToFlow using an iterate link and connect the Job to the tLogRow using a Row main connection.

• In the tFileList Component view, set the directory where the list of files is stored.

• In this example, the files are three simple .txt files held in one directory: Countries.

• No need to care about the case, hence clear the Case sensitive check box.

• Leave the Include Subdirectories check box unchecked.

• Then select the tIterateToFlow component et click Edit Schema to set the new schema

• Add two new columns: Filename of String type and Date of date type. Make sure you define the correct pattern in Java.

• Click OK to validate.

• Notice that the newly created schema shows on the Mapping table.

• In each cell of the Value field, press Ctrl+Space bar to access the list of global and user-specific variables.

• For the Filename column, use the global variable: tFileList_1CURRENT_FILEPATH. It retrieves the current filepath in order to catch the name of each file, the Job iterates on.

• For the Date column, use the Talend routine: Talend Date.getCurrentDate() (in Java)

• Then on the tLogRow component view, select the Print values in cells of a table check box.

• Save your Job and press F6 to execute it.

The filepath displays on the Filename column and the current date displays on the Date column.