tDataShuffling

Shuffles the data from in an input table to protect the actual data while having a functional data set. Data will remain usable for purposes such as testing and training.

tDataShuffling replaces original values with other values for the same column from a different row.

If you define one or several columns as the partition group, the whole table is split into a given number of partitions. These partitions share the same values in the columns partitioned. Then, the shuffling process is applied independently to each partition. All partitions are merged into one output table.

If you do not set columns as the partition group, the shuffling process is applied to the whole input table.

In local mode, Apache Spark 2.4.0 and later versions are supported.

This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.