Joining movie and director information using an Apache Spark Batch Job
This scenario demonstrates:
-
How to create a Talend Job for Apache Spark Batch. See Creating the Spark Batch Job for details.
-
How to drop and link the components to be used in a Spark Batch Job. See Dropping and linking Spark components for details.
-
How to configure the input components using the related metadata from the Repository. See Configuring the input data for details.
-
How to configure the transformation to join the input data. See Configuring the data transformation for details.
-
How to write the transformed data to ADLS. See Writing the output to Azure ADLS Gen1 for details.