tCassandraOutputBulk
Prepares an SSTable of large size and processes it according to your needs before loading this SSTable into a column family of a Cassandra keyspace.
The tCassandraOutputBulk and tCassandraBulkExec components are generally used together as parts of a two step process. In the first step, an SSTable is generated. In the second step, this SSTable is written into Cassandra. These two steps are fused together in the tCassandraOutputBulkExec component, detailed in a separate section. The advantage of using two separate components is that the data can be transformed before it is loaded into Cassandra.
tCassandraOutputBulk receives data from the preceding component, and creates an SSTable locally.
This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.
tCassandraOutputBulk Standard properties
These properties are used to configure tCassandraOutputBulk running in the Standard Job framework.
The Standard tCassandraOutputBulk component belongs to the Big Data and the Databases NoSQL families.
The component in this framework is available in all Talend products with Big Data and in Talend Data Fabric.
Basic settings
|
Property type |
Either Built-In or Repository. Built-In: No property data stored centrally. Repository: Select the repository file where the properties are stored. |
|
Schema and Edit Schema |
A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields. Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:
|
|
|
Built-In: You create and store the schema locally for this component only. |
|
|
Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs. When the schema to be reused has default values that are integers or functions, ensure that these default values are not enclosed within quotation marks. If they are, you must remove the quotation marks manually. For more information, see Retrieving table schemas. |
|
Table type |
Select the type of the data model to be used for the table to be created. It can be CQL (actually CQL3) or non-CQL (the legacy thrift-based API of Cassandra before CQL3). This drop-down list is available only when the DB version you are using is Cassandra 2.0.0 (deprecated). For the Cassandra versions later than 2.0.0, CQL becomes the only model used by this component and so this list is no longer available. |
|
DB Version |
Select the Cassandra version you are using. |
|
File name |
Type in the name of file into which you want to write the SSTable. |
Advanced settings
|
tStatCatcher Statistics |
Select this check box to gather the Job processing metadata at the Job level as well as at each component level. |
Global Variables
|
Global Variables |
ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box. A Flow variable functions during the execution of a component while an After variable functions after the execution of the component. To fill up a field or expression with a variable, press Ctrl+Space to access the variable list and choose the variable to use from it. For more information about variables, see Using contexts and variables. |
Usage
|
Usage rule |
This component always needs an incoming link. |