cKafka

Broker List

Specify the list of Kafka message brokers in the form hostname1:port1,hostname2:port2,hostname3:port3.

Client Id

Specify an Id string of the client to pass to the server when making requests.

Topic

Type in a name for the message topic in the message broker.

GroupId

Enter the Id of the Kafka Connect cluster group.

Receive Buffer (bytes)

Specify the size of the TCP receive buffer to use when reading data. If the value is -1, the OS default will be used.

Use Schema Registry

For more information about Schema Registry, see the Confluent documentation.

This option is available when you have installed the 8.0.1-R2023-10 Talend Studio Monthly update or a later one delivered by Talend. For more information, check with your administrator.

The following options are available only when the cKafka is used as a Producer:

Partitioner

Enter the partitioner that determines how data is distributed across the Kafka cluster.

Serializer Class

Enter the class name of the serializer to be used.

Key Serializer Class

Enter the class name of the key serializer to be used.

Compression Codec

Select compression type from NONE, GZIP, SNAPPY, and LZ4.

The following options are available only when the cKafka is used as a Consumer:

Auto Commit Enable

Select this check box to periodically commit the offset of messages in the background. Specify the frequency in milliseconds in the Auto Commit Interval (ms) that the consumer offsets are committed to Kafka.

Auto Offset Reset

Choose what to do when there is no initial offset in Kafka or if the current offset does not exist any more on the server from the following:

• EARLIEST: automatically reset the offset to the earliest offset;

• LATEST: automatically reset the offset to the latest offset;

• NONE: throw exception to the consumer if no previous offset is found for the consumer's group.

Set the optional arguments in the corresponding table. Click [+] as many times as required to add arguments to the table. Then click the corresponding value field and enter a value. See the sitehttp://kafka.apache.org/documentation.html for available options.

SSL Key Password

Click [...] and enter the password of the private key in the key store file in double quotes.

SSL Keystore Location

Enter the location of the key store file.

SSL Keystore Password

Click [...] and enter the password for the key store file in double quotes. This is only needed if SSL Keystore Location is configured.

SSL Truststore Location

Enter the location of the trust store file.

SSL Truststore Password

Click [...] and enter the password for the trust store file in double quotes.

SSL Cipher Suites

Enter the list of cipher suites. This is a named combination of authentication, encryption, MAC and key exchange algorithm used to negotiate the security settings for a network connection using TLS or SSL network protocol. By default all the available cipher suites are supported.

SSL Endpoint Algorithm

Enter the endpoint identification algorithm to validate server hostname using server certificate.

Kerberos Service Name

Enter the Kerberos principal name that Kafka runs as.

Security Protocol

Select the protocol to use to communicate with brokers from Plaintext, SSL, SASL over Plaintext, and SASL over SSL.

Usage rule

Limitation

n/a