Talend Cloud Data Catalog and Talend Data Catalog Bridges

Data Mapping Script: updated bridge documentation

Added an FAQ regarding data mapping scripts and 2 file type models.

Any Database import: improved SQL parsing to better support function calls lineage

Improved the parser that has option supportFunctionCalls set to true in order to build lineage for the built-in functions.

-connection.cast "UNKNOWN"="MICROSOFT SQL SERVER"

All Talend Data Catalog licenses

Salesforce (SFDC) Database: keep field order same as its original source order

Added code to set Position value to MIRAttribute.

All Talend Data Catalog licenses

Snowflake Database (via JDBC): support for connections at Database.Schema level

Added connection splitting through the miscellaneous parameter.

All Talend Data Catalog licenses

Amazon Web Services (AWS) Simple Storage Service (S3) File System: support for platforms compatible with AWS S3

Added miscellaneous option -custom.url to specify custom URL to access buckets on stores compatible with AWS S3.

Looker Server: moved to API v4 as v3 is deprecated

The Looker Server bridge is now using API v4.0 by default.

Added miscellaneous option -api.version to allow backward compatibility with API v3.1.

Microsoft Power BI (File): no connection for Databricks source

Added support for PowerQuery function Databricks.Catalogs().

Microsoft Azure SQL Database (via JDBC): "Error occurred during initialization of VM" when log message Type code is set to NONE

Fixed the issue by using java.exe instead of javaw.exe.

All Talend Data Catalog licenses

Microsoft Azure Data Lake Storage Gen2 File System: the miscellaneous parameter -partitions.latest does not import the latest modified files

Improved partitioned files modified time processing.

Oracle Database (via JDBC): java.lang.IllegalArgumentException for function HR.EMP_ADMIN.HIRE_EMPLOYEE

Fixed IllegalArgumentException when parsing package members in Oracle.

All Talend Data Catalog licenses

Oracle Database (via JDBC): miscellaneous option -package.filter filters out all packages

Added description of how to use double quotes in the miscellaneous parameter in the bridge documentation.

All Talend Data Catalog licenses

Talend Data Integration: unable to define both source and destination

All Talend Data Catalog licenses

SAP BusinessObjects: fewer database connections imported and the names are not consistent

Restored the unknown connection, which is sometimes needed when parsing SQL Expression Fields.

QlikView: wrong lineage between Partitioned Folder dataset columns

Fixed lineage by changing MIRLineageOptions to BY_NAME for QVD files when the miscellaneous option has qvd.as.file.

Hadoop Hive (via JDBC): stopped responding for a long time

Optimized expression analyzer.

All Talend Data Catalog licenses

Talend Data Integration: unsupported source attribute and expression syntax

Improved tSetGlobalVar processing of input schema. Schema columns are exposed as parameters with 0 value by default. Parameter files can be used to override these parameters with meaningful values.

Added support for INTO TEMP syntax in Redshift expression parser.

All Talend Data Catalog licenses

Hadoop Hive (via JDBC): insecure Log4j from Maven (after MIMBRN-2954)

Removed insecure Log4j dependency following the update on MIMBRN-2954.

All Talend Data Catalog licenses

QlikSense: QVD files were duplicated when imported with the -qvd.as.file option

Fixed duplicate QVD files with -qvd.as.file option when the same QVD file names are in different cases.

All Talend Data Catalog licenses

Informatica Big Data Management (BDM) Developer Repository: there is only one folder out of all the harvested folders

Fixed multiple projects filters.

QlikSense Cloud: "Consistency: StoreContent: there already exists an object with the native id"

Fixed the issue.

To distinguish applications with the same names in the same space, you have to use the application ID.

QlikSense Cloud: java.lang.NullPointerException

Improved handling of inaccessible logs.

The bridge fails if execution logs are not accessible. If the script execution log is not required, you may specify -log.notavailable in the miscellaneous parameter. It is strongly recommend to import with accessible execution logs.

All Talend Data Catalog licenses

Amazon Web Services (AWS) Athena Database (via JDBC): incremental harvesting does not work

All Talend Data Catalog licenses

Apache Atlas: columns not extracted

Fixed the issue.

Amazon Web Services (AWS) Glue ETL (via Apache Spark): missing stitching for some scripts

Added support for merging Python dictionaries.

SAP Business Suite 4 HANA (S/4HANA), ECC, R/3 ERP: no metadata created when subsetting

Improved subsetting algorithm.

All Talend Data Catalog licenses

MicroStrategy: error "MITI.MIRException: The Model is not consistent" occurred when the "Import schema only" option is set to false

Changed fail-safe code to avoid consistency error if an attribute related to hierarchy is not imported.

MicroStrategy: import stopped responding while running the bridge

Moved the closing MSTR session to the end of the last project import.

Fixed importing attributes with multiple source tables when importing more than one project.

Oracle OBIEE: shows incorrect parent for the "Sample KPI" report

Improved handling of KPI report name.

OpenAPI Specification (OAS): "MVLD_E0023 Consistency: Element 'Attribute' with ID <>/[Attribute] has no name"

Added support for reusable parameters for OpenAPI 2.0.

Tableau: custom SQL query not extracted

In expression parser for Snowflake, added a built-in function "DATE".

All Talend Data Catalog licenses

Talend Data Integration: Snowflake connection parsing errors

All Talend Data Catalog licenses

Data Mapping Script: expression syntax is not recognized and some lineage metadata is not available

Fixed error caused by the file connections that point out to the same root directory.

QlikSense Cloud: Java process did not complete successfully

Changed building of WebSocket URI to fix the case when the bridge option Cloud URL does not end with /.

All Talend Data Catalog licenses

Salesforce (SFDC) Database: field description fetched by the bridge is extracted from the label attribute instead of the description attribute

All Talend Data Catalog licenses