Skip to main content Skip to complementary content

Talend Data Catalog Application

New features and improvements

Feature Description

New feature: Model / Open in Tool / Snowflake

MM ExternalViewers: added support for Snowflake

REST API: multiple improvements

  • dataClasses/{objectId}: fixed the schema definition of DataClassWithStatus for the function /repository/dataClasses/{objectId} output, so threshold attributes would be included in the schema definition.
  • dataClasses: added the missing data class thresholds attributes and data types to allow thresholds attributes to be exported through the function.

Setup.bat: [x] enable all IP addresses for WebApp

Added security option "Enable all IP addresses for WebApp" to Setup.bat.

Relationships: improve state management of the Object selector

Object selector now remembers the previous filters that were used in the Search tab.

Any bridge: Deprecation / MIMB and MM Web Application Impact

Bridges: added support for deprecated parameters in the infrastructure and in the UI. Deprecated parameters will not be shown in the UI but will be supported for those who have hard-coded them.

Application: added support for deprecated import/export bridge parameters in the infrastructure and in the UI. Deprecated parameters will continue to appear with their values in the configuration manager UI as long as they are populated. They will disappear as soon as they are cleared out and saved.

Data Profiling / MQL: support for Null, Blank, and Zero

Added Null, Blank and Zero data profiling KPI attributes in MQL and REST API.

Manage / Email Notification: UI change

Moved the Manage Email Notification menu to a new tab called Manage Tool Integration (in order to reuse the Manage > Tool Integration > General > MM Public URL).

Manage / Tool Integration / General: MM public URL

Added the ability to set the Metadata Management (MM) external URL and use it everywhere else to manage email, browser extensions, etc.

By default, the URL is populated with any previous email URL setup, otherwise the current MM server URL.

Manage / Repository or Configuration: attribute panel field is not updated with new name when a model is renamed

The Source Model Name attribute was removed from the details page of custom models, as it should always be the same as the one defined in Manage Repository.

Worksheets: Snowflake tags not available as UDP

Supported Snowflake UDPs in worksheets. Please reimport the models that have UDPs.

Data Flow: clicking or double clicking on an UI element while the Details panel is open triggers a JavaScript error

Fixed a bug where the UI was trying to refresh a destroyed widget.
Data Flow / Lineage Diagram: performance issues when over 10,000 nodes and links are involved

Fixed a performance issue occurring when a graph had big nodes set. A warning message will now display and the graph will filter to depth 1.

Manage / Tool Integration / Browser Extension: Snowflake

Implemented a URL parser prototype for Snowflake.

Manage / Tool Integration / Browser Extension: improve side pane header

Improved the Chrome extension header.

Manage / Tool Integration / Browser Extension / Content widget: show list of documented report items

Improved the browser extension to show the list of source data objects.

Data Flow / Lineage Diagram: performance options for overview type diagrams

Changed the overview diagram warning message to "has old views" and hid the Depth filter.

Manage / Tool Integration / Chrome Extension: can't open more than one side panel

Fixed a bug preventing opening more than one side panel.

Custom Model / CSV import: bulk import

Added a bulk operation to export all the models under the given MM folder into CSV.

Data Flow / Related Report: stick to specified object

Disable recursive lineage trace when computing the list of related reports.

Manage / License: enable Data Quality (DQ) import bridges in Talend Data Catalog (TDC)

Added Data Quality bridges to Talend license.

New feature: Manage / Tool Integration / Browser Extension / Side Panel auto-refresh option for selected technologies like Snowflake

Added automatically panel refresh on URL change.

Data Quality / Status: rename from Successful/Acceptable/Failed to Good/Acceptable/Bad

Renamed some of the Data Quality status values for consistency.

Data Flow / Lineage Diagram and Related Report: the backend takes 2 minutes on any fact detail tables

New options to better control the size of the lineage trace produced by the backend.

New feature - Data Quality: predefine conditional labels for Data Quality

New conditional labels for Data Quality.

Manage / Cloud Identity: changes to original bridge parameters

Preserve the original text of the parameter if it is not already set.

Overview / Data Flow widget: widget should not be expanded by default to prevent it to call the backend automatically

Data Flow widget is now collapsed by default.

Data Quality / Data Sampling and Profiling: missing column

Fixed data sampling in the DQ sample CSV files.

Deployment / Icons / Bundle more SVG icons in conf/MIRProfiles/icons

Added new icons to the MIMM and TDC installers

Data Flow / Large Lineage graph doesn't prompt that the diagram is too big anymore

Fixed the code to prompt again

Data Flow / Optimize graph JSON structure to be smaller

Improved network transfer performance and memory consumption

New feature:

Manage / Conditional Labels / Export and Import (limited to append, no update or delete)

Added Import/Export support to manage conditional labels

External Icon Servlet / Add support for converting the image to png

Added a new URL parameter for the icon servlet to force converting an image to png

Data Flow / Lineage Diagram / Opening the diagram with a depth of 1 seems to return too many objects

Fixed Depth filter in diagram

Manage / Cloud Identity / Cleanup log messages

Moved CloudIdentity messages from user's log into debug log

   

Notable fixes

Issue Description

Manage / Tool Integration / Email: error when batch time has large variable value in Notification Settings

Added a max value to the input fields to prevent the error.

Worksheets / Filter: "exists" filter shows empty results for Data Quality Status and Data Quality Score

Handle features that have data profiling/sampling only, i.e. without any data quality information.

Manage / Worksheets: error when leaving worksheet without saving

Fixed the javascript error.

Dashboards / Home Dashboards: configuration being ignored with home dashboards

Fixed a bug where Home dashboards created by users were automatically assigned to them or application administrators as home page, even though they didn't assign themselves as viewers.

Diagram: Show Term Definitions produces incorrect diagram

Fixed incorrect graph view after term definitions are shown.

Manage / Tool Integration / Browser Extension: problem parsing the tool URL

Fixed the URL parsing issue.

Deployment / Search / Solr: syntax exception

Fixed a Solr SyntaxException.

Dashboards: images are being lost

Fixed the garbage collection of images during database maintenance.

Search: cannot see search results for "Data Quality Latest Score" with decimal number

Filter now supports decimal numbers.

Data Quality search: remove DQ Metamodel from search results

DQ models are removed from the search scope unless explicitly indicated in a top-level (i.e. ANDed) category filter or "Object Type" filter.

Data Quality: support for multiple DQ models is preventing search from returning results when Data Quality Status is "exist"

Fixed the search query to exclude rows without Data Quality Status when a "Data Quality Latest Status=exists" filter is used.

Search: the number of objects in search results doesn't match the number displayed in the Model filter

Fixed the problem that the facet count of the model does not correspond to the number of objects returned by the Model filter.

Search: operator "Before" doesn't show results after operator "Between" for Data Quality Latest Date filter

Fixed the processing of the operator.

Search: Model Facet filter produces unsorted results

Fixed the order of the Model Facet results.

Search / Filters: Model Facet throws a Java exception when there is no category filter

Fixed the Java exception with the Model Facet.

Data Flow / Diagram: error when clicking "Show Lineage Details"

Fixed the JavaScript exception.

Collections / Bulk Update / Comments: adding a comment to over 5,000 objects

Changed the UI to apply the changes to only 10 objects at a time in a loop, allowing the user to cancel. This won’t improve the overall processing time but will allow the user to know the current progress and to cancel.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!