Semarchy xDI 2023.2 Release Notes

This document provides the latest information about Semarchy xDI version 2023.2, including new features and Bug Fixes.

Support information

Semarchy xDI version 2023.2 is a mainstream support (MS) release.

MS product versions are released throughout the year. They showcase the latest features and enhancements, and will receive active support for a limited period.

Alternatively, long-term support (LTS) versions offer a longer maintenance period with patches and fixes, and benefit from extended support.

For more details about our releases and support policies, see our Support and maintenance terms.

Feature Highlights

Docker Images for Production Deployments

Semarchy xDI 2023.2 now ships with official Docker images to deploy its production components: Analytics, Runtime, and License Server. These images, available on Docker Hub, are regularly updated with the latest features, as well as the security and corrective fixes issued by Semarchy. These images come with a sample compose file to deploy a multi-container xDI infrastructure.

Using these images, administrators and infrastructure managers can deploy and upgrade xDI using their production-grade container orchestrator, while relying on officially maintained and always up-to-date images.

AWS S3 Delivery Repository

A new type of delivery repository is introduced in this release for Amazon Web Services users, to store their deliveries in AWS S3 buckets. This new delivery repository type brings AWS users a feature also available with Google Cloud Platform (GCP) Storage.

Using AWS S3 Delivery Repositories, administrators and infrastructure managers can better integrate xDI with AWS and maximize their investments in the Cloud.

Greenplum and PostgreSQL Deserializers

A major improvement to the mappings design experience introduced in 2023.1 is the Deserializer, allowing users to integrate semi-structured JSON data contained in table columns. This capability came with generic templates. Semarchy xDI 2023.2 expands this capability with dedicated templates to de-serialize JSON data using Greenplum and PostgreSQL native capabilities.

Using these deserializers, data integration developers can simply manipulate semi-structured data using xDI’s no-code universal mapping, and benefit from optimal performances for their integration flows.

Converters

Customers using Oracle Data Integrator, Informatica PowerCenter or IBM DataStage can now migrate their data integration design-time assets from legacy ETL tools to Semarchy xDI, using Semarchy-designed Converter tools.

The Converters are critical in migration projects, handling the bulk conversion of legacy ETL flows in the universal mapping design approach and optimizing them for the ELT architecture.

These converters simplify the move from legacy and outdated tools to xDI, reducing the re-development or migration of existing data integration assets from years to weeks.

Converters are available on demand. Please contact your Semarchy account representative for more information.

Noticeable Changes

System Requirements

The following changes have been made to the system requirements:

  • Semarchy xDI Runtime support for MySQL to store the logs and/or scheduler configuration is removed in this version.

  • Semarchy xDI Runtime and License Server support for JDK 8 is removed in this version.

See the System Requirements for more information.

The next Semarchy xDI mainstream version 2023.3.0 (MS) will introduce JDK 17 support for all the products. It will be the only supported JDK for this version.

Installation

  • The installation of the Semarchy xDI Runtime as a Windows Services (using the installEngineAsService script) is deprecated. We recommend using the official container images and leverage containerized deployment capabilities for services.

  • The installation of the License Server as a Windows Services (using the serviceInstall script) is deprecated. We recommend using the official container images and leverage containerized deployment capabilities for services.

  • The Native Clustering capabilities of the Semarchy xDI Runtime are deprecated and will be removed in the 2023.3 release. We recommend using the official container images instead and leveraging containerized deployment capabilities for load balancing and failover.

  • The Semarchy xDI Runtime Scheduler configuration file properties/engineScheduler.properties is now provided by default and mandatory when using the built-in scheduler.

Breaking Changes

The thread count for the runtime thread pool has been changed from 50 to 3. When upgrading, make sure you are not using the old value.

Changelog

2023.2.0

Semarchy xDI Designer

Bug Fixes

  • DI-6324: When using Kafka structured as a source, the Load Kafka Structure to RDBMS template does not create the Load_Temporal table and an insert error occurs at the integration step.

  • DI-7155: A ConcurrentModificationException error is thrown when multiple mapping builds run simultaneously.

  • DI-7213: The copy-paste operation between mappings generates a copy with the expression using the wrong datastore name.

  • DI-7214: When the alias of the deserializer is changed, it is not taken into account.

  • DI-7215: When creating a deserializer by the context menu, the input field is not mapped automatically.

  • DI-7224: When building documentation from a mapping, the templates are not displayed in the documentation and the files are not created in the specified folder.

  • DI-7280: In a mapping, when one of the joins is conditionally activated from the Advanced finger tab of the Property view, all the other joins in the mapping are also activated using the same condition.

Semarchy xDI Runtime

Breaking Changes

  • DI-7343: Semarchy xDI Runtime support for JDK 8 is removed in this version.

  • DI-6881: Semarchy xDI Runtime support for MySQL to store the logs and/or scheduler configuration is removed in this version.

New Feature

  • DI-6014: New Semarchy xDI Runtime image available in Docker Hub.

  • DI-7644: In addition to the enigineParameters.xml file, a standalone file can also be used to define the external value resolver configuration.

  • DI-6352: Delivery repository storage in Amazon S3.

  • DI-7101: A default engineScheduler.properties configuration file is added to the properties folder.

Bug Fixes

  • DI-7220: Deliveries cannot be run from analytics when connecting to the runtime using the RMI protocol.

  • DI-7225: Statistics are not displayed when the mapping name contains the à character.

  • DI-7631: Runtime commands returning session information fail with a null error message.

  • DI-7650: Runtime user roles no longer work.

  • DI-7695: It is not possible to define an empty configuration in an external value resolver standalone file.

Semarchy xDI Production Analytics

New Feature

  • DI-6015: New Semarchy xDI Production Analytics image available in Docker Hub.

Bug Fixes

  • DI-7125: At startup, Tomcat warns about missing externalization keys.

  • DI-7220: Deliveries cannot be run from analytics when connecting to the runtime using the RMI protocol.

  • DI-7229: Code has been improved to ensure that all exceptions thrown by methods named do* are explicitly handled in servlet classes.

License Service

Breaking Changes

  • DI-7343: Semarchy xDI Runtime support for JDK 8 is removed in this version.

New Feature

  • DI-6010: New License Server image available in Docker Hub.

Oracle® is a registered trademark of Oracle and/or its affiliates. Informatica® and PowerCenter® are registered trademarks of Informatica LLC in the United States and in foreign countries. IBM® and DataStage® are trademarks or registered trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other names may be trademarks of their respective owners