Databricks

Databricks SQL is a compute resource that lets you query and explore data on Databricks.

Overview

The Databricks SQL component lets you work with Databricks data in Semarchy xDI.

You can reverse-engineer the database structure and store it in xDI metadata like other SQL databases. Use this metadata to design mappings and processes, and adapt your business rules according to your requirements.

Install the Databricks SQL component

If you did not install it yet, install the Databricks SQL component in Designer by following the component installation process.

The Databricks SQL component comes with the required JDBC driver.

Supported features

On June 24, 2024, Databricks announced that Databricks-managed passwords will reach end of life on July 10, 2024. Databricks recommend using OAuth authentication to authenticate to Databricks APIs.

See the Databricks announcement for more details.

Common features

Feature Description

Sub-metadata support

The Databricks SQL component lets you create Sub-Metadata on Databricks schema and query folder Metadata nodes.