HBase

Overview

With the Hadoop component, you can produce fully customized HBase data flows in Semarchy xDI.

The database structure can be fully reverse-engineered and stored in xDI Metadata. You can then use it when designing mappings and processes to adapt your business rules according to your requirements.

Supported features

Common features

Feature Description

Reverse

This technology can be reverse-engineered to xDI Metadata.

Additional features

Feature Description

Kerberos

The Kerberos authentication method is supported

Data Consultation

HBase data can be consulted from the Query Editor like traditional databases

HBase server operations

The Component allows to:

  • create and drop namespaces

  • create, drop, enable, disable or truncate tables

  • create, restore and delete snapshots

HBase data operations

The Component allows to:

  • insert data

  • update data

  • delete data

Transactions

A transaction mechanism has been implemented to allow the user to optionally treat batch of data without being affected by rows newly created in parallel. This offers the possibility to fix a timestamp and treat only data inserted before this time.

Joins / Lookup

The connector allows to join two HBase tables based on their Row Key. This allows to retrieve only the rows from which the Row Key exists in the joined table. It therefore gives the possibility to perform 'lookups' on HBase tables.