Hive

Overview

With the Hadoop component, you can produce fully customized Hive data flows in Semarchy xDI.

The database structure can be fully reverse-engineered and stored in xDI Metadata. You can then use it when designing mappings and processes to adapt your business rules according to your requirements.

Supported features

Common features

Feature Description

Reverse

This technology can be reverse-engineered to xDI Metadata.

DDL/DML Operations

Supports DML/DDL operations, such as Insert, Update, Select, Delete, Create or Drop.

Integration Methods

  • Append

  • Incremental Update

Load Methods

  • Load through HDFS

  • Load through Sqoop

Staging Methods

Can be used as a stage for data transformation, mutualization, and more. The following methods are supported:

  • Staging as Sub-Query

  • Staging as View

  • Staging as Table

Rejects

Supports defining Reject rules to detect or filter out specific data during integrations.

Replication

Supports replicating data to or from this technology using Replicators.

Additional features

Feature Description

Kerberos

The Kerberos authentication method is supported