Reading Multiple files at the same time

The Semarchy xDI File Driver has a powerfull functionality allowing to read data from multiple files.

This permits to load data from a set of files having the same structure.

Example:

files

Metadata Configuration

Create a File Metadata and reverse one of the file (or design it manually) like you would usually do:

file before

Then simply update the Physical Name to use a file mask:

file mask

When loading data the file driver will read all the files coresponding to the mask.

Usage

Use it as Source in your Mappings and Processes. All the files will be loaded seamlessly:

mappingExample

You can only use this to read files. Using it as target in a Mapping or process will produce an error.

You could use this together with Property Fields to know from which file each rows is retrieved.