This is documentation for Semarchy xDI 2024.4, which is no longer actively maintained.

For more information, see our Global Support and Maintenance Policy.

Snowflake - Snowpipe Streaming Get Last Committed Offset Token

Tools

Description

This tool gets the last committed offset token linked to the Snowpipe Streaming channel and the target table, and publishes it to a variable in a user-specified path.

All tool parameters are mandatory.

Parameters

Parameter Description

Parameter	Description
Name	Display name given to the tool.
Channel Name	Name of the Snowpipe channel to use for loading data to Snowflake.
Xpath Expression For Target Table	Name of the target table, either as a literal table name, or an xpath expression that evaluates to the target table name. For example, the expression `$REF/tech:name()` will return a table that has been dragged and dropped onto the tool if `REF` is set to the current link name.
Xpath Expression For Snowflake Schema	Xpath expression pointing to a Snowflake schema that contains the target table and connection details needed for a Snowpipe Streaming client. For example, the expression `$REF/ref:schema()` will return a schema if a target table been dragged and dropped onto the tool
Last Committed Offset Token Variable Path	Path to a process variable where the last committed offset token is published. By default, the offset token is published in the variable `lastCommittedOffsetToken` attached to this tool.

Name

Display name given to the tool.

Channel Name

Name of the Snowpipe channel to use for loading data to Snowflake.

Xpath Expression For Target Table

Name of the target table, either as a literal table name, or an xpath expression that evaluates to the target table name.

For example, the expression $REF/tech:name() will return a table that has been dragged and dropped onto the tool if REF is set to the current link name.

Xpath Expression For Snowflake Schema

Xpath expression pointing to a Snowflake schema that contains the target table and connection details needed for a Snowpipe Streaming client.

For example, the expression $REF/ref:schema() will return a schema if a target table been dragged and dropped onto the tool

Last Committed Offset Token Variable Path

Path to a process variable where the last committed offset token is published.

By default, the offset token is published in the variable lastCommittedOffsetToken attached to this tool.