Stream Schema Merge

Description

The Stream Schema Merge transform merges multiple inputs with different structures and creates a combination of fields.

If the streams to merge contain fields with the same name but different types, these fields with be combined into a single field of type String.
If you want to make sure fields keep their original data type, make sure to convert them to identical types. e.g. through the Metadata tab in the Select Values transform.

Supported Engines

Hop Engine

Supported

Single Threaded

Supported

Native Spark

Not Supported

Beam Spark

Not Supported

Beam Flink

Not Supported

Beam Dataflow

Not Supported

Options

Option Description

Option	Description
Transform name	Name of the transform.
Transform	The list of transforms to merge. Fields with identical field names in two or more of the input streams will be combined into a unified field (data type is kept if identical, converted to `String` if different). All fields from all of the input streams will be added to the output stream.

Transform name

Name of the transform.

Transform

The list of transforms to merge. Fields with identical field names in two or more of the input streams will be combined into a unified field (data type is kept if identical, converted to String if different). All fields from all of the input streams will be added to the output stream.