Serialize To File From File transform Icon Serialize To File

Description

The Serialize To File transform stores rows of data in a binary format in a file. The binary format has an advantage over a text (flat) file because the content does not have to be parsed when read back. The metadata is stored in the file as well.

The Serialize to file transform supports a write-once access pattern, and does not support appending to existing files.

Supported Engines

Hop Engine

Supported

Single Threaded

Supported

Native Spark

Supported

Beam Spark

Maybe Supported

Beam Flink

Maybe Supported

Beam Dataflow

Maybe Supported