Single Threaded Pipeline Engine

Single Threaded

The single-threaded pipeline engine runs your pipeline locally in a single-threaded fashion. Every transform is executed in topological order, and data is processed sequentially rather than in a parallel stream.

This execution mode is useful for debugging, testing, or processing batch data where concurrency overhead is undesirable, as well as executing pipelines embedded in other environments (such as mapping transforms in Kafka message processing).

Options

Option Description Default

Sample type while running in the GUI

Here you can specify which rows you want to see when you click on the little grid icons on the transform icons during a pipeline execution. You can choose: None: do not show, First : show the first rows, Last : show the last rows or Random: a random selection of rows (reservoir sampling)

Last

Number of rows to sample in the GUI

The number of rows which will be collected

100