Single Threaded Pipeline Engine
Single Threaded
The single-threaded pipeline engine runs your pipeline locally in a single-threaded fashion. Every transform is executed in topological order, and data is processed sequentially rather than in a parallel stream.
This execution mode is useful for debugging, testing, or processing batch data where concurrency overhead is undesirable, as well as executing pipelines embedded in other environments (such as mapping transforms in Kafka message processing).
Options
| Option | Description | Default |
|---|---|---|
Sample type while running in the GUI | Here you can specify which rows you want to see when you click on the little grid icons on the transform icons during a pipeline execution. You can choose: | Last |
Number of rows to sample in the GUI | The number of rows which will be collected | 100 |