Local Pipeline Engine

Local

The local runner runs on the local Hop engine.

Options

Option	Description	Default
Row set size	The row set buffer size.	10.000
Safe mode	Checks every row passed through your pipeline and ensure all layouts are identical. If a row does not have the same layout as the first row, an error is generated and reported.	false
Collect metrics	Collects metrics to monitor the performance of your pipeline.	false
Sort transforms	Performs a topological sort of the transforms in the pipeline before execution.	false
Log rows feedback	Enables log rows feedback, showing a log line every after processing multiple of 50.000 (default) rows.	false
Feedback size in rows	The number of rows to return as feedback.	50.000

Option

Description

Default

Row set size

The row set buffer size.

10.000

Safe mode

Checks every row passed through your pipeline and ensure all layouts are identical. If a row does not have the same layout as the first row, an error is generated and reported.

false

Collect metrics

Collects metrics to monitor the performance of your pipeline.

false

Sort transforms

Performs a topological sort of the transforms in the pipeline before execution.

false

Log rows feedback

Enables log rows feedback, showing a log line every after processing multiple of 50.000 (default) rows.

false

Feedback size in rows

The number of rows to return as feedback.

50.000