Pipeline Run Configuration

Description

pipeline run config

Describes how and with which engine a pipeline is to be executed.

Pipelines can be executed on a variety of runtime engines. Check Pipeline Run Configurations for more details.

None/All

Options

Option Description

Name

the name to be used for this pipeline run configuration

Description

the description to be used for this pipeline run configuration

Engine Type

The available pipeline engines are listed below. Detailed configuration depends on the selected engine.

  • Beam Dataflow pipeline engine

  • Beam Direct pipeline engine

  • Beam Flink pipeline engine

  • Beam Spark pipeline engine

  • Hop local pipeline engine

  • Hop remote pipeline engine

Samples

Your Hop installation comes with a default 'local' pipeline run configuration.