Beam BigTable Output Icon Beam Bigtable Output

Description

The Beam Bigtable Output transform can be used to write data to a Google Cloud Bigtable table using the Beam execution engine.

Supported Engines

Hop Engine

Not Supported

Spark

Supported

Flink

Supported

Dataflow

Supported

Options

Option Description

Transform name

Name of the transform, this name has to be unique in a single pipeline.

Project ID

The Google Cloud project.

Instance ID

The Bigtable instance ID.

Table ID

The Bigtable ID.

Key field

the field to use as the Bigtable table row key

Columns to set:

a list of the columns to write to the Bigtable table:

  • name: the name (qualifier) for this column

  • family: the family name for this column

  • source field: the pipeline field to use for the column’s values