Beam BigQuery Output Icon Beam BigQuery Output

Description

The Beam BigQuery Output transform can be used to write data to a BigQuery table using the Beam execution engine.

Supported Engines

Hop Engine

Not Supported

Spark

Supported

Flink

Supported

Dataflow

Supported

Options

Option Description

Transform name

Name of the transform, this name has to be unique in a single pipeline.

Project ID

The Google Cloud Platform project.

Data set ID

The BigQuery dataset ID.

Table ID

The BigQuery table ID.

Create table if needed

Whether or not to create the table if it does not exist. (default: true)

Truncate table

Whether or not to truncate the table before inserting.

Fail if the table is not empty

Throws an error if the table is not empty.