Beam BigQuery Input Icon Beam BigQuery Input

Description

The Beam BigQuery Input transform can be used to input data from Google Cloud BigQuery using the Beam execution engine.

Supported Engines

Hop Engine

Supported

Spark

Supported

Flink

Supported

Dataflow

Supported

Options

Option Description

Transform name

Name of the transform, this name has to be unique in a single pipeline.

Project ID

The Google Cloud project.

Data set ID

The BigQuery dataset ID.

Table ID

The BigQuery table ID.

Query

The input query, blank means everything from the table.

Return fields selection

A list of result fields.

BQ Field name

The field name in the BigQuery table.

Rename to…​ (optional)

The name to be given to a column.

Hop data type

The field data type.