Doris Bulk Loader
Description
Apache Doris is a modern MPP analytical database product. It can provide sub-second queries and efficient real-time data analysis. With it’s distributed architecture, up to 10PB level datasets will be well supported and easy to operate.
Apache Doris can meet various data analysis demands, including history data reports, real-time data analysis, interactive data analysis, and exploratory data analysis. Make your data analysis easier!
The Doris Bulk Loader allows you to insert data into Apache Doris at high speed and volume, making it a faster way to load data than using the traditional database insert statements.
Options
General
| Option | Description |
|---|---|
Transform name | Name of the transform; This name has to be unique in a single pipeline |
FE Host | Hostname of the FE Host |
FE HTTP Port | Port used to connect to the FE Host |
Database Name | The database you want to connect to |
Table Name | Table name to bulk load records to |
Login User | User used to connect to the database |
Login Password | Password to connect to the database |
Data Field | The Data has to be combined to a single field, this can be a csv style field or json data |
Format | Indicator to tell the transform it is expecting CSV style or JSON style data |
Line Delimiter | The Delimiter used to indicate line endings |
Column separator | When using CSV style data this will indicate what character to split fields on |
Buffer Size | Size of the buffer in bytes (0 = unlimited) |
Buffer Count | Buffer Size * Buffer Count is the max capacity to buffer data before doing real stream load (0 = unlimited) |