Pipeline Metrics
Hop Gui shows a lot of useful metrics during and after pipeline execution.
| the metrics in this table can be captured and processed in a standard pipeline (e.g to write to a database table or Apache Kafka topic) with a Pipeline Log |
| the metrics available in this table depend on your Pipeline run configuration. The Local pipeline engine always shows these metrics in real-time. |
| Metric | Description |
|---|---|
Copy | The transform copy these metrics apply to. See Specify Copies for more details |
Input | Number of rows read from an input source like files, relational or NoSql databases etc |
Read | Number of rows coming from previous transform |
Written | Number of rows leaving this transform toward next transform |
Output | Number of rows written to an output target like files, relational or NoSql databases etc |
Updated | Number of rows updated by the transform in an output target like files, relational or NoSql databases etc |
Rejected | Number of rows that were rejected by the transform and diverted to an error handling transform |
Errors | Number of errors in the execution of this transform that were not diverted to an error handling transform (marked by a red error triangle on the transform) |
Buffers Input | Number of rows in the input buffer for this transform (can only higher than 0 during execution) |
Buffers Output | Number of rows in the output buffer for this transform (can only higher than 0 during execution) |
Duration | The execution duration for this transform |
Speed | The execution speed in rows per second for this transform. This is close to the number of rows processed (written or output) by this transform divided by the duration (not exact because of rounding in the duration) |
Status | The transform status; Running, Stopped, Finished, |