Execution Information Perspective

Icon: location

Description

The Execution Information perspective provides an overview of execution information for previously executed workflows and pipelines. The perspective allows you to browse the list of executions and drill up or down to parent or child workflows and/or pipelines. Additionally, this perspective provides information about the execution status, logging information, (pipeline) metrics and the profiled data.

Information collection

The execution information displayed in this perspective is not collected automatically. You need to specify to which location you want to send execution information in the Pipeline run confirmation or Workflow run configuration of your choice.

Navigation

You can navigate to it by clicking the location icon from the vertical perspective toolbar in the Hop GUI.

The Keyboard shortcut to do the same is: CTRL-Shift-I.

If you want to view information regarding the last execution of the currently loaded pipeline (from the data orchestration perspective), you can hit the location icon in the toolbar:

execution information perspective pipeline toolbar icon

If you’re editing a workflow you can do the same:

execution information perspective workflow toolbar icon

Usage

Left-hand side panel

The left-hand side panel of the perspective contains a tree with all the defined Execution Information Location metadata elements. Below the names of these locations you’ll see the icon, name and registration date of the pipelines and workflow for which there is information. For example:

An example left panel

Possible action:

Action Result

Double-click on a listed execution

The information about the pipeline or workflow will be loaded into a new tab on the right-hand side of the perspective.

Click on the refresh icon

The last 100 executions without parent will be loaded from the location

Click on the delete icon

The currently selected execution will be deleted or all executions from the currently selected location (after confirmation).

Right-hand side tab folder

On the right side are the executions opened in different tabs. For example, here is a single execution information tab of a completed workflow:

Overview of a right-hand side of the execution information perspective

At the bottom you have different tabs:

Tab Description

Info

Here you’ll find general information regarding the pipeline or workflow you’re looking at

Metrics

In case you’re examining a pipeline execution you can see the overall transform metrics if there are any.

Log

Here you can find the pipeline or workflow logging text

Data

During the execution of a pipeline or workflow Hop can capture all sorts of data. Which data depends on the type of work that is being done and on how capturing is configured. For example the amount of data captured depends on the Execution Data Profile you set for a pipeline or whether of not there was interesting information after the execution of an action.

Selecting an icon

If you click on a transform or workflow icon the perspective will automatically try to load all the data it has for it. It will switch to the "Data" tab at the bottom. There you will find a list of data sets that you can look at.

Here are available data sets for workflow actions:

Data set Description

Result details of action

You will find out if there were any errors, what the result (true/false) was or whether the action was stopped.

Result files of action

If the action result contains any file names they will be in this data set

Result rows of action

If the action result contains any rows they will be in this data set

Variables before execution

The list of interesting (different from the start of the workflow) variables before the action was executed.

Variables after execution

The list of interesting variables (and their values) after the action was executed.

Here are some data sets you can capture in workflow transforms using an Execution Data Profile:

Data set Description

First rows of …​

Shows the first rows that were written by the transform.

Last rows of …​

Shows the last rows that were written by the transform.

Random rows of …​

Shows a random selection of rows written by the transform

Data profiling data sets

Depending on the data profiling options you enabled you can find per-column statistical information as well as sample rows.

Drill down

If you want to know what went on during the execution of a particular action or transform you can select it and hit the arrow down in the toolbar:

drill down in the execution information perspective

If the transform executed a pipeline or workflow in multiple copies you can choose which execution you want to follow. The same goes for workflows or pipelines that got executed multiple times in a repeat action or a Start loop. The result will be that the underlying execution will be opened in a new tab in the perspective.

Navigate to parent

If you are looking at the execution that got started by another pipeline or workflow you can navigate to this parent by clicking on the "arrow up" toolbar icon:

go to the parent execution

Edit the pipeline or workflow

If you want to quickly navigate from the execution information of a pipeline or workflow to its editor, you can click on the data orchestration icon in the toolbar:

navigate to the editor