Item types

Action

An Action is a single operation performed in a Workflow. Actions are executed sequentially one after another by default, with parallel branch execution available as a configuration option. When an action finishes, it returns a success or failure status (true or false). This status determines which outgoing hops the workflow follows next. Actions can also pass variables, lists of files, and summary rows to subsequent actions. See the Actions catalog for all available workflow actions.

Hop

A Hop links Actions in a Workflow or Transforms in a Pipeline. In Workflows, Hops operate based on the exit status of previous Actions, Hops in Pipelines pass data between Transforms.

Pipeline

Pipelines are the data workers of Apache Hop. Operations in a pipeline read, transform, enrich, clean, validate, and write data. A pipeline starts with one or more pipeline sources and runs every transform in parallel. Data travels between transforms along hops through in-memory row buffers, ensuring high throughput and automatic back-pressure. See Pipelines for detailed execution mechanics, engines, and production scenarios.

Pipeline Streaming Execution Model — All transforms run concurrently; rows stream through in-memory buffers SOURCE Table Input Reads customer rows ~8,000 rows/s Row Buffer Capacity: 10k Flowing TRANSFORM Lookup & Clean Enriches & validates Paused (Throttled) Buffer Full! 10k / 10k Back-Pressure TARGET SINK Database Insert Writes to warehouse ~2,000 rows/s Back-Pressure: When Database Insert is slower than Table Input, the row buffer fills up and automatically pauses Table Input.
Transform

A Transform is a single unit of data processing inside a Pipeline. Typical transform operations include reading from databases or files, filtering rows, calculating values, performing lookups, joining datasets, and loading to destinations. All transforms in a pipeline run simultaneously in parallel. Pipeline sources generate rows without needing an incoming hop, while intermediate transforms continuously process streaming rows and pass them along hops to downstream transforms through in-memory row buffers. See Transforms for where to find the page of each transform.

Workflow

A Workflow is the orchestrator of your data architecture. Workflows execute a series of actions sequentially by default (with optional parallel branches). Workflows manage control flow rather than streaming individual rows: they check prerequisites, prepare environments, execute pipelines, manage files, handle errors, and send notifications. Hops in a workflow decide which path to follow based on whether an action succeeded or failed. See Workflows for in-depth orchestration concepts, decision backtracking, and scheduling scenarios.

Workflow Orchestration & Backtracking Model — One action at a time; hops route on success or failure ALWAYS SUCCESS TRUE FAILURE FALSE Start Origin Action 1 Check Files Prerequisites check Exit: True / False Action 2 Run Pipeline Fires data worker Streams records Action 3 Archive Files Moves input to S3 Cleans temp dir Success Fallback Send Alert Emails on-call team Logs error details Abort Abort Workflow Flags job as failed Stops execution Backtracking: Hop follows one branch to its end, then returns to the last fork and takes any branch it has not run yet.