Skip to main content
Apache Hop
Blog
Documentation
Getting started
User manual
Developer documentation
Architecture
Roadmap
Community
Contributing
Mailing lists
Tools & chat
Events & user groups
Team
Support
Commercial support
Ethos
Security advisories
Apache
Foundation
Events
License
Security
Privacy
Thanks
Sponsorship
Search Apache Hop
Download
×
Getting Started
What is Hop
Hop Concepts
Download & Install
Tools
Hop Gui Overview
Pipelines
Workflows
Next Steps
Kettle/PDI and Hop
Hop vs Kettle
If you know Kettle
Upgrade Kettle to Hop
Concepts
Installation and Configuration
Hop in Docker
Hop Web in Docker
Hop in the Cloud
Supported Java Versions
Hop Gui
Customize the UI
File Dialog
Popup Dialog
Notes on pipelines and workflows
Perspectives
AI Assistant
Database perspective
Search
Working with git
Keyboard Shortcuts
Hop Web
Notifications
Projects
Projects & Environments
Metadata
Advanced Configuration
Pipelines
Pipeline Editor
Create a Pipeline
Run, Preview and Debug a Pipeline
Error Handling
Getting started with Apache Beam
Running the Beam samples
Direct Runner
Apache Flink
Apache Spark
Google Cloud Dataflow
Running a Hop pipeline using the Flink Kubernetes Operator
Getting started with the native Spark engine
Paths and file systems
Cluster mapping walk-through
Lakehouse tables (Delta / Iceberg)
Native Spark on Databricks
Pipeline Metrics
Pipeline Run Configurations
Beam Google DataFlow
Beam Direct
Beam Flink
Beam Spark
Native Local
Native Remote
Native Load-balancing
Native Spark
Pipeline Unit Tests
Metadata Injection
Specify copies
Partitioning
Formatting numbers and dates
Pipeline sources
Transforms
Abort
Add a checksum
Add Constants
Add Sequence
Add value fields changing sequence
Add XML
Analytic Query
Append Streams
Apache Tika
Avro decode
Avro encode
Avro file input
Avro file output
AWS SNS notify
AWS SQS reader
Azure Event Hubs listener
Azure Event Hubs writer
Beam Bigtable input
Beam Bigtable output
Beam BigQuery Input
Beam BigQuery Output
Beam file input
Beam file output
Beam GCP Pub/Sub: publish
Beam GCP Pub/Sub: subscribe
Beam Kafka consume
Beam Kafka produce
Binary File Output
Beam Kinesis consume
Beam Kinesis produce
Beam timestamp
Beam window
Blocking transform
Blocking until transforms finish
Calculator
Cassandra Input
Cassandra Output
Cassandra SSTable Output
Call DB procedure
Change file encoding
Check if file is locked
Check if webservice is available
Clone row
Closure
Coalesce
Column exists
Combination lookup/update
Concat fields
Copy rows to result
Credit card validator
CSV file input
Data stream input
Data stream output
Database Join
Database Lookup
Database value validation
Data Grid
Data set input
Data set output
Database impact input
DDL Generator
Data Validator
Delay row
Delete
De-Serialize From File
Detect Empty Stream
Detect language
Dimension lookup/update
Doris Bulk Loader
Drools Rule Accumulator
Drools Rule Executor
Dummy (do nothing)
Dynamic SQL row
Edi to XML
Email Messages Input
Enhanced JSON output
Excel input
Excel writer
Execute a process
Execute row SQL script
Execute SQL script
Execute unit tests
Execution information
Fake data
File exists
File metadata
Files from result
Files to result
Filter Rows
Formula
Fuzzy match
Generate Random Value
Get Data From XML
Get filenames
Get files rowcount
Get records from stream
Get Rows from Result
Get SubFolder names
Get System Info
Get table names
Get variables
Git Input
Google Analytics Input
Google Sheets input
Google Sheets output
Group By
HTML 2 Text
HTTP client
HTTP Post
Identify last row in a stream
If null
Injector
Insert / Update
Java Filter
JavaScript
JDBC Metadata
Join Rows
JMS consumer
JMS producer
JSON Input
JSON Normalize Input
JSON Output
Kafka consumer
Kafka producer
Language model chat
LDAP Input
LDAP Output
Load file content in memory
Mail
Mapping input
Mapping output
Memory Group By
Merge Join
Merge rows (diff)
Metadata Injection
Metadata input
Metadata structure of stream
Microsoft Access Output
MonetDB Bulk Loader
MongoDB delete
MongoDB Input
MongoDB Output
MS SQL Server Bulk Loader
Multi Mapping
Multiway Merge Join
MySQL bulk loader
Neo4j Cypher
Neo4j generate CSVs
Neo4j Get Logging Info
Neo4j graph output
Neo4j import
Neo4j output
Neo4j split graph
Null If
Number range
OData input
Oracle Bulk Loader
Output transform metrics
Parquet file input
Parquet file output
Pipeline Data Probe
Pipeline logging
PGP decrypt stream
PGP encrypt stream
Pipeline Executor
PostgreSQL bulk loader
Process files
Properties file Input
Properties file Output
Redshift Bulk Loader
Redis Input
Redis Output
Regex Evaluation
Repeat fields
Replace in String
Reservoir Sampling
REST Client
Row Denormaliser
Row Flattener
Row Generator
Row Normaliser
Run SSH commands
Salesforce Delete
Salesforce Input
Salesforce Insert
Salesforce Update
Salesforce Upsert
Sample Rows
SAS input
Script
Select Values
Serialize To File
Server Status
Set field value to a constant
Set field Value to a field
Set Variables
SFTP Put
Simple Mapping
Snowflake bulk loader
Sort Rows
Sorted Merge
Sorted schema merge
Spark lake table input
Spark lake table maintenance
Spark lake table merge
Spark lake table output
Spark SQL
Split Fields
Split fields to rows
Splunk input
SQL File Output
Standardize Phone Number
Stanford NLP
Static Schema Mapping
Stream Lookup
Stream schema merge
String cut
String operations
Switch / Case
Synchronize after merge
Table Compare
Table Exists
Table Input
Table Output
Teradata Bulk Loader
Text File Input
Text File Output
Token replacement
Unique Rows
Unique Rows (HashSet)
Update
User Defined Java Class
User Defined Java Expression
Value Mapper
vCard Input
vCard Output
Vertica Bulk Loader
Web services lookup
Workflow Executor
Workflow logging
Write to log
XML Input Stream (StAX)
XML Join
XML Output
XML output (Advanced)
XSD Validator
XSL transformation
Yaml Input
Zip file
Workflows
Create a Workflow
Run and Debug a Workflow
Workflow Run Configurations
Native Local
Native Remote
Native Load-balancing
Actions
Abort workflow
Add filenames to result
AS/400 command
Build documentation
Bulk load from MySQL into file
Bulk load into MSSQL
Bulk load into MySQL
Cassandra Exec Cql
Check Db connections
Check files locked
Check if a folder is empty
Check if XML file is well-formed
Check Neo4j connections
Check webservice availability
Checks if files exists
Columns exist in a table
Compare folders
Convert file between Windows and Unix
Copy Files
Create a folder
Create file
Databricks job run
Databricks job wait
dbt
Decrypt files with PGP
Delete file
Delete filenames from result
Delete files
Delete folders
DTD validator
Dummy
Encrypt files with PGP
End repeat
Evaluate files metrics
Evaluate rows number in a table
File compare
File exists
FTP delete
Get a file with FTP
Get a file with SFTP
Get mails (POP3/IMAP)
HTTP
JavaScript
Join
Mail
Mail validator
Move files
MongoDB QL
Neo4j constraint
Neo4j Cypher script
Neo4j index
Ping a host
Pipeline
Process result filenames
Put a file with FTP
Put a file with SFTP
Repeat
Run pipeline unit tests
Send Nagios passive check
Send SNMP trap
Set password encoder
Set variables
Shell
Simple evaluation
Snowflake warehouse manager
SQL
Start
Success
Table exists
Telnet a host
Truncate tables
Unzip file
Verify file signature with PGP
Wait for
Wait for file
Wait for SQL
Workflow
Write to file
Write to Log
XSD validator
XSL pipeline
Zip File
Fields, parameters, and variables
Variables
Passing parameters to a child
Virtual File System
Amazon Web Services S3
Microsoft Azure Storage
Databricks Volumes / Workspace
Dropbox
Google Cloud Storage
Google Drive
HDFS
MinIO
Relational Database Connections
Apache Derby
DuckDB
Apache Hive
AS400
ClickHouse
CrateDB
Databricks
DB2
Apache Doris
Exasol
Firebird
Google BigQuery
Greenplum
Gupta SQLBase
H2
Hypersonic
IBM Universe
Cloudera Impala
Infobright DB
Informix
Ingres
Interbase
InterSystems Cache
InterSystems Iris
Kingbase ES
Mariadb
MaxDB (SAP DB)
SingleStore (MemSQL)
Microsoft Access
MonetDB
MS SqlServer
MS SqlServer (Native)
MySql
Netezza
Oracle
Oracle RDB
PostgreSQL
Redshift
Snowflake
SqLite
Sybase
Sybase IQ
Teradata
Vectorwise
Vertica
Logging basics
Logging reflection
Metadata Types
AI Provider
Asynchronous Web Service
Azure Connection
Beam File Definition
Cassandra Connection
Databricks Connection
Databricks VFS Connection
Data Set
dbt Project
Execution Data Profile
Execution Information Location
Elastic location
OpenSearch location
Neo4j location
FTP Connection
Git Connection
Google Storage Connection
HDFS Connection
Hop Server
Mail Server Connection
Minio (S3) Connection
MongoDB Connection
Neo4j Connection
Neo4j Graph Model
Partition Schema
Pipeline Log
Pipeline Probe
Pipeline Run Configuration
Pipeline Unit Test
Relational Database Connection
Redis Connection
REST Connection
Salesforce Connection
SFTP Connection
Splunk Connection
JMS connection
Spark Catalog
Variable Resolver
AWS Secrets Manager variable resolver
Azure Key Vault variable resolver
Google Secret Manager variable resolver
Hashicorp Vault variable resolver
Hop Password variable resolver
OpenBAO variable resolver
Pipeline variable resolver
Static Schema Definition
Naming Scheme
Web Service
WebDAV Connection
Workflow Log
Workflow Run Configuration
Passwords
AES Two way password encoder
Samples
Technology
AI
Apache Calcite
Azure
Cassandra
Memgraph
Neo4j
Working with Neo4j data
Neo4j Logging Schema
Redis
Google
OpenLineage
Dataset identity
Hop Server
Deploying Hop Server
Project in a Docker image
Remote run with export resources
Git checkout on the server
REST api
JSON API
Web Service
Async Web Service
Hop Tools
hop lint
hop marketplace
hop setup
hop-conf
hop-encrypt
hop-gui
hop doc (Generate documentation)
hop-run
hop-search
hop-import
hop-server
Best Practices
Linting
Lint rules
Lint rule packs
Pro Tips
Unique Selling Propositions
How-to guides
Hop web services in Docker
Change Data Capture
CDC: log sniffing
CDC: filtered selection
CDC: comparing snapshots
Joins and lookups
Logging pipeline data with pipeline log
Logging workflow data with workflow log
Loops in Apache Hop
Parallel execution in workflows
Write Parquet to Cloudera HDFS from OpenShift
Scheduling workflows and pipelines
Run Hop workflows and pipelines in Apache Airflow
Avoiding deadlocks
Community Posts
User manual
2.20.0 (pre-release)
User manual
2.20.0 (pre-release)
2.19.0
2.18.1
2.18.0
2.17.0
2.16.0
2.15.0
2.14.0
2.13.0
2.12.0
2.11.0
2.10.0
Development Documentation
2.20.0
2.19.0
2.18.1
2.18.0
2.17.0
2.16.0
2.15.0
2.14.0
2.13.0
2.12.0
2.11.0
2.10.0
Edit this page
Documentation menu
Home
Frequently Asked Questions
Frequently Asked Questions
This page contains some of the frequently asked question
Questions
