Roadmap

The Apache Hop team aims to create a new release every 2 to 3 months.

Here are a few directions that we want to explore for the future of our software:

  • Authentication and authorization plugins for various security providers

  • VFS:

    • Integration with authentication for the VFS plugins, allow VFS configurations per project (instead of the current global Apache Hop configurations)

    • S3 compatible object store support through updated AWS libs

  • Integrate with graph databases as a plugin type similar to the existing database plugins

  • Creation of a 'hop' command with sub-commands

  • Set up a software marketplace where 3rd party plugins can be found

  • Finish conversion of all plugins to generic XML serialization to allow for JSON/YAML/…​ metadata serialization of pipelines and workflows

  • Pluggable field expressions in transforms and actions

  • Integration with Apache Airflow both in Airflow and as a new Workflow engine plugin

  • Infrastructure and project environment validation

  • MongoDB: API update to support Atlas

  • Improved monitoring and logging, integrations with the leading logging and monitoring platforms

  • A new docker/k8s pipeline/workflow engine

  • …​