With 2020 coming to a close, we’ve started preparing for 0.50, which will be our first Apache release. We’ll have more news on that soon!
At the start of the final month of 2020, let’s have a closer look at what happened at Apache Hop in November.
Apache Hop Incubation - infrastructure
Our migration to the Apache Software Foundation infrastructure is now done. All references to Project Hop have been changed to Apache Hop (Incubating).
All software and documentation code have been moved to apache-hop-* repositories. All builds have been ported or recreated, some additional features have been added (e.g. PR builds over GitHub Actions). Thank you Hans to get all of this to work seamlessly!
New Plugins
Documentation
As mentioned a couple of times in previous updates, documentation will be work in progress for the foreseeable future. However, there is progress!
We’ve received some additions and updates to the user manual.
The majority of the work was done on the developer documentation (thanks, Hans, Hiromu, Mahendran, Matt!):
-
Updated Developer Getting Started
-
Updated Porting Kettle Plugins
-
New: Metadata Plugins guide
As always, ping us on mattermost to discuss documentation, and create tickets if you find any missing or incorrect information in the docs. Documentation is code, we take bugs in the documentation just as serious as bugs in the code.
Community
The Hop community continues to grow:
The following people have been added as committers:
-
Peter Fabricius
-
Sergio Ramazzina
Check out the complete list of committers and contributors.
Without community contribution, Hop is just a coding club! Please feel free to join, participate in the discussion, test, file bug tickets on the software or documentation, … Contributing is a lot more than writing code.
Check out our contribution guides to find out more.
Various
The full list of issues that had activity over the last month is:
Resolved (76)
| Issue | Summary | Components | Created | Updated |
|---|---|---|---|---|
Update MSSQLNative documentation with info on how to use integrated security | Database, Documentation | 2020-10-04 | 2020-11-15 | |
Error thrown when hop.properties doesn’t exist | 2020-10-04 | 2020-11-23 | ||
Editing Pipeline Run Configuration causes error | 2020-10-04 | 2020-11-23 | ||
Refactor UuidUtil | 2020-10-04 | 2020-11-26 | ||
MemoryGroupByMeta not working in Beam | Beam | 2020-10-04 | 2020-11-23 | |
hop-conf.sh: Create config.json if missing | 2020-10-04 | 2020-11-23 | ||
Transform context option to specify row distribution doesn’t work | Transforms | 2020-10-04 | 2020-11-23 | |
Project not correctly created | GUI | 2020-10-04 | 2020-11-23 | |
Update Generic Database connection Documentation | Database, Documentation | 2020-10-04 | 2020-11-15 | |
update environments page | Documentation | 2020-10-04 | 2020-11-15 | |
Remove or adapte file resources/org/apache/hop/ui/core/dialog/license/license.txt | GUI | 2020-10-04 | 2020-11-25 | |
port Stream Schema Merge plugin to Hop transform | Transforms | 2020-10-04 | 2020-11-18 | |
Stream Schema Merge - NPE | Transforms | 2020-10-04 | 2020-11-18 | |
In a fresh copy of hop, a pipeline will fail to run without a project. | 2020-10-04 | 2020-11-23 | ||
If you close the Preview Rows dialog using the "X", the preview will keep running with no way to cancel (ever). | 2020-10-04 | 2020-11-18 | ||
Without a project; Text Input Step fails to record the whole file name for browsing and selecting files. | 2020-10-04 | 2020-11-25 | ||
Update base doc url to https://hop.apache.org/ | Documentation, GUI | 2020-10-18 | 2020-11-15 | |
Code cleanup: rename variables with bad style | 2020-10-19 | 2020-11-09 | ||
Parameter HOP_MAX_LOG_SIZE_IN_LINES is set too low | 2020-10-22 | 2020-11-12 | ||
Workflows do not correctly capture their log channel | 2020-10-22 | 2020-11-09 | ||
Context dialog for Notes is missing in workflows | 2020-10-23 | 2020-11-25 | ||
Add support for ordered categories for context actions, expose in context dialog | GUI | 2020-10-27 | 2020-11-16 | |
Null pointer exception when running Shell action in a workflow | Actions | 2020-10-27 | 2020-11-12 | |
Options: Font size changes are not honored | GUI | 2020-10-30 | 2020-11-23 | |
Zoom factor is incorrectly calculated on Windows | GUI | 2020-10-30 | 2020-11-12 | |
Exception raised when running Hop Translator | 2020-11-03 | 2020-11-12 | ||
AuditManagerTest fails | 2020-11-06 | 2020-11-09 | ||
Enum HopExtensionPoint use Job name | 2020-11-10 | 2020-11-30 | ||
AbstractMetaTest.testMultithreadHammeringOfListener causes OOM | 2020-11-11 | 2020-11-12 | ||
Wrong name of project and enviroment after update | GUI | 2020-11-12 | 2020-11-25 | |
Add format selector in Data Set creation | GUI | 2020-11-12 | 2020-11-12 | |
Add format selector in File Definition creation | GUI | 2020-11-12 | 2020-11-12 | |
ContextDialog NPE | GUI | 2020-11-12 | 2020-11-17 | |
Store run configuration names per file | GUI | 2020-11-12 | 2020-11-17 | |
Random Value transform generates data of wrong class | 2020-11-12 | 2020-11-16 | ||
Evaluation Action: parent_workflow unavailable | Actions | 2020-11-13 | 2020-11-23 | |
Make it easy for plugins to get lists of names from other plugins | GUI | 2020-11-13 | 2020-11-17 | |
Translation issues | GUI | 2020-11-16 | 2020-11-23 | |
Failed to show filename, file content & fields | GUI | 2020-11-16 | 2020-11-23 | |
Error pasting from clipboard | GUI | 2020-11-16 | 2020-11-24 | |
Canvas grid option doesn’t update after saving | GUI | 2020-11-16 | 2020-11-24 | |
Font and color options do not update after setting | GUI | 2020-11-16 | 2020-11-24 | |
ContextDialog to create an item: set Workflow and pipeline in a Basic category | 2020-11-16 | 2020-11-18 | ||
Add RAT to PR Build and make it pass | Build | 2020-11-17 | 2020-11-17 | |
Port the Salesforce transforms | Transforms | 2020-11-17 | 2020-11-17 | |
Undoing delete of a note changes font color | 2020-11-17 | 2020-11-17 | ||
NPE in Copy Rows To Result | Transforms | 2020-11-17 | 2020-11-18 | |
ITransform declaring meta or data causing NPEs | Transforms | 2020-11-17 | 2020-11-18 | |
rename hop-assemblies-client to hop-client | Build | 2020-11-17 | 2020-11-18 | |
Split the File/New actions into File and Metadata categories | GUI | 2020-11-17 | 2020-11-18 | |
Changing variable in project dialog requires restart | GUI | 2020-11-17 | 2020-11-19 | |
Workflow Transform not working | 2020-11-17 | 2020-11-18 | ||
Remove the Hop Lifecycle listener plugin type | API | 2020-11-18 | 2020-11-26 | |
Workflow executer Transform does not show logging | Transforms | 2020-11-18 | 2020-11-18 | |
Passing parameters using the "Copy results to parametrs" option does not work | Actions, Transforms | 2020-11-18 | 2020-11-19 | |
Make ContextDialog more friendly for plugins | GUI | 2020-11-19 | 2020-11-19 | |
ContextDialog: remove excess spacing and add "clear search" icon | GUI | 2020-11-19 | 2020-11-19 | |
Add m2 caching to PR build | Build, Infrastructure | 2020-11-19 | 2020-11-22 | |
Port the MongoDB plugins | Transforms | 2020-11-19 | 2020-11-23 | |
Issue with variable resolution of empty values | Transforms | 2020-11-20 | 2020-11-23 | |
Creating project with relative path in home folder creates NPE | CLI | 2020-11-20 | 2020-11-24 | |
hop-run, return exit code 1 when a workflow aborts with error | CLI | 2020-11-22 | 2020-11-28 | |
create mongoDB documentation | Documentation | 2020-11-23 | 2020-11-24 | |
Clear custom options in the options dialog doesn’t save to file | GUI | 2020-11-24 | 2020-11-24 | |
Creating new project fails | GUI | 2020-11-24 | 2020-11-24 | |
Renaming metadata entries creates a copy | Metadata | 2020-11-24 | 2020-11-25 | |
The preview rows dialog should not pop up when dragging | GUI | 2020-11-25 | 2020-11-27 | |
The Metadata Injection dialog references methods of specification | Transforms | 2020-11-25 | 2020-11-27 | |
Port the repeat-until actions | 2020-11-26 | 2020-11-27 | ||
Project variables are not passed to a new workflow | Workflows | 2020-11-26 | 2020-11-27 | |
Values are not passed to parameters in the Workflow Executor transform | Transforms, Workflows | 2020-11-26 | 2020-11-27 | |
Action dialogs are not searched for in the plugin classpath | API | 2020-11-27 | 2020-11-27 | |
Resizing the file dialog collapses columns | GUI | 2020-11-27 | 2020-11-27 | |
Add search to metadata injection Transform | Transforms | 2020-11-27 | 2020-11-27 | |
The JavaScript action still uses entry, doc says action | Actions | 2020-11-27 | 2020-11-27 | |
A stopped workflow will think it’s still running | Workflows | 2020-11-27 | 2020-11-27 |
In Progress (9)
| Issue | Summary | Components | Created | Updated |
|---|---|---|---|---|
Action with Connection line not correctly translated | Actions, Translations | 2020-10-25 | 2020-11-30 | |
Check and update notice,license,disclaimer,… | 2020-11-17 | 2020-11-24 | ||
Create About page | GUI | 2020-11-18 | 2020-11-18 | |
Create first version of Integration Testing | Build, Infrastructure, Integration Testing | 2020-11-20 | 2020-11-20 | |
Port the Cassandra plugin | Transforms | 2020-11-22 | 2020-11-29 | |
Document how to set up a developer environment | Documentation | 2020-11-25 | 2020-11-25 | |
Create a perspective to manage metadata | GUI | 2020-11-26 | 2020-11-29 | |
When executing a workflow manually set variables are not applied | GUI | 2020-11-27 | 2020-11-27 | |
Reverse sort the projects drop-down list by use date | GUI | 2020-11-30 | 2020-11-30 |
Open (42)
| Issue | Summary | Components | Created | Updated |
|---|---|---|---|---|
Review/Refactor getValueFromSQLType | Database | 2020-10-04 | 2020-11-09 | |
API should use boolean "isXXXX()" getter naming convention | Database | 2020-10-04 | 2020-11-09 | |
Create Help- About menu entry | GUI | 2020-10-04 | 2020-11-18 | |
Fix the beam-demo project | Beam | 2020-10-04 | 2020-11-12 | |
Create Fake Data Transform Documentation | Documentation | 2020-10-04 | 2020-11-03 | |
Hop needs a default "Project" and "Local Run Configuration" | 2020-10-04 | 2020-11-12 | ||
NullPointerException raised on hop-server workflow start | Hop Server | 2020-11-05 | 2020-11-05 | |
Replace javax/mail/Address dependency | Transforms | 2020-11-05 | 2020-11-23 | |
Not found from Search option | Documentation | 2020-11-06 | 2020-11-23 | |
Git Repository option is missing | Documentation | 2020-11-06 | 2020-11-06 | |
"Synchronise name with" option doesn’t work (Workflow properties) | GUI | 2020-11-06 | 2020-11-29 | |
hop-server.bat has wrong line ending char | Hop Server | 2020-11-09 | 2020-11-09 | |
NullPointerException raised on stopping an inactive workflow | Hop Server | 2020-11-10 | 2020-11-10 | |
Standardize option name "Synchronise name with filename" | GUI | 2020-11-10 | 2020-11-17 | |
Issue editing pipelines and workflows | GUI | 2020-11-10 | 2020-11-16 | |
Hop-server Object ID not returned in the result from /registerWorkflow request | Hop Server | 2020-11-10 | 2020-11-10 | |
Error editing Data set with no file name | GUI | 2020-11-11 | 2020-11-26 | |
Error selecting Edit Hop metadata object | GUI | 2020-11-11 | 2020-11-26 | |
Flink pipeline engine documentation broken table | Website | 2020-11-12 | 2020-11-12 | |
MetaStore created with no data | GUI | 2020-11-12 | 2020-11-26 | |
Error in Ok, Edit and View options when the Data Set has no name | GUI | 2020-11-12 | 2020-11-12 | |