RapidMiner Board - Chart Server
I am sure we are all involved in optimising RapdMiner models, saving partial results and models on disk, and using some tools to preview and chart the results, while the model development is ticking away in the background. Basically, we need to have live charts and the ability to send data and performance measures to these charts. We could use RapidMiner Server apps to achieve some of this functionality, but it can be done much simpler and cheaper, and if needed interactively as well.
I suggest to create a RapidMiner Board, similar in its functionality to Tensorflow's Tensorboard. The board would run as a web server (either launched locally, similarly what is already been done with H2O for example, or to be linked to an existing web server via URL). The RapidMiner would also need an extension to connect the RM instance to the board, and to offer "callback" operators which would send data and performance measurements to the board in runtime, as well as "charting" operators that would request updates of live plotting of the accumulated data. This would allow watching the performance of models developed iteratively in loops, in cross-validation, and optimisation grids, which normally takes too long to execute and there is virtually no feedback of what is going on. The charts could be interactive, so that you could select different visualisation of data, inspect data points, etc.
The charts can be as sophisticated, dynamic and beautiful as D3.js, but there are many other HTML5 options there as well.
Optionally, if we were to replicate the full Tensorboard functionality, it may be possible to store the data in a folder accessible by the server, so that you can plot the saved data after the run finished, or compare the charts from one run against the charts of another run. It may even be possible to save the models checkpoints for later selection and loading (e.g. to select the best), and if so, similarly to Tensorboard, we could offer visualisation of the checkpointed models.