Parallel execution of subprocesses
I have written an operator that executes a subprocess with different subsets of the data (like Bagging does, just a bit trickier, since the metadata also changes between the runs - but I eventually got it to work).
Now, my question is: can I execute multiple instances of the subprocess in parallel? If yes, how do I do that? The problem is that there seems to be only one instance of the nested process and its ports, so if I try something like that
in a multithreaded fashion, it breaks.
PredictionModel model = (PredictionModel) innerModelSink.getData(PredictionModel.class);
Any hints and/or templates?