Monitor progress of running process?

keithkeith Member Posts: 157 Maven
edited November 2018 in Help
Is there a way to monitor the progress of a running process while it's "inside" a node?

For example, I have built an operator tree that contains a NeuralNet node.  Evaluating that node takes the bulk of the processing time.  I know the status bar at the bottom of the window indicates what node it is in, and how it has been running, but what I'd really like to is what percentage of the processing for the node is completed, or much longer it has to go.  In this case, maybe how many training cycles have been completed.  That would allow to estimate how long the process still has until it completes.

This specific case is a NeuralNet node, but I suspect it applies to other long-running nodes as well.  Is this possible?

Thanks,
Keith

Answers

  • IngoRMIngoRM Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, Community Manager, RMResearcher, Member, University Professor Posts: 1,751 RM Founder
    Hi Keith,

    there is unfortunately no easy way to do this in a generic way. Although it is not (yet) supported, here are some thoughts and ideas:

    Way 1:

    - one could add the ProcessLog operator as inner operator of a monitorable (<-- does this word exist?) operator
    - the outer operator could provide the values which should be monitored

    Although this would fit nicely to the process logging like it is supported right now, it would mean that monitorable must be operator chains instead of operators which would clearly a drawback and would probably not ease the process design.


    Way 2:

    - one could add a new operator "OperatorLog" before the operator which should be monitored
    - this operator is used similar to a ProcessLog but adds a sort of listener to the monitored operator which is called each time new values arrive


    I would probably prefer Way 2 if I would implement this type of inner-operator-monitoring.

    Cheers,
    Ingo
Sign In or Register to comment.