Breakpoint
Can I use a breakpoint to run the model from that particular point??
My situation is:
Suppose, I have a huge model with n number of joins, m number of filtering and cleaning operators and at the end I have a Neural net. If I make a small change in one of the join or cleaning operator somewhere in the middle of the model, I had to run the entire model to see the results which is taking 1- 3 mins. Is there any way that I can create a checkpoint in the model so that, I should be able to run the model from that particular point next time instead of running it from the beginning. Is it posisble in Rapidminer????
Is that the purpose of Breakpoint? But I dont see it that way. I can observe that at breakpoint the flow stops and shows us the result.
If there is any way to solve this. Please let me know.
Thanks in advance.
Best,
Raj
Answers
Breakpoints are a way to pause your process and review results coming in or going out of an operator. It is especially useful for debugging and such.
You can't select an operator and run your process from there like say a checkpoint, doing that would eat up a lot of memory and RapidMiner is optimized for memory usage.
As Thomas said, you can't do that with a breakpoint. However, you could use the "Store" operator to store your pre-processing results and then just drag those results into your process.
I think there is no alternative to the model training time, even if the data is only slightly different, the final model could be VERY different.
That said, it looks as you are spending much of the time in the data prep step. You can easily save some time there by saving an intermediate result with the store operator, especially if you know that the data prep process is constant until a certain point.
Another idea is to try different things in one go, so that you can leave the process running while you drink some coffee