RapidMiner generates the Blue Screen of Death

SGolbert

Hi all,

I wanted to bring the attention to a long lasting problem with RM that I haven't seen reports or developments on. The problem concerns RM Studio running on Windows (it should happen in Linux too though), and involves RM crashing the system when using too much memory.

It has happen to me also when using good machines (32 GB RAM), specially when running something in AutoModel in the background. I thougth the JVM was inmune to these issues, but that is clearly not the case.

Is the software development team aware of the problem or doing something to prevent it? The ideal solution would be to abort the process (one of them, in case multiple process are running). At the worst close all process and RM itself. But NEVER crash my OS!

Regards,

Sebastian

varunm1

I too agree with @SGolbert. If RAM usage is high the windows is getting stuck and I need to manually power cycle the system . I raised this earlier but I got suggestions to limit RAM in RM preferences.

hughesfleming68

This can be a complex issue. I solved all my BSOD problems by doing the following. Set a physical limit to memory and switch off hyperthreading. In my tests, both the JVM and Python/Tensorflow were faster with hyperthreading off. This may be due to various security mitigations that were introduced in the last 24 months. Lastly, switch off this nasty piece of software from Intel that is used to adjust turbo boost that Windows would install automatically. It took me a few months to sort that one out.

On windows, I would install whocrashed. It lets you know which driver is ruining your day. https://resplendence.com/whocrashed. This is a crash dump analyser.

Take a picture of the BSOD and post it. In my experience, it has nothing to do with the JVM.

SGolbert

Hi @varunm1

That's a good work around, if it works. I still wonder why does the OS crash. Isn't it possible to use virtual memory?

varunm1

Actually, it should throw an outofmemory error and stop. I am not sure why its crashing OS. May be @Marco_Boeck have some insights.

Marco_Boeck

Hi,

To be perfectly honest here, I'd love it if I could create bluescreens by coding regular Java , but the truth is, I cannot. If something happens, it would be outside of our control, like a result of some unfortunate combination of the Java VirtualMachine and other external factors like @hughesfleming68 mentioned above.

Therefore there is pretty much nothing we can do on our end.

Regards,
Marco