Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
Out of memory error
Saurabh_Sawant_24
Member Posts: 7 Learner II
I have a data set of 1.7 million of transactions running on windows server with 32 GB ram but still i am getting "Out of memory" error with HBOS algorithm.
Can someone help?
Can someone help?
Tagged:
0
Answers
Lindon Ventures
Data Science Consulting from Certified RapidMiner Experts
From the Settings --> Preferences menu, you can specify how much ram RM Studio can maximally use. One of the machines I use for RapidMiner development has 32GB of ram - and I have allocated up to 23 GB of ram on this machine for RapidMiner Studio as I have had processes fail due to running out of memory.
RapidMiner Studio doesn't automatically grab all of the memory you allocate when it loads, but if you allocate (for example) 20 GB of ram, RapidMiner Studio will use up to the amount of ram if needed. The Resource Monitor panel will always show you how much ram RM Studio is using at any given time.
I have also found it useful to close and restart RM Studio after running a memory intensive process - which frees up considerable memory given that at start up, RM Studio will not need to use all of the ram you have allocated in Settings -- Preferences.
Hope this has been helpful and best wishes, Michael Martin
we are running this process on RM server allocating 25 GB ram to 1 job agent container and 5 GB for Studio
After the process gets started we close the studio to freeup the memory.
As i am newbie to data science and rapidminer both
Can to tell me how to define or identify boundaries on HBOS ?
An example would really help me to understand. Thanks.
Lindon Ventures
Data Science Consulting from Certified RapidMiner Experts