Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
GC overhead limit exceeded
Legacy User
Member Posts: 0 
Newbie
Hello,
for an extensive GridParameterOptimization, RapidMiner terminates after
a while with:
OutOfMemoryError
Process failed Message:
GC overhead limit exceeded
How can I fix this problem?
More memory for the JVM is not possible since all my 4GB are already
used.
On
http://java.sun.com/javase/technologies/hotspot/gc/gc_tuning_6.html#par_gc.oom
I found that with the option "-XX:-UseGCOverheadLimit" this error can be
avoided. Is this a good solution?
Or should I try to integrate the MemoryCleanUp operator into my model (which
is very simular to sample 11 in the meta validation directory).
Best regards,
Sascha
for an extensive GridParameterOptimization, RapidMiner terminates after
a while with:
OutOfMemoryError
Process failed Message:
GC overhead limit exceeded
How can I fix this problem?
More memory for the JVM is not possible since all my 4GB are already
used.
On
http://java.sun.com/javase/technologies/hotspot/gc/gc_tuning_6.html#par_gc.oom
I found that with the option "-XX:-UseGCOverheadLimit" this error can be
avoided. Is this a good solution?
Or should I try to integrate the MemoryCleanUp operator into my model (which
is very simular to sample 11 in the meta validation directory).
Best regards,
Sascha
0
Answers
If your app has a lot of concurrent procceses, or it uses a lot of recursion, you should take a look at the Concurrent Collector ..
Here you'll find a lot of information about it http://java.sun.com/javase/technologies/hotspot/gc/gc_tuning_6.html#par_gc.oom
If you have multiple proccessors, then the Concurrent Collector may be very helpful here ..
Hope this helps ..
C ya
could you post your process here and tell us, how many memory is available? This is shown in the memory monitor on the lower right.
And take a look at the log messages if there are some warnings.
Greetings,
 Sebastian