RapidMiner

process failed: this process would need more than the maximum amount of available memory

SOLVED
Highlighted
Contributor II

process failed: this process would need more than the maximum amount of available memory

Hi I'm working with  the Association RuleGenerator, I have a PC with 8 GB of memory and the operating system of 64 bit. 

Now I'm using the RapidMiner Studio Educationale 7,4 version.

After I run the process, in correspondence of the preprocessing appear this:

"process failed: this process would need more than the maximum amount of available memory,reduce the amount of data by one of the sampling operators, optimize the process by using other learning or preprocessing schemes.

The dataset contains 35000 row and 5 column. Inside the preprocessing I use the "Discretize by frequency" and "Nominal2Binominal", then the FP-Growth and finally the Association RuleGenerator.

Thanks a lot.

Alessandra

 

See more topics labeled with:

1 ACCEPTED SOLUTION

Accepted Solutions
Moderator
Solution
Accepted by Thomas_Ott (Moderator)
‎02-16-2017 09:24 AM

Re: process failed: this process would need more than the maximum amount of available memory

Binominal and Association Rules operators require a lot of memory to process. If you have an 8GB laptop, assume 2GB is consumed for your operating system (if you have windows), so you probably only have about 6GB to do in-memory processing of your process. 

4 REPLIES
Moderator

Re: process failed: this process would need more than the maximum amount of available memory

You ran out of memory to do all the pre-processing and association rule calculations. you could try sampling it down or perform the analysis of a more powerful machine.

 

 

Contributor II

Re: process failed: this process would need more than the maximum amount of available memory

Thank you! 

However I don't understand well what means "You ran out of memory to do all the pre-processing and association rule calculations".

Thank you for the attention!

Alessandra

Moderator
Solution
Accepted by Thomas_Ott (Moderator)
‎02-16-2017 09:24 AM

Re: process failed: this process would need more than the maximum amount of available memory

Binominal and Association Rules operators require a lot of memory to process. If you have an 8GB laptop, assume 2GB is consumed for your operating system (if you have windows), so you probably only have about 6GB to do in-memory processing of your process. 

Contributor II

Re: process failed: this process would need more than the maximum amount of available memory

ok, it's clear!!!

I'm going to try to move rapid miner in external hardware.

Thank you so much!

Alessandra