I read the DB contents using DatabaseExampleSource operator (work_on_database is not set), and then I used the Nominal2Binominal operator for converting the nominal attribute values. But, the problem is that Nominal2Binominal runs forever(too slow, running for more than 1h and it still continues). How do I speed up the process? Will setting create_view to true, help here?
Hi, the process setup seems to be ok, but if you have a really high number of nominal values per attribute, the binomalization will create a huge amount of attributes. If you don't activate the view, they are all created, calculated and stored in memory during the operators runtime. If you just use them once for the SOM, it would be usefull to create the view. This would have the effect, that the results wouldn't be saved in memory, instead calculated if needed (here one time and hence as often as otherwise). So you would save the time for creating the attributes in main memory.
Ok! You are right in my case that some of the nominal attributes take around 50 different values.
After setting the 'create_view' for the Nominal2Binominal (after that, I have also used Nominal2Numeric with the 'create_view' setting, because the subsequent SOMDimensionalityReduction requires all the values to be numerical), it doesn't hang at it. But, the subsequent SOMDimensionalityReduction throws out the 'OutofMemory' error. I tried increasing it in the RapidMinerGUI.bat and rapidminer.bat. But, the same memory error is reported again.
In fact, I have posted a separate thread for the 'OutofMemory' error. How do I come out of it?