A static model
I'm trying to compare some of my normally trained models to a predefined, static one.
I have a x-validation box for one of the proper models that outputs all sorts of performance values I need (and that's what I want indeed). I created another x-validation box for the static model so the values outputted would be comparable. However, what I couldn't figure out how to do is to tell the model what its output should be. Basically, I have an attribute which is what I want as output for each record, and another attribute with the correct output, and I just want to see what my static outputs' performance is with exactly the same folding as for the proper models.
Could anyone please help me out with some suggestions?
(btw, rapidminer seems to manage memory pretty badly, if any other java application is open next to it everything will crash, so I either use my browser and check emails or use rapidminer, which is quite a pitty. [end of complaint])