RapidMiner

Which Validation operator should be used for model evaluation?

SOLVED
Contributor II

Which Validation operator should be used for model evaluation?

The Accuracy given by the Performance Vector for Split validation and Cross validation is different. Where Cross validation shows slight improvement in accuracy. Which validation operator is preferred the most in case of model evalation?

1 REPLY
Community Manager

Re: Which Validation operator should be used for model evaluation?

There are big differences on how Split and Cross Validation operator but the intent is the same, train, test, and measure performance of a model.  The Cross Validation operator gives a more honest estimation on how the model would perform on unseen data sets. This is why in the accuracy measure for a CV model you might see 70.00% (+/- 5%). The +/- 5% is essentially one standard deviation of the average 70% accuracy . 

 

Go check out Ingo's paper on model validation to learn more: https://rapidminer.com/resource/correct-model-validation/

Regards,
Thomas - Community Manager
LinkedIn: Thomas Ott