🥳 RAPIDMINER 9.9 IS OUT!!! 🥳
The updates in 9.9 power advanced use cases and offer productivity enhancements for users who prefer to code.
CLICK HERE TO DOWNLOAD
Prospective evaluation of model prediction
Fairly new to datamining, so this maybe a really dumb question, but I have built a model in RM based on retrospective data that appears to perform very well on both validation and test/holdout data-sets. The model is supposed to predict what will likely be the outcome on some binominal variable one year from now. So I am wondering, when I do know the actual outcome one year from now, how should I ideally evaluate my model performance? I'm thinking there must be some probabilistic uncertainty to be accounted for? Basicly I am trying to compare expected values/probabilities with real values.
0
Best Answer
-
varunm1 Moderator, Member Posts: 1,207  
 Unicorn
Hello @Casper72
Are you looking for Chi squared test? This is generally used to find a significant relationship between two same attributes(one with expected values and one with observed values).
Please inform if you need more information.
Regards,
Varun
https://www.varunmandalapu.com/Be Safe. Follow precautions and Maintain Social Distancing
7
Answers
Brilliant. Should have thought of that.