Prospective evaluation of model prediction
Fairly new to datamining, so this maybe a really dumb question, but I have built a model in RM based on retrospective data that appears to perform very well on both validation and test/holdout data-sets. The model is supposed to predict what will likely be the outcome on some binominal variable one year from now. So I am wondering, when I do know the actual outcome one year from now, how should I ideally evaluate my model performance? I'm thinking there must be some probabilistic uncertainty to be accounted for? Basicly I am trying to compare expected values/probabilities with real values.