I have a data set I'm trying to find the natural clusters in. I am using KNN to group the clusters and a Bayesian model to classify the cluster labels
The aim being the higher the accuracy of the Bayesian model, the better the clusters are (There will obviously be some manual checking done afterwards)
I embedded all of this information into an Optimize Parameters as well as a log file to tell me the performance of each iteration i.e. For every value of K output the performance of the model
I got the results below from the log file
As always, the xml of your process would be helpful. Since I don't have it, I can only guess: which performance are you logging? Your log operator should be configured to log the performance of the X-Validation operator. That will give you the accuracy estimated after application of the complete cross validation steps. If you log operator points to the Performance operator, you will only see the performance of the very last iteration of the X-Validation, i.e. the 10th step. That is not what you want to see and may explain the differences.
Just as a sidenote your accuracies are *very* high, and very high accuracies are always suspicious (unless you have really well-separated clusters). You may want to have another look at your process setup to see that everything is setup correctly.