Options
Peformance measure for XV and feature selection
Maven
Hi,
Using feature selection with XV inside of it to determine best variables for my model. I have an SVM learner and am using "binomial performance" as my performance test. I've indicated AUC as the measure.
When running RM and using the process log to output "performance" from the XV step, it is giving me a decimal that doesn't appear to be the AUC. Clearly RM is picking some OTHER measure of performance even though I specifically indicated to use AUC.
Does anybody have any idea what is happening? Is this a possible bug? Or am I understand the process wrong??
-N
Using feature selection with XV inside of it to determine best variables for my model. I have an SVM learner and am using "binomial performance" as my performance test. I've indicated AUC as the measure.
When running RM and using the process log to output "performance" from the XV step, it is giving me a decimal that doesn't appear to be the AUC. Clearly RM is picking some OTHER measure of performance even though I specifically indicated to use AUC.
Does anybody have any idea what is happening? Is this a possible bug? Or am I understand the process wrong??
-N
0
