Options
Classifying as unknown if confidence is under a certain threshold
Maven
Hello there!
So here is my current problem: I'm doing a classification task and I would like examples to be marked as unknown ( '?' ) when the model's confidence is under a certain threshold. I tried using the ThresholdFinder operator, but it seems to only accept binominal exampleSets (whereas I have a polynominal one.) I also tried to include my LibSVMLearner in CostBasedThresholdLearner, which seems like the right track. However, I don't really understand how to configure the CostBasedThresholdLearner to suit my needs...
Am I on the right track here? If not, is there an operator I have not found yet which could work?
Thanks in advance for your help!
- R
Edit: I just found the UncertainPredictionsTransformation operator. You guys really though of everything
So here is my current problem: I'm doing a classification task and I would like examples to be marked as unknown ( '?' ) when the model's confidence is under a certain threshold. I tried using the ThresholdFinder operator, but it seems to only accept binominal exampleSets (whereas I have a polynominal one.) I also tried to include my LibSVMLearner in CostBasedThresholdLearner, which seems like the right track. However, I don't really understand how to configure the CostBasedThresholdLearner to suit my needs...
Am I on the right track here? If not, is there an operator I have not found yet which could work?
Thanks in advance for your help!
- R
Edit: I just found the UncertainPredictionsTransformation operator. You guys really though of everything
0
Answers