# F-Score for Multiclass Problems?

hi,

in binomial classification, f-measure exists, but not in Performance (Classification) operator for multiclass data,

does there exist a f-measure for multiclass problems? is it in some way possible to built or generate an attribute f-score (multiclass) with the existing fields like precision / recall etc.?

what about 2* (Precision(class1+class2+...+class_n)*Recall(class1+..+class_n)) / (Sum of precision + recall over all classes) ?

does that make sense in some way? what do you guys think?

Is this still comparative? I know with more classes it is likely that precision and recall will go down, do the multiplication factors tend to weight too much and take bad performance too much into account, regarding the division by the sum of terms in the denominator? or is it still accurately enough?

I just want to get a better performance measure overall for the whole result if one class is just massively underrepresented...

## Answers

2,045RM Data ScientistHi,

isn't logloss a good option for you?

~Martin

Dortmund, Germany

344Unicornhm I don't know how to interpret logistic loss..

it is ln(1+exp(-[conf(CC)])), so it calculates that formula with the value of confidence for the class predicted which (should) be the correct class, and adds it up for all training examples and then averages it, is that correct?

so the smaller the confidence, the bigger the logistic loss.. but in what range are the values and how should I interpret them? what is a small/ big loss?

1,150UnicornHere's a good simple explanation of logloss from Kaggle, where it is a popular performance metric:

https://www.kaggle.com/wiki/LogarithmicLoss

The value range is dependent on the dataset you have and the predictive power of your attributes, there is no absolute answer that says what a "good" logloss is vs a "bad" one.

Lindon Ventures

Data Science Consulting from Certified RapidMiner Experts

497UnicornFor a multi class if we need F-1 score. Do I need to calculate manually from recall and precision? I see there is no option in rapidminer this. I want to calculate due to workshop requirement.

Thanks,

Varun

Varun

193RM Data ScientistYou can get weighted average of the F1 scores of each class for the multiclass task. So the multi-class problem has to be converted to multiple binomial tasks, one task for each class. You will need the performance (binomial classification) and performance to data then aggregate to get the average F1 scores.

each F1 = 2 * (precision * recall) / (precision + recall)

https://en.wikipedia.org/wiki/F1_score

YY

497UnicornYep, RM provides weighted mean Precision and recall from performance multi class operator. I will use it to calculate the over all f1 score.

Thanks

varun

Varun

193RM Data ScientistSurely the weighted mean precision and recall from multi-class performance is useful. If you use the weighted recall and weighted precision to generate F1 = 2 * (precision * recall) / (precision + recall)

it may not be the expected F1. Since the formula is non-linear. The one you calculated would be slightly higher.

Here is a quick test on iris data

F1 score with the weighted recall and weighted precision from multi-class performance would be 2*91.67*92.24/(91.67+92.24)=91.95%, but the other methods by averaging on the f-scores of each class will give you 91.62%