Creating Charts for Performance Measurement Parameters
I have 2 phases question which I need advice. I have imbalanced data set and according to literature, accuracy is not accurate parameter for these kind of data for performance measurement of classification algorithm.
I applied parameter optimization for decision tree algorithm with both cross validation for binomial and classification performance. (I am currently using three types feature selection algorithm and try to find out their effect on performance of classification). firstly, ı need to visualize roc curve which shows different results for same algorithm (for example fist graph will indicate result of DT main creation: accuracy, depth:100; confidence:0,050 and another result DT main reation: gain ratio, depth:50; confidence:0,200).
Second question is, how I can compare with graphics other parameters like kappa, NPV, PPV ..
I hope I clearly express my question.
Your valuable contribution will highly appreciated.