Creating Charts for Performance Measurement Parameters
ozgeozyazar
Member Posts: 21 Maven
Hi All !,
I have 2 phases question which I need advice. I have imbalanced data set and according to literature, accuracy is not accurate parameter for these kind of data for performance measurement of classification algorithm.
I applied parameter optimization for decision tree algorithm with both cross validation for binomial and classification performance. (I am currently using three types feature selection algorithm and try to find out their effect on performance of classification). firstly, ı need to visualize roc curve which shows different results for same algorithm (for example fist graph will indicate result of DT main creation: accuracy, depth:100; confidence:0,050 and another result DT main reation: gain ratio, depth:50; confidence:0,200).
Second question is, how I can compare with graphics other parameters like kappa, NPV, PPV ..
I hope I clearly express my question.
Your valuable contribution will highly appreciated.
Özge
I have 2 phases question which I need advice. I have imbalanced data set and according to literature, accuracy is not accurate parameter for these kind of data for performance measurement of classification algorithm.
I applied parameter optimization for decision tree algorithm with both cross validation for binomial and classification performance. (I am currently using three types feature selection algorithm and try to find out their effect on performance of classification). firstly, ı need to visualize roc curve which shows different results for same algorithm (for example fist graph will indicate result of DT main creation: accuracy, depth:100; confidence:0,050 and another result DT main reation: gain ratio, depth:50; confidence:0,200).
Second question is, how I can compare with graphics other parameters like kappa, NPV, PPV ..
I hope I clearly express my question.
Your valuable contribution will highly appreciated.
Özge
0
Answers
many thanks for your time and your recommendation.
Additionally, I need to create a recall and precision plot as well. Hope there is a node which will help me to create this plot.
Regards,
Özge Özyazar
Lindon Ventures
Data Science Consulting from Certified RapidMiner Experts