How to Plot multi-class ROC curve in Rapidminer?

MunchCrunch19MunchCrunch19 Member Posts: 23 Contributor I
edited September 2020 in Help
How to plot the Multiclass ROC curve from below details (Results) in one Graph! There are Six Classes in my Case. A Picture is also uploaded for Better understanding of Multiclass ROC curves in One graph for an algorithm.

Regards


Tagged:

Best Answers

Answers

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
    hi @MunchCrunch19 check out the Compare ROCs operator. Go to the help menu and check out the tutorial.



    Scott

  • varunm1varunm1 Moderator, Member Posts: 1,207 Unicorn
    edited May 2019
    Hello @Telcontar120 and @mschmitz

    Just a thought, Can't we relabel one vs all manually (converting to binomial) and then run the validation methods on different one vs all to get ROC curves and average the performance metrics? I am not sure if there is an easier way in RM.

    Thanks,
    Varun
    Regards,
    Varun
    https://www.varunmandalapu.com/

    Be Safe. Follow precautions and Maintain Social Distancing

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
    @Telcontar120 you are correct. My bad. My eyes went right over the 'multi-class' requirement. Thx.
  • Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn
    @varunm1 That is the same as what I suggested, but you have to do it 6 times if you have 6 classes (6 different one vs all definitions, then run the model and store the ROC area, and then average them all at the end).  
    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • varunm1varunm1 Moderator, Member Posts: 1,207 Unicorn
    Thanks, @Telcontar120. Sorry my bad, read it differently. But in the long run, if there are many classes, this doesn't seem to be a feasible option if people need multiple ROC curves in case of multiclass classification. But I also see very less AUC or ROC comparisons in research for multiclass classification.
    Regards,
    Varun
    https://www.varunmandalapu.com/

    Be Safe. Follow precautions and Maintain Social Distancing

  • MunchCrunch19MunchCrunch19 Member Posts: 23 Contributor I
    @varunm1, The Problem is How to do it, I mean one vs all? Could you show me the Process in Rapidminer!
  • varunm1varunm1 Moderator, Member Posts: 1,207 Unicorn
    @MunchCrunch19 Process and figures updated in the above post with clear distinction.
    Regards,
    Varun
    https://www.varunmandalapu.com/

    Be Safe. Follow precautions and Maintain Social Distancing

Sign In or Register to comment.