Options

"ROC confidence limits"

brianbakerbrianbaker Member Posts: 24 Maven
edited May 2019 in Help
Does anyone know how to control (toggle on/off) the confidence bands in the ROC curves?

I've copied code that has them into another process and they disappear!!

thanks!
Tagged:

Answers

  • Options
    landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    Hi,
    perhaps you don't have confidence attributes in your data?

    Greetings,
      Sebastian
  • Options
    brianbakerbrianbaker Member Posts: 24 Maven
    Sebastian,

    Thank you for your help!  I checked for that; they are there (in the performance export file).


    <com.rapidminer.tools.math.ROCPoint id="246">
                    <falsePositives>139.0</falsePositives>
                    <truePositives>68.0</truePositives>
                    <confidence>0.19407850064775464</confidence>
    </com.rapidminer.tools.math.ROCPoint>
     

    But, I can't figure out how to turn on the confidence band in the ROC plot.  I'd also like to know exactly what it represents; how, for instance, does it relate to the confidence value in the performance export file, is it the height of the shaded region?  I'd also like to know where this confidence comes from / how computed?


    If you have any answers or can point me in the right direction I'd appreciate it!

    Thanks!
    brian
  • Options
    steffensteffen Member Posts: 347 Maven
    I think the question has been answered here:
    http://rapid-i.com/rapidforum/index.php/topic,47.0.html
  • Options
    landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    Thank you Steffen,
    this saved me a lot of either work or inconvenience by pointing Brian on the source code  :)

    Greetings,
      Sebastian
  • Options
    brianbakerbrianbaker Member Posts: 24 Maven
    Thanks to you both Sebastian and Steffen!
Sign In or Register to comment.