Probabilities from LogisticRegression

evgenyevgeny Member Posts: 11 Contributor II
edited November 2018 in Help
Hi, I am trying to find a way of extracting probabilities out of a LogisticRegression model.

I found a post which talks about "converting" confidence values into probabilies using the PlattScaling operator.

However, I am finding that the confidence values which are produced following PlattScaling are not the logistic regression probabilies that I would expect (i.e. taking the callibration parameters for the logistic regression generated by RM (which are spot-on) and manually computing the probability as prob = exp / [1 + exp] ).

what am i doing wrong? and is there a way to extract the logit probabilities?

many thx.


  • Options
    landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    I think this is because the PlattScaling uses another algorithm to determine the probabilities. But I'm not that familiar with this algorithm, that I could describe what's happening there...

  • Options
    evgenyevgeny Member Posts: 11 Contributor II
    thx, Sebastian.

    further to my original post: the LogLikelihood figure produced by RM is what i would expect if regression probabilities were p = exp / [1+exp ]

    which is not the case if one was to compute the LogLikelihood with produced Confidence values both before and after PlattScaling. (both of which result in poorer fit, in my particular case).
  • Options
    earmijoearmijo Member Posts: 270 Unicorn
    Try using the Weka's LogistRegression operator. It's faster and it will give you the probabilities you want (after ModelApplier).

Sign In or Register to comment.