Two different performance scores? (Deep Learning)

dubbhismdubbhism Member Posts: 2 Contributor I
edited November 2018 in Help

Hello everybody,

 

I'm strictly a newbie, and i've been experimenting for a while, mostly with the new Deep Learning module. So far so good, but recently i noticed that the (regression) performance module gives me performance-values that are not the same as the values given by H2O. I do remember that at an earlier moment, this was not the case, but i can't figure out what has changed. The H2O values seem more reliable Any ideas?

 

I've added an example of a process

Greetings,

Anton

Best Answer

  • mschmitzmschmitz Posts: 2,316  RM Data Scientist
    Solution Accepted

    Hi dubbhism,

     

    the performance measures in the description of DL are training errors, not real prediction errors. Thus they are different to your splitted data and also should be treated with care. We always recommend to use Cross validation.

     

    ~Martin

    - Head of Data Science Services at RapidMiner -
    Dortmund, Germany

Answers

Sign In or Register to comment.