Options

How to evaluate the performance of supervised learning of auto model?

APAP Member Posts: 37 Contributor II
How to evaluate the performance of supervised learning of auto model?Is there any documentation about this?

Best Answer

  • Options
    ceaperezceaperez Member Posts: 528 Unicorn
    Solution Accepted
    Hi @AP

    Into Automodel you have a button "Open Process" click on and then you can see the scoring, validation block.
    Inside you have the validation subprocess.

    Best, 

    Cesar

      

Answers

  • Options
    ceaperezceaperez Member Posts: 528 Unicorn
    Hi @AP,

    You have two ways.
    1- In each model used in Automode you have a specifif topic for performance with some performance meassurements.
    2- You can open the automodel process and then, into the performance opertator, change the automatically selected metrics for your desired ones.

    Best

    Cesar
  • Options
    APAP Member Posts: 37 Contributor II
    What I want to know is Whether it's based on training set or test set
  • Options
    ceaperezceaperez Member Posts: 528 Unicorn
    Hi again @AP

    when you open the model, the performance operator is applied to validation set.

    Best.

    Cesar
  • Options
    APAP Member Posts: 37 Contributor II
    The performance is based on cross validation?default ten fold?
  • Options
    ceaperezceaperez Member Posts: 528 Unicorn
    Hi @AP
    when you open the proposed model in automodel you can check the validation process. 

    As far I remember the system use to work with a Hold-out set but I don't remeber the number of partitions. 

    You can check it in your results. 
  • Options
    APAP Member Posts: 37 Contributor II
    “when you open the proposed model in automodel you can check the validation process. ”--How can I do it?Can you give me a graph?
  • Options
    APAP Member Posts: 37 Contributor II
    Yes, I see. Thank you very much
Sign In or Register to comment.