Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

performance of algorithm in train set

LefterisLefteris Member Posts: 6 Learner I
Good evening
I would like to ask if I can get the performance (average error) of the algorithm in the train set to compare with the performance in validation set;
Thanks in advance

Best Answers

  • jacobcybulskijacobcybulski Member, University Professor Posts: 391 Unicorn
    Solution Accepted
    Yes, it is done commonly, especially when optimising models, to check that the algorithm still had the capacity to learn (performance on a training set) vs its practical use (performance on a validation set). Simply apply the model to both the training and validation sets, and then run each result via a performance operator. Note that you can always utilise copies of the training data which emerges on output from the trained model to immediately apply the model to it, and then a copy of the model which emerged on output from Apply Model to be applied the second time to the validation data set. If this is done in an optimisation loop, which may be iterating over some model parameter (e. g. k of knn), then typically we would also use a Log operator to log the model parameter vs the performance on training and validation. 
  • LefterisLefteris Member Posts: 6 Learner I
    Solution Accepted
    thank you so much jacobcybulski for the useful information

    you are awesome
Sign In or Register to comment.