How can I compare my prediction to the original label with the Validation Operator?

GLopesGLopes Member Posts: 3 Newbie

I'm doing a text mining project where I'm classifying text with a given label. I've split my data 70/30 with the Split Validation Operator. 

However, as this video "Finding the right model" on RapidMiner Youtube Page shows, I'm unable to see ofr which documents did my model fail. I can only see the confusion matrix... 

How can I see for each document which ones the model was wrong, as the Cross Validation operator does?

Best regards :)


  • Options
    varunm1varunm1 Moderator, Member Posts: 1,207 Unicorn
    edited June 2019
    Hello @GLopes

    Did you connect the "exa" of performance operator to the output "res"?

    This will give you example set with original and predicted labels. You can analyze which are correct and wrong.

    If you need more help just share you XML code by copying from (View --> Show Panel --> XML) and pasting here.

    Hope this helps.


    Be Safe. Follow precautions and Maintain Social Distancing

  • Options
    GLopesGLopes Member Posts: 3 Newbie
    Hello! Thank you so much for helping! I'm completely lost and I've seek the whole Internet for help on RapidMiner. 

    I have the Performance Operator inside the Split validation, so it will only let me connect the "per" and the "exa" to "ave"... 

    Here's the XML:  codeshare.io/UbKVU 
    (too big to post her e:\ )

  • Options
    Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn
    Just output your model via the model port and then use another Apply Model operator to score the data (again) and then you will be able to do the comparison. 
    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • Options
    GLopesGLopes Member Posts: 3 Newbie
    so, Telcontar120, inside the Validation, should I not use an Apply and a Performance? I'm confused..

    Sorry it's my first RapidMiner process after the tutorials :\
  • Options
    sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
    hi @GLopes you may find the new Text Mining training resources on the RapidMiner Academy more useful and relevant to your project:



Sign In or Register to comment.