Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

How to implement weighted AUC in RM

aldofcesattialdofcesatti Member Posts: 3 Learner III
edited October 2019 in Help
Hi everyone,

I am currently testing 5 different models that are trying to correctly classify a binary classification problem with an imbalanced dataset. The costs of misclassification are slightly different.  

To select the best of the 5 models that I built I want to implement weighted AUC, but I don't know what is the operator that should use to draw an set up the weighted AUCs in RM. Could you please help me?

Thanks in advance.

Aldo
Tagged:

Answers

  • varunm1varunm1 Member Posts: 1,207 Unicorn
    Hello @aldofcesatti

    Rapidminer has compare ROC operator, that helps get ROC curves for all the models you want to use and you can compare ROC curves to see the better model.

    Hope this helps.
    Regards,
    Varun
    https://www.varunmandalapu.com/

    Be Safe. Follow precautions and Maintain Social Distancing

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,529 RM Data Scientist
    I think you need to go for ROC to data, weight the points yourself and build a integral.

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.