Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
Select weight by accuracy
fiddinyusfida
Member Posts: 12 Contributor II
Hi everyone,
I am conducting a classification experiment by using weight. My scenario is I divided the whole dataset using 10-Fold Cross-validation. In every training phase, I want to obtain some weights by accuracy results. And the final is applying the weight into the testing phase.
For example, I have 3 classifiers, the result from these classifiers are SVM = 80, NB = 60, and RF = 90.
Is it possible to obtain weight from the specific measurement like accuracy during training phase?
I am conducting a classification experiment by using weight. My scenario is I divided the whole dataset using 10-Fold Cross-validation. In every training phase, I want to obtain some weights by accuracy results. And the final is applying the weight into the testing phase.
For example, I have 3 classifiers, the result from these classifiers are SVM = 80, NB = 60, and RF = 90.
Is it possible to obtain weight from the specific measurement like accuracy during training phase?
Tagged:
1
Answers
Are you trying to build some kind of voting ensemble where you weight the vote by the overall accuracy?
In either case, why would you ever want to look at this accuracy only from the training phase? That's not usually sound since training accuracies are notoriously overfit.
Lindon Ventures
Data Science Consulting from Certified RapidMiner Experts