Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
No variance in confusion matrix output
Learner I
Hi,
If anyone is available now, maybe i can go in further details but in brief my team and I are building a model that should predict who among a list of
previous donators would donate for the next campaign, based on a database with previous donators and their characteristics.
We seem to do everything right but I think we face an overfitting issue because we always get the same results in the confusion matrix no matter how many tries we make.
Also, the model has extreme poor performances but what is really disturbing is that the output doesnt vary at all.. Any help ?
If anyone is available now, maybe i can go in further details but in brief my team and I are building a model that should predict who among a list of
previous donators would donate for the next campaign, based on a database with previous donators and their characteristics.
We seem to do everything right but I think we face an overfitting issue because we always get the same results in the confusion matrix no matter how many tries we make.
Also, the model has extreme poor performances but what is really disturbing is that the output doesnt vary at all.. Any help ?
0
Answers
Your data sets seem to be highly imbalanced with more than 3700 samples belong to one class and just 54 to another. You need to try data preprocessing methods like sampling (on training side) or weighting.
Also, try to do some feature selection and tune your hyperparameters of the model, you can do so by using Optimize parameter (Grid) operator.
Varun
https://www.varunmandalapu.com/
Be Safe. Follow precautions and Maintain Social Distancing
Varun
https://www.varunmandalapu.com/
Be Safe. Follow precautions and Maintain Social Distancing