Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

How can I improve the accuracy of my models ?

rod33rod33 Member Posts: 4 Learner I
in Help
Hello, 

I have this Rapid Miner assignement to do!

I have to train and find a model that bests predict the credit downgrade of firms (variable: downgrade). I have two data sets: event.train (with "downgrade" and "Rating Rank") and event.test (without "downgrade" and "Rating Rank"). The only problem is that the best predictor variable is "Rating Rank" and so the accuracy drops from 93% to 70% when I don't train my model with "Rating Rank"... 

Any suggestions? 
Thanks 

Best Answer

Answers

  • rjones13rjones13 Member Posts: 199 Unicorn
    Hi @rod33,

    There's two main approaches to improving the model performance. The first is to improve the model; you could try different models, or increase the model complexity, and even try and run a model optimization. The second approach is to try and improve the input data, and here we might use Feature Engineering. Have you had a chance to see the RapidMiner Academy, it has some excellent content on both.

    Best,
    Roland
  • rod33rod33 Member Posts: 4 Learner I
    thanks for you answer! 

    I tried with 5 models and my data is cleaned with turbo prep so i don't know where to look anymore haha... 
    I'll try to look into it with your advices, thanks! 

    If you have any other suggestions i'm here :)

    Best, 
  • rjones13rjones13 Member Posts: 199 Unicorn
    Feature Engineering looks at how we can transform the variables, and also combine them (especially numerical columns). There's an option to turn it on in Auto Model, or there's operators to help with this. 

    Here's two videos to get you started (the first is quite long):
    Best,
    Roland
  • rod33rod33 Member Posts: 4 Learner I
    thanks!!

    I tried and applied the video to the letter but i'm only gaining 1% in accuracy and my f1 measure is still pretty low... (45%) i'll try to look for other solutions!! 
  • SD_24SD_24 Member Posts: 2 Learner I
    Hi @rod33

    Could you provide the model screen shot?
  • rod33rod33 Member Posts: 4 Learner I
    i solved the issue ! thanks tho
Sign In or Register to comment.