How can I improve the accuracy of my models ?

rod33rod33 Member Posts: 4 Newbie
Hello, 

I have this Rapid Miner assignement to do!

I have to train and find a model that bests predict the credit downgrade of firms (variable: downgrade). I have two data sets: event.train (with "downgrade" and "Rating Rank") and event.test (without "downgrade" and "Rating Rank"). The only problem is that the best predictor variable is "Rating Rank" and so the accuracy drops from 93% to 70% when I don't train my model with "Rating Rank"... 

Any suggestions? 
Thanks 

Best Answer

Answers

  • rjones13rjones13 Member Posts: 154 Unicorn
    Hi @rod33,

    There's two main approaches to improving the model performance. The first is to improve the model; you could try different models, or increase the model complexity, and even try and run a model optimization. The second approach is to try and improve the input data, and here we might use Feature Engineering. Have you had a chance to see the RapidMiner Academy, it has some excellent content on both.

    Best,
    Roland
  • rod33rod33 Member Posts: 4 Newbie
    thanks for you answer! 

    I tried with 5 models and my data is cleaned with turbo prep so i don't know where to look anymore haha... 
    I'll try to look into it with your advices, thanks! 

    If you have any other suggestions i'm here :)

    Best, 
  • rjones13rjones13 Member Posts: 154 Unicorn
    Feature Engineering looks at how we can transform the variables, and also combine them (especially numerical columns). There's an option to turn it on in Auto Model, or there's operators to help with this. 

    Here's two videos to get you started (the first is quite long):
    Best,
    Roland
  • rod33rod33 Member Posts: 4 Newbie
    thanks!!

    I tried and applied the video to the letter but i'm only gaining 1% in accuracy and my f1 measure is still pretty low... (45%) i'll try to look for other solutions!! 
  • SD_24SD_24 Member Posts: 2 Newbie
    Hi @rod33

    Could you provide the model screen shot?
  • rod33rod33 Member Posts: 4 Newbie
    i solved the issue ! thanks tho
Sign In or Register to comment.