Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
Optimize Parameter (Grid) Parameter
Hello,
I tried the Optimize Parameter (Grid) Operator in my Process, to find optimal Parameters for a decision tree. The Operator workd fine. My Problem now is, when i use the Parameters in a seperate decision Tree the accuraccy is different from the Optimize Operator.
For example:
The Optimize Parameter Operator detects that with the criterion gini_index and depth of 3 and in the cross validation with the stratified method and 5 folds the accuracy of 80%.
If I use these Parameters to the exact same Process (without Optimize Parameter) with same data and Operators, then the accuracy drops to 60%.
Is there any solution to this problem? Or is that explainable?
Thanks!
0
Best Answer
-
rfuentealba RapidMiner Certified Analyst, Member, University Professor Posts: 568 UnicornHello @dome,You are doing nothing wrong. Let me use the Titanic example to show you how to use the best available model. Attached you can find two processes.The training process:...and the Scoring process:This is just an example. If your scoring algorithm doesn't behave well with new, unseen data, you should store your data, see what the reality is and go back and forth until you find yourself comfortable. Splitting your process in training and production, and share the models between both helps recovering time.Hope this helps,Rodrigo.5
Answers
Can you share your process and your data in order we can reproduce what you observe ?
Regards,
Lionel
Please post your XML code based on the followung screenshot,
Varun
https://www.varunmandalapu.com/
Be Safe. Follow precautions and Maintain Social Distancing