Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
How to make automodel doing cross-validation?
wanglu2014
Member Posts: 19 Contributor II
Thank for your attention. In automodel, imported data are splited into training and validation with a ratio. However, for improve the reliability of model, can we modify the spliting process into cross-validation?
Tagged:
0
Answers
Certainly, just open the process for the model you want and then change the process from split validation into cross validation and rerun.
Lindon Ventures
Data Science Consulting from Certified RapidMiner Experts
Lindon Ventures
Data Science Consulting from Certified RapidMiner Experts
Today I was showcasing RapidMiner AutoModel to a new coworker. With the Titanic dataset, if you select a Logistic Regression (that is the case I remember, but there might be many others) there is no such thing as a Split Validation operator. Instead, the process performs a Split Data operator in an early stage and applies the Performance operators as the final ones, which is what I call the manual way to perform validation.
In that case, it is not as simple as changing the operator. (Others are, though).
My advice would be to reorder the process and understand how it works because while AutoModel is a great beginning of a data science project, it is still a beginning: our project still lacks proper documentation (it still cannot generate the documentation for our domain expertise), removal of boilerplate steps (if our dataset doesn't have text, why handling text?), and adapting the process to our use cases.
I know, this is not the kind of happy answer that magically solves our problems and having to go through the process is especially frustrating for newcomers to RapidMiner, but please focus in that RapidMiner does have a #noblackboxes philosophy that allows people to go from nought to 60 in a few seconds by having access to what the process does.
(@Telcontar120, are you having the same deja vu I had? Wasn't this the topic of our conversation when we met each other?)
Hope this helps,
Rodrigo.
Varun
https://www.varunmandalapu.com/
Be Safe. Follow precautions and Maintain Social Distancing