I am supposed to create a predictive model using old data for training and then apply it to a new dataset. However when I try to apply it to my new dataset it says that there is missing attributes. I have tried a number of combinations and cannot resolve it.
If anyone knows how I can resolve this issue, help is more than welcomed,
You remove on both old and new set the correlated attributes, and most likely one of the removed attributes (SC_MCV in this case) wasn't considered as correlated in the training set. Or just above the threshold in one set and below in the other set...
You need to ensure therefore that the attributes you keep for both CSV 1 and CSV (3) are the same as you used for your model. Though I think you can actually just remove the correlated attributes filter from the test set as the non used attributes probably will be ignored.
in both cases the are numerical but in the original dataset they are nominal and I believe it is because when transforming into dummy variables, the value npvrv =1 does not exist in the new dataset. because I tried removing the attribute in both dataset and it gave me the same issue with another attribute. so I conclude that it is because in the first dataset there are values that are not in the second and that creates an issue when it recodes in dummy variable. but I don't know how to solve or if it is possible to solve ?
Thank you so much for your help
0
MartinLiebigAdministrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University ProfessorPosts: 3,453 RM Data Scientist
Hi,
i think you want to use the Parse Numbers operator on the upper stream before you use Nominal to Numerical.
Best,
Martin
- Sr. Director Data Solutions, Altair RapidMiner - Dortmund, Germany
Answers
You need to ensure therefore that the attributes you keep for both CSV 1 and CSV (3) are the same as you used for your model. Though I think you can actually just remove the correlated attributes filter from the test set as the non used attributes probably will be ignored.
Dortmund, Germany
Dortmund, Germany
Dortmund, Germany
Thank you so much for your help
Dortmund, Germany