RapidMiner

Lower accuracy of libsvm in rapidminer vs weka with same parameters

Contributor II njasaj
Contributor II

Lower accuracy of libsvm in rapidminer vs weka with same parameters

Hi,
I am really getting confused. I used a same data set with same parameters in weka and rapidminer for classification with libsvm. the strange result was that weka accuracy for prediction was 15 percent higher than rapidminer???(I used same C and same kernel and same gamma for rbf kernal).I think there is something wrong with weka. it's accuracy on training set for testing phase is 100%.
Can any body explain it?
Thanks a lot.
7 REPLIES
Contributor II njasaj
Contributor II

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

In addition to above i must say that my data set is imbalanced. rapidminer fail to predict the two smaller classes and just predict the largest class
725  188    211
3      1          1
1      0            1

but weka with same parameters gives
729    0    0
124    65    0
111    0    101
I did not use any weight for classes in weka.Help me please and tell me what is wrong with rapidminer?

thank you.
RM Partner
RM Partner

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

There are many different implementations of the SVM. If the Weka implementation works better on your data, you can easily integrate Weka with RapidMiner by installing the Weka Extension. For comparing models please remember to cross-validate them - as you know the training error alone is not an indicator on how well the model will work on unseen data.

Best, Marius

Marius Helf
LinkedInTwitter
RM Partner
RM Partner

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

BTW, you should optimize each implementation separately - for different implementations different parameter sets *might* work better.

Marius Helf
LinkedInTwitter
Guru
Guru

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

does  the Weka LibSVM implementation still exist or was it removed? Somehow I cannot see any LibSVM Weka implementation anymore in the list...? Would like to try it out..

RM Certified Expert
RM Certified Expert

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

The version of Weka we implement is v3.6.9. But from this: https://weka.wikispaces.com/LibSVM it appears it's a 3rd party tool that needs to be downloaded and installed seperately. It looks like if you want to use the Weka implementaiton of LibSVM, you have to download it extra. 

Highlighted
Guru
Guru

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

thanks, but it seems that the download links are broken..

RM Certified Expert
RM Certified Expert

Re: Lower accuracy of libsvm in rapidminer vs weka with same parameters

I can't do anything about that. Smiley Sad Maybe contact them, somehow?