"Feature selection and SVM modeling for text classification"
I'm working on a project of text classification with Rapid Miner. I want to predict the category of some questions,so I have a polynominal label(with 4 classes) as target attribute.
I tried to do modelization with Naive Bayes and the process works in a good way,but I have some questions:
1)My dataset(that is divided in training and test set with cross-validation) is composed of .txt documents. Now all words of these documents are single attributes("features") used for modelization. I've tried "Select attribute" for improving my selection of the features but I think that is quite limitated.
I would want to select part of speech or bigrams as features.. Do you know some instruments or extension that permit this selection of features?
2)I can't use Support Vectore Machines methods because they don't support polynominal labels. I think that is very strange because SVM are good methods for text classification. How can I use them for multi-class prediction?
Thank you for the help.