Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.
feature selection for text classification
negar_mahini
Member Posts: 3 
Contributor I
Dear friends
I work on text classification with reuters-21578 dataset in rapid miner. When preprocessing will complete and word vector creates and terms are weighted with tfidf, i can not use the feature selection teqniques (such as IG, MI, GINI, ...) and then validation (contains classifier and performance element). Between process documents(preprocessing) and validation, how to use feature selection?
thanks
I work on text classification with reuters-21578 dataset in rapid miner. When preprocessing will complete and word vector creates and terms are weighted with tfidf, i can not use the feature selection teqniques (such as IG, MI, GINI, ...) and then validation (contains classifier and performance element). Between process documents(preprocessing) and validation, how to use feature selection?
thanks
0
Answers
what's the problem with using feature selection techniques? You can use them on the output of Process Documents the same way as you do on other data, i.e. a combination of Weight by XXX and Select by Weight.
As an alternative approach, you should try to train (and optimize) an SVM with a linear kernel on the complete data set with all attributes.
Best regards,
Marius