Options

# Feature Importance - logistic regression.

Could you please help me to know how to determine the feature importance in case of logistic regression.

Tagged:

0

💬0 Comments | 🔥0 Discussions | 👤0 Members | 🔌0 Online |

Options

Could you please help me to know how to determine the feature importance in case of logistic regression.

Tagged:

0

## Answers

1,195UnicornYou can use Auto Model for that :

- Submit your data to Auto Model

- Select "Logistic Regression" as model

- In the results screen, click on "Weights" under "Logistic Regression" ==> you will see the feature importance

Regards,

Lionel

291UnicornYou can also open the model itself and have a look at the coefficients. Generally, the higher the coefficient, the more importance certain variable has. Also, the sign matters, as positive coefficients support positive prediction while negative coefficients contradict positive prediction.

Vladimir

http://whatthefraud.wtf

29Contributor II323UnicornYou can. Following on from what @kypexin has already mentioned. This applies to linear models and also linear SVM for example. In order to make it work, you need make several runs across your data and then aggregate the model weights. Often you will see a pattern where repeated attributes have high weightings relative to the others. You can then rank them based on their weights. Looking at one sample is rarely enough if you have lots of attributes. There is a weights to example set operator these days which makes this less painful. In the old days, it required parsing text files which was a lot of extra work to setup. Even then it was worth the effort to do so.

There are also the feature selection operators, the most useful in my opinion being the Optimise feature selection evolutionary but don't ignore simple backward elimination. There are pros and cons to all approaches as you open yourself up to different ways of curve fitting. Auto Model is the newest way but understanding how the older operators work is a good use of time.