Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

Gradient boosting weights

k_vishnu772k_vishnu772 Member Posts: 34 Learner III
edited June 2019 in Help
Hi all,
I ran the model with gradient boosting algorithm in rapid miner and I have seen the weights generated for each input parameter and some of them have zero weight does that mean that those are eliminated from the model.does that mean it feature selects the parameters with positive weight?
Could you please help me in this.

Regards
Vishnu

Best Answer

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,531 RM Data Scientist
    Solution Accepted

    Hi,

     

    yes and yes, i would call it feature selection. I often use this (or the weights of an RF) for feature selection. Just use a Select by Weights operator afterwards.

     

    Best,

    Martin

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,531 RM Data Scientist

    Hi @k_vishnu772,

    the weights are caculated in the aftermath. Basically you run over all trees an calculate the influence of each cut and sum over it. A value of 0 in the weights indicates, that this attribute was never used for any split.

     

    Cheers!

    Martin

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • k_vishnu772k_vishnu772 Member Posts: 34 Learner III

    @mschmitz

    so attibute of weight zero means even if i remove those in the model i should be able to get the same results right ?

    and it is a kind of feature selection

Sign In or Register to comment.