Options

Gradient boosted trees parameters optimization

marimari Member Posts: 1 Contributor I
edited December 2018 in Help

Hi,

What are the parameters of Gradient Boosted Trees that shoud be optimized, that can make a difference in performance?

Answers

  • Options
    Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn

    Hi, technically any of the parameters can be optimized using the various optimization operators, but the parameters that have the largest impact in my experience are the number of trees, the maximal depth, the minimum split improvement, and the number of bins.

     

    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • Options
    MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,517 RM Data Scientist

    I would rather take learning rate than min_split

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.