The capability of optimization is granted to the trees since they are constructed with parameters to be modified in direction of reducing the total loss function of the regressor. A tree which reduces the total loss is added to the existing sequence of trees .