gilbertocunha:

would that not have an impact on the gradient calculation?


You compute the gradient wrt to the weights, you added just a constant value to them, so no it wouldn’t impact the gradient computation.