Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
not considered to effect after that. This is how the value is calculated. When we take the value 0.9 we obtain the red line in the image. It gives quite a good approximation of our data points. The green line represents beta = 0.5. It is a 2-time unit average, so it adapts to the change in the data