Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
of days moving average we are calculating. The number of days average=1/(1-beta) Now, if we have to calculate the weighted average of 50 days with beta 0.9 This is the calculation, thus we are providing different weights to the impact of different time units. The (0.9)¹⁰ becomes very less and is